deploy/spark-connect/sample-run.log
# knutpipe SDP pipeline run against a real Spark 4.2 Connect server
# server brought up PURELY FROM RUST via podman's REST API (bollard):
# knut-spark-server up (no shell, no podman CLI — see src/bin/knut-spark-server.rs)
# image: docker.io/apache/spark:4.2.0-preview5-scala2.13-java21-python3-ubuntu
# command: knutpipe pipeline sc://localhost:15002 \
# --spec crates/knut-pipelines/examples/pipeline.json \
# --storage file:///tmp/knut_pipeline
# captured: 2026-07-08T00:18:33Z
# ---------------------------------------------------------------------
# defining pipeline (2 datasets, 2 flows)
# graph b10ae7f4-c4ac-4c6f-b709-44c07e0518b6; starting run
INFO [2026-07-08T00:18:35.120336039+00:00] Flow spark_catalog.default.knut_bronze is QUEUED.
INFO [2026-07-08T00:18:35.122590998+00:00] Flow spark_catalog.default.knut_silver is QUEUED.
INFO [2026-07-08T00:18:35.127675055+00:00] Flow spark_catalog.default.knut_bronze is PLANNING.
INFO [2026-07-08T00:18:35.128679871+00:00] Flow spark_catalog.default.knut_bronze is STARTING.
INFO [2026-07-08T00:18:35.129913505+00:00] Flow spark_catalog.default.knut_bronze is RUNNING.
INFO [2026-07-08T00:18:37.058368800+00:00] Flow spark_catalog.default.knut_bronze has COMPLETED.
INFO [2026-07-08T00:18:37.145195652+00:00] Flow spark_catalog.default.knut_silver is PLANNING.
INFO [2026-07-08T00:18:37.145296671+00:00] Flow spark_catalog.default.knut_silver is STARTING.
INFO [2026-07-08T00:18:37.145335181+00:00] Flow spark_catalog.default.knut_silver is RUNNING.
INFO [2026-07-08T00:18:38.023607963+00:00] Flow spark_catalog.default.knut_silver has COMPLETED.
INFO [2026-07-08T00:18:39.203669141+00:00] Run is COMPLETED.
=== final state ===
Dataflow graph <unassigned> — 2 dataset(s), 2 flow(s) [2 done · 0 running · 0 failed · 0 idle]
✓ [materialized_view] knut_bronze (done)
<- knut_bronze (external source)
✓ [materialized_view] knut_silver (done)
<- knut_silver reads: knut_bronze
job progress: 100% — 24/24 tasks · 0 inflight · 26.4 KiB read
[✓] stage 0 — 12/12 tasks
[✓] stage 1 — 12/12 tasks
# EXIT CODE: 0