[viethqb]

Summary

Workflow parity package #6 runs three things a stored flow already declared but egret never ran:

• a Loop's outputs: and fetchType:;
• a Loop's retry:, now inherited by each iteration;
• the flow-level outputs:.

Each now behaves as Kestra does, except for the egret-only limits listed below.

Spec: docs/en/specs/2026-10-29-workflow-loop-outputs-design.md (+ VI). Plan: docs/en/plans/2026-10-29-workflow-loop-outputs.md. Roadmap row #6.

Changes

• Loop outputs.
  • Evaluated at the end of each iteration and appended to the Loop run's outputs list as {item: {value, iteration, key?}, outputs}.
  • Every Loop run carries the counters iterationCount, runningIterations and terminatedIterations.
  • fetchType: STORE (or AUTO over a file values:) writes each iteration's outputs to outputs.ion, and the list holds {uri}.
  • A failed output fails the iteration. With transmitFailed: true, the default, that fails the Loop.
• Loop retry. An iteration's tasks and Subflows inherit the nearest retry:, in this order: their own, an ancestor inside the iteration, the Loop's or its ancestors', then the flow's.
• Flow outputs.
  • Evaluated when the execution ends, before afterExecution:. A failure appends FAILED.
  • {{ execution.outputs }} holds them, and a Subflow parent reads outputs.<sub>.outputs.
  • A Flow trigger's inputs: can use {{ trigger.outputs }}, merged with the window's for dependsOn.
• API.
  • GET /executions/{id} gains outputs, with SECRET values shown as ******.
  • The list endpoint does not carry outputs, because they can reach 16 MiB per execution.
  • The OpenAPI spec and the generated client are regenerated.
• Bug fix. A failed flowable task under an ancestor's or the flow's retry: now ends its parent FAILED. Before, the parent stayed RUNNING forever.
• Migration 0214_workflow_execution_outputs.sql. It was built as 0211. Under D12 it was renumbered at merge time, because main had reached 0213 and no PR was open.
  • It adds workflow.executions.outputs jsonb and secret_outputs bytea, and task_runs.outputs_bytes.
  • Every statement is ADD COLUMN IF NOT EXISTS.
• Whole-branch review fixes (no Critical; 4 Important, all resource bounds):
  • I1: a Loop append moves one entry, not the whole list, using a SQL append and a running byte total.
  • I2: settles no longer read a running Loop's list.
  • I3: SECRET values count toward the 16 MiB cap at their clear size.
  • I4: API responses are bounded.
  • Minors m1, m5, m7, m9 and m12 are fixed. The rest are recorded in spec §7.

egret-only limits (Kestra has none)

• A Loop iteration's FETCH outputs may be at most 1 MiB, and the whole list at most 16 MiB. A flow's outputs may be at most 16 MiB. Each overflow fails with a message pointing to STORE or to a FILE output.
• A type: FILE output must name a file of the execution itself or of its Loop family. Anything else is refused.
• A SECRET output under STORE is refused. Elsewhere, SECRET outputs are sealed with secrets.master_key.
• Duplicate output ids in a Loop's outputs: are refused at save, and so is secret() in an output's value:.

Behaviour change for stored flows. A flow saved before this release can now give a different answer. The full before/after table is in spec §7, "Release notes (#6)", and on the docs upgrade page.

Test plan

• Oracle ratchet: 301 / 35 / 35 / 0 → 301 / 25 / 25 / 0. 10 entries are banked, including both subflow-secret-output-*.
• Review fixes: each Important finding has a test that fails without its fix. Each was mutated once, then restored, and the restore was cmp-checked. For example, the_loop_book_moves_one_entry_per_iteration_end_at_any_list_length measures 298–366 bytes per iteration end at N = 2 000 and at N = 10 000.
• After merging origin/main and the renumber (2026-11-07):
  • cargo fmt --check and workspace clippy --all-targets -D warnings are clean.
  • egret-workflow: 3 590 passed. The 7 failures are all sql_starrocks_live, which needs a live StarRocks (EGRET_TEST_STARROCKS_URL); the same 7 failed before the merge.
  • egret-server --lib passed, including the openapi currency and client digest gates. egret-metastore --lib passed, including the migration-version uniqueness test.
• Live DBs: none of the shared dev or test DBs has a row for version 211, so nothing needs cleaning.

Documentation

egret-data/docs#67: Loop outputs, Loop retry and flow outputs. It updates inputs and outputs, flow control, error handling, execution detail, Flow triggers, the YAML reference and the REST reference. It also adds an upgrade note and marks KI-117 fixed.

Checklist

• Linked to an issue (no tracking issue; roadmap row Phase 2a — Iceberg REST Catalog (egret-storage, egret-iceberg-ext, egret-catalog) #6)
• Tests added or updated
• Docs updated in egret-data/docs
• Commit messages follow Conventional Commits
• No secrets, tokens or real data added

🤖 Generated with Claude Code