Skip to content

Bound V2 shared reads and partition DuckDB scan work - #10857

Closed
joseph-isaacs wants to merge 27 commits into
developfrom
ji/duckdb-v2-scan-driver
Closed

joseph-isaacs wants to merge 27 commits into
developfrom
ji/duckdb-v2-scan-driver

Conversation

@joseph-isaacs

@joseph-isaacs joseph-isaacs commented Oct 27, 2026 •

Copy link
Copy Markdown
Contributor

Summary

V2 work ranges can overlap stored segments, duplicating reads and retaining buffers after their consumers finish. Drivers now share reads within one file execution and release them when owned row claims prove no unfinished work can read them again. DuckDB assigns work across its configured threads; DataFusion preserves independently scheduled scan chunks.

Changes

  • Move pending/completed read sharing to vortex-scan::planning::driver::FileReads. Queued planners, filtering, pruning, projection, and morsels transfer or split RowClaim ownership. Completed later parts can release their reads while an earlier part remains stalled.
  • Derive conservative consumer ranges from the stored layout. Dictionary values and auxiliary children inherit their enclosing root-row region. Missing lifetime information retains a read until file execution ends.
  • Partition DuckDB work on a 65,536-row grid, with at most 1,048,576 rows per assignment. For one projected string/binary column, preserve dictionary regions when that supplies enough assignments; coalesce only regions below 8,192 rows. Inspect the projected row-domain metadata without opening dictionary values or unrelated fields, and fall back to the static grid when metadata is unavailable.
  • Let DataFusion explicitly request independent chunk planners. The shared planner had changed Spawn into ordinary child planning, moving chunk execution onto the root scan task. Restoring independent chunks recovers parallel compute and read scheduling. DuckDB retains ordinary child planners inside its own work assignments.
  • Share dictionary inputs between filtering and projection, retain encoded predicate inputs and materialized boolean results, and release decoded predicate inputs. Preserve structural expression caching, sparse projection, unused-field pruning, and short-edge chunk merging.
  • Share concurrent DuckDB dictionary conversions through one initialization cell per dictionary. Gather sparse string/binary selections before export. Allow larger DuckDB projection batches while preserving DataFusion's output limit and byte bounds for identity projections.
  • Preserve develop's stricter DuckDB filter-argument checks. The regression case now returns the expected 40,000 rows in both scan modes instead of dropping the V1 filter and returning 200,000.

Planner interfaces remain experimental; constructors and pruning continuations transfer row claims.

Performance

ClickBench CI and controlled diagnostics tested aa2cf422. Final head df3c42df has identical Rust sources; its only subsequent change removes temporary diagnostic workflows. The controls were built from develop c56ee880 and the preceding PR's Rust sources at d704b47a, with matching compiler flags.

DataFusion Q38

Both controls and the candidate use V2 scanning and the same input files on one 96-core Graviton runner. Each version was warmed before two ABBA comparisons, with 30 iterations per trial and the first iteration excluded: 58 retained samples per version in each comparison.

Controlled comparison Before (ms) Candidate (ms) Time change
Pre-fix PR vs candidate 18.879 12.759 −32.4%
Develop V2 vs candidate 12.656 12.781 +1.0%

The native CPU profiles corroborate the scheduling change: before, 22.72% of sampled cycles run through the root scan's spawn_cpu path; after, 23.30% run through independent chunk_stream tasks and only 0.89% through that root path. The scan metrics report the same output rows and segment-cache misses, with individual I/O requests falling from 11 to 2. This is primarily an elapsed-time improvement from scheduling, not less total CPU work.

The full 43-query report reduces DataFusion's attributed warm regression from +10.4% in the preceding rerun to +2.7%, with low confidence. Q20, Q21, Q23, Q26, Q28, and Q38 are now within 3.6% of the cached develop warm reference. This does not establish parity for every query: DataFusion Q24 remains +14.8%, and the combined Vortex cold geometric mean remains +13.4% in the report.

DuckDB Q28

Measurement Before (ms) After (ms) Time change
CI: earlier PR 52b50e21 vs current 648.964 499.136 −23.1%
Local warmed V2 ABBA: 52b50e21 vs dictionary-aligned scheduler 1261.474 1128.896 −10.5%

The local comparison used 32 DuckDB/Tokio threads, 100 partitioned ClickBench files, and fresh connections. Both binaries were warmed; two eight-iteration trials per version retained 14 warm samples. Seven guard queries were checked, no benchmark/build workloads overlapped, and all 200 input-file size/mtime records remained unchanged. Existing benchmark processes and Cargo caches were preserved.

Current CI Q28 is 2.4% below the cached develop reference of 511.325 ms. Develop's DuckDB reference uses V1, so that comparison is not V2 versus V2. Earlier runs of the dictionary-aligned scheduler measured 500.956, 501.121, and 502.467 ms. Other DuckDB regressions remain, including Q20 (+14.3%) and Q38 (+24.8%) versus the cached reference.

Memory and retention

Restoring DataFusion Q38 parallelism increases median peak RSS across the paired 30-iteration trials from 1.95 to 2.32 GiB (+18.8%); develop measured 2.29 GiB. More simultaneous work is the tradeoff for the lower elapsed time.

The earlier local DuckDB Q28 comparison reduced peak RSS from 7.50–7.55 GiB to 4.95–5.84 GiB. These measurements compare V2 implementations and do not establish whole-process memory parity with V1. Decoded arrays and output buffers can retain memory independently of read-cache eviction.

The controlled 32-part retention test holds the first part stalled while later parts finish. Flat reads retained fall from 32 segments / 128 KiB under the former watermark policy to 2 / 8 KiB; dictionary reads fall from 33 / 144 KiB to 3 / 24 KiB. Each segment is fetched once, and the cache empties after the final claim drops.

Validation

  • Final-head regular CI passed, including formatting, Clippy, Linux/Windows and CPU-feature Rust tests, SQL logic tests, and integration checks. Instrumented Rust, musl, and CUDA workflows also passed.
  • Full ClickBench and controlled Q38 diagnostics passed. The diagnostics artifact includes raw timings, metrics, explain plans, binary hashes/build IDs, and native profiles.
  • Regression coverage checks bounded selections for both ordinary and independent chunk planners. Existing retention and dictionary-region tests continue to run in CI.
  • Local Q28 timings, guards, and profiles are recorded above. The new DataFusion comparison ran on isolated CI runners while the other local benchmark continued. Local pinned formatting could not run because its toolchain installation ran out of disk space; final-head CI formatting passed. No existing caches were removed.
  • Patch whitespace checks passed; temporary CI instrumentation is removed from the final diff.

@codspeed

codspeed Bot commented Oct 27, 2026 •

Copy link
Copy Markdown

Merging this PR will improve performance by 10.02%

1 warning

⚠️ Walltime results may be unreliable

Some benchmarks used the Walltime instrument outside CodSpeed Macro Runners, which can make the results inconsistent.

Learn more about Macro Runners

See affected benchmarks

⚡ 1 improved benchmark
✅ 2317 untouched benchmarks

Performance Changes

Mode Benchmark BASE HEAD Efficiency
⚡ Walltime threshold_avx2[80] 2.9 µs 2.7 µs +10.02%

Tip

Curious why performance improved? Comment @codspeedbot explain why performance improved on this PR, or directly use the CodSpeed MCP with your agent.


Comparing ji/duckdb-v2-scan-driver (df3c42d) with develop (89c5009)

Open in CodSpeed

@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 27, 2026
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 27, 2026
@github-actions

github-actions Bot commented Oct 27, 2026 •

Copy link
Copy Markdown
Contributor

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done aa2cf42 clickbench-nvme 1 Explore Profiling Data
Previous Runs (100)
Status Commit Job Attempt Link
🟢 Done dd5e75a clickbench-nvme 1 Explore Profiling Data
🟢 Done a2283e2 clickbench-nvme 1 Explore Profiling Data
🟢 Done 5c1c40d clickbench-nvme 1 Explore Profiling Data
🟢 Done d704b47 clickbench-nvme 3 Explore Profiling Data
🟢 Done d704b47 polarsignals 1 Explore Profiling Data
🟢 Done d704b47 tpch-nvme-10 1 Explore Profiling Data
🟢 Done d704b47 tpch-nvme 1 Explore Profiling Data
🟢 Done d704b47 fineweb 1 Explore Profiling Data
🟢 Done d704b47 tpch-s3 1 Explore Profiling Data
🟢 Done d704b47 tpcds-nvme 1 Explore Profiling Data
🟢 Done d704b47 clickbench-nvme 2 Explore Profiling Data
🟢 Done d704b47 clickbench-nvme 1 Explore Profiling Data
🟢 Done 68b35c5 clickbench-nvme 1 Explore Profiling Data
🟢 Done 68b35c5 fineweb 1 Explore Profiling Data
🟢 Done 68b35c5 polarsignals 1 Explore Profiling Data
🟢 Done 68b35c5 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 68b35c5 tpcds-nvme 1 Explore Profiling Data
🟢 Done 68b35c5 tpch-s3 1 Explore Profiling Data
🟢 Done 68b35c5 tpch-nvme 1 Explore Profiling Data
🟢 Done 18c00c4 clickbench-nvme 2 Explore Profiling Data
🟢 Done 18c00c4 tpch-nvme-10 2 Explore Profiling Data
🟢 Done 18c00c4 polarsignals 2 Explore Profiling Data
🟢 Done 18c00c4 fineweb 2 Explore Profiling Data
🟢 Done 18c00c4 tpch-s3 2 Explore Profiling Data
🟢 Done 18c00c4 tpch-nvme 2 Explore Profiling Data
🟢 Done 18c00c4 tpcds-nvme 2 Explore Profiling Data
🟢 Done 9702556 clickbench-nvme 1 Explore Profiling Data
🟢 Done 9702556 polarsignals 1 Explore Profiling Data
🟢 Done 9702556 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 9702556 fineweb 1 Explore Profiling Data
🟢 Done 9702556 tpch-s3 1 Explore Profiling Data
🟢 Done 9702556 tpch-nvme 1 Explore Profiling Data
🟢 Done 9702556 tpcds-nvme 1 Explore Profiling Data
🟢 Done 764811d clickbench-nvme 1 Explore Profiling Data
🟢 Done 764811d tpch-nvme-10 1 Explore Profiling Data
🟢 Done 764811d polarsignals 1 Explore Profiling Data
🟢 Done 764811d tpch-s3 1 Explore Profiling Data
🟢 Done 764811d fineweb 1 Explore Profiling Data
🟢 Done 764811d tpch-nvme 1 Explore Profiling Data
🟢 Done 764811d tpcds-nvme 1 Explore Profiling Data
🟢 Done 956cc60 clickbench-nvme 1 Explore Profiling Data
🟢 Done 956cc60 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 956cc60 polarsignals 1 Explore Profiling Data
🟢 Done 956cc60 tpch-s3 1 Explore Profiling Data
🟢 Done 956cc60 tpch-nvme 1 Explore Profiling Data
🟢 Done 956cc60 fineweb 1 Explore Profiling Data
🟢 Done 956cc60 tpcds-nvme 1 Explore Profiling Data
🟢 Done 52b50e2 fineweb 2 Explore Profiling Data
🟢 Done 52b50e2 tpch-s3 2 Explore Profiling Data
🟢 Done 52b50e2 tpch-nvme 1 Explore Profiling Data
🟢 Done 52b50e2 polarsignals 1 Explore Profiling Data
🟢 Done 52b50e2 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 52b50e2 tpcds-nvme 1 Explore Profiling Data
🟢 Done 52b50e2 clickbench-nvme 1 Explore Profiling Data
🟢 Done e871a14 clickbench-nvme 1 Explore Profiling Data
🟢 Done e871a14 tpch-nvme 1 Explore Profiling Data
🟢 Done e871a14 tpch-s3 1 Explore Profiling Data
🟢 Done e871a14 tpch-nvme-10 1 Explore Profiling Data
🟢 Done e871a14 fineweb 1 Explore Profiling Data
🟢 Done e871a14 polarsignals 1 Explore Profiling Data
🟢 Done e871a14 tpcds-nvme 1 Explore Profiling Data
🟢 Done a8decab tpch-s3 1 Explore Profiling Data
🟢 Done a8decab clickbench-nvme 1 Explore Profiling Data
🟢 Done a8decab polarsignals 1 Explore Profiling Data
🟢 Done a8decab tpch-nvme-10 1 Explore Profiling Data
🟢 Done a8decab fineweb 1 Explore Profiling Data
🟢 Done a8decab tpch-nvme 1 Explore Profiling Data
🟢 Done a8decab tpcds-nvme 1 Explore Profiling Data
🟢 Done 6c216be clickbench-nvme 1 Explore Profiling Data
🟢 Done 6c216be tpch-s3 1 Explore Profiling Data
🟢 Done 6c216be polarsignals 1 Explore Profiling Data
🟢 Done 6c216be tpcds-nvme 1 Explore Profiling Data
🟢 Done 6c216be tpch-nvme 1 Explore Profiling Data
🟢 Done 40293f7 fineweb 1 Explore Profiling Data
🟢 Done 40293f7 tpch-nvme-10 1 Explore Profiling Data
🟢 Done 40293f7 clickbench-nvme 1 Explore Profiling Data
🟢 Done 40293f7 polarsignals 1 Explore Profiling Data
🟢 Done 40293f7 tpcds-nvme 1 Explore Profiling Data
🟢 Done 40293f7 tpch-nvme 1 Explore Profiling Data
🟢 Done 40293f7 tpch-s3 1 Explore Profiling Data
🟢 Done ab0d7cc clickbench-nvme 1 Explore Profiling Data
🟢 Done ab0d7cc polarsignals 1 Explore Profiling Data
🟢 Done ab0d7cc tpch-nvme-10 1 Explore Profiling Data
🟢 Done ab0d7cc fineweb 1 Explore Profiling Data
🟢 Done ab0d7cc tpch-nvme 1 Explore Profiling Data
🟢 Done ab0d7cc tpcds-nvme 1 Explore Profiling Data
🟢 Done ab0d7cc tpch-s3 1 Explore Profiling Data
🟢 Done 45c1a8c clickbench-nvme 1 Explore Profiling Data
🟢 Done 45c1a8c tpch-nvme-10 1 Explore Profiling Data
🟢 Done 45c1a8c polarsignals 1 Explore Profiling Data
🟢 Done 45c1a8c fineweb 1 Explore Profiling Data
🟢 Done 45c1a8c tpch-s3 1 Explore Profiling Data
🟢 Done 45c1a8c tpch-nvme 1 Explore Profiling Data
🟢 Done 45c1a8c tpcds-nvme 1 Explore Profiling Data
🟢 Done 2a91fa8 tpch-s3 1 Explore Profiling Data
🟢 Done 2a91fa8 tpch-nvme 1 Explore Profiling Data
🟢 Done 2a91fa8 tpcds-nvme 1 Explore Profiling Data
🟢 Done 2a91fa8 fineweb 1 Explore Profiling Data
🟢 Done 2a91fa8 clickbench-nvme 1 Explore Profiling Data
🟢 Done 2a91fa8 polarsignals 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions

github-actions Bot commented Oct 27, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: PolarSignals Profiling 📖

Commits: PR d704b47a vs base c56ee880
Vortex (geomean): hot 0.990x ➖ · cold 1.047x ➖


datafusion / vortex-file-compressed / ns (0.990x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
polarsignals_q00/datafusion:vortex-file-compressed 44364846 / 44370148 / -0.0% 92328947 / 87685627 / +5.3% 0.48 / 0.51 / -5.0%
polarsignals_q01/datafusion:vortex-file-compressed 50598477 / 50094463 / +1.0% 111888233 / 112725110 / -0.7% 0.45 / 0.44 / +1.8%
polarsignals_q02/datafusion:vortex-file-compressed 43586817 / 48220838 / -9.6% 85444256 / 85339004 / +0.1% 0.51 / 0.57 / -9.7%
polarsignals_q03/datafusion:vortex-file-compressed 53187919 / 53866162 / -1.3% 117814248 / 110982302 / +6.2% 0.45 / 0.49 / -7.0%
polarsignals_q04/datafusion:vortex-file-compressed 9421958 / 9317400 / +1.1% 48524973 / 46456739 / +4.5% 0.19 / 0.20 / -3.2%
polarsignals_q05/datafusion:vortex-file-compressed 11560666 / 11534832 / +0.2% 55719005 / 48367235 / +15.2% 🔴 0.21 / 0.24 / -13.0%
polarsignals_q06/datafusion:vortex-file-compressed 23262597 / 23180577 / +0.4% 63873526 / 59612395 / +7.1% 0.36 / 0.39 / -6.3%
polarsignals_q07/datafusion:vortex-file-compressed 11020510 / 11071004 / -0.5% 49796233 / 48307680 / +3.1% 0.22 / 0.23 / -3.4%
polarsignals_q08/datafusion:vortex-file-compressed 98102408 / 97777378 / +0.3% 160353224 / 161442120 / -0.7% 0.61 / 0.61 / +1.0%
polarsignals_q09/datafusion:vortex-file-compressed 10014947 / 10173886 / -1.6% 48768995 / 45096756 / +8.1% 0.21 / 0.23 / -9.0%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 27, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: FineWeb NVMe 📖

Commits: PR d704b47a vs base c56ee880
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.8%
Engines: DataFusion No clear signal (+2.6%, low confidence) · DuckDB No clear signal (-0.9%, low confidence)
Vortex (geomean): hot 1.011x ➖ · cold 0.966x ➖
Parquet (geomean): hot 1.002x ➖ · cold 0.941x ➖
Shifts: Parquet (control) +0.2% · Median polish +0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.022x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:vortex-file-compressed 6982718 / 6853400 / +1.9% 16912073 / 16576872 / +2.0% 0.41 / 0.41 / -0.1%
fineweb_q01/datafusion:vortex-file-compressed 8269004 / 7891348 / +4.8% 42488531 / 42113182 / +0.9% 0.19 / 0.19 / +3.9%
fineweb_q02/datafusion:vortex-file-compressed 9924540 / 9725174 / +2.0% 46514485 / 46838184 / -0.7% 0.21 / 0.21 / +2.8%
fineweb_q03/datafusion:vortex-file-compressed 20867573 / 20052137 / +4.1% 98992082 / 110824628 / -10.7% 🟢 0.21 / 0.18 / +16.5%
fineweb_q04/datafusion:vortex-file-compressed 66482566 / 67107098 / -0.9% 147501178 / 160888753 / -8.3% 0.45 / 0.42 / +8.1%
fineweb_q05/datafusion:vortex-file-compressed 67285007 / 67480024 / -0.3% 141306218 / 156565651 / -9.7% 0.48 / 0.43 / +10.5%
fineweb_q06/datafusion:vortex-file-compressed 19375112 / 18733354 / +3.4% 101545007 / 113626131 / -10.6% 🟢 0.19 / 0.16 / +15.7%
fineweb_q07/datafusion:vortex-file-compressed 18533102 / 19081230 / -2.9% 96948018 / 110444958 / -12.2% 🟢 0.19 / 0.17 / +10.6%
fineweb_q08/datafusion:vortex-file-compressed 9609634 / 8882008 / +8.2% 54150969 / 51904778 / +4.3% 0.18 / 0.17 / +3.7%
datafusion / parquet / ns (0.996x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/datafusion:parquet 9432525 / 9431055 / +0.0% 32404691 / 32024488 / +1.2% 0.29 / 0.29 / -1.2%
fineweb_q01/datafusion:parquet 76531988 / 74856970 / +2.2% 150671181 / 162328533 / -7.2% 0.51 / 0.46 / +10.1%
fineweb_q02/datafusion:parquet 75064212 / 76165944 / -1.4% 147466274 / 162232112 / -9.1% 0.51 / 0.47 / +8.4%
fineweb_q03/datafusion:parquet 73585860 / 76702268 / -4.1% 148422807 / 175601630 / -15.5% 🟢 0.50 / 0.44 / +13.5%
fineweb_q04/datafusion:parquet 81922792 / 82474158 / -0.7% 142180419 / 163374289 / -13.0% 🟢 0.58 / 0.50 / +14.1%
fineweb_q05/datafusion:parquet 81030982 / 79897233 / +1.4% 140100025 / 163953428 / -14.5% 🟢 0.58 / 0.49 / +18.7%
fineweb_q06/datafusion:parquet 75576696 / 75991534 / -0.5% 147589476 / 165600920 / -10.9% 🟢 0.51 / 0.46 / +11.6%
fineweb_q07/datafusion:parquet 73736516 / 73534941 / +0.3% 139738763 / 155527876 / -10.2% 🟢 0.53 / 0.47 / +11.6%
fineweb_q08/datafusion:parquet 73246399 / 73523884 / -0.4% 138376155 / 156417279 / -11.5% 🟢 0.53 / 0.47 / +12.6%
duckdb / vortex-file-compressed / ns (0.999x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:vortex-file-compressed 2029344 / 1990267 / +2.0% 7007210 / 7088901 / -1.2% 0.29 / 0.28 / +3.2%
fineweb_q01/duckdb:vortex-file-compressed 9413018 / 9539509 / -1.3% 33314713 / 33115802 / +0.6% 0.28 / 0.29 / -1.9%
fineweb_q02/duckdb:vortex-file-compressed 10720286 / 10670464 / +0.5% 33506233 / 36906125 / -9.2% 0.32 / 0.29 / +10.7%
fineweb_q03/duckdb:vortex-file-compressed 19316984 / 19406172 / -0.5% 89968981 / 92047946 / -2.3% 0.21 / 0.21 / +1.8%
fineweb_q04/duckdb:vortex-file-compressed 67063832 / 66447489 / +0.9% 109015702 / 108758193 / +0.2% 0.62 / 0.61 / +0.7%
fineweb_q05/duckdb:vortex-file-compressed 66319276 / 67071470 / -1.1% 104130454 / 106669166 / -2.4% 0.64 / 0.63 / +1.3%
fineweb_q06/duckdb:vortex-file-compressed 18986882 / 19388252 / -2.1% 92710098 / 93189139 / -0.5% 0.20 / 0.21 / -1.6%
fineweb_q07/duckdb:vortex-file-compressed 18875752 / 18918024 / -0.2% 87245318 / 89844379 / -2.9% 0.22 / 0.21 / +2.7%
fineweb_q08/duckdb:vortex-file-compressed 5440216 / 5363758 / +1.4% 15038163 / 14367828 / +4.7% 0.36 / 0.37 / -3.1%
duckdb / parquet / ns (1.008x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
fineweb_q00/duckdb:parquet 24038034 / 23653739 / +1.6% 27938951 / 28425999 / -1.7% 0.86 / 0.83 / +3.4%
fineweb_q01/duckdb:parquet 56331492 / 55369286 / +1.7% 75667327 / 81676168 / -7.4% 0.74 / 0.68 / +9.8%
fineweb_q02/duckdb:parquet 59826238 / 59681530 / +0.2% 83177690 / 87246937 / -4.7% 0.72 / 0.68 / +5.1%
fineweb_q03/duckdb:parquet 118308533 / 119731277 / -1.2% 187486751 / 188529697 / -0.6% 0.63 / 0.64 / -0.6%
fineweb_q04/duckdb:parquet 164835630 / 164049834 / +0.5% 225938334 / 218684679 / +3.3% 0.73 / 0.75 / -2.7%
fineweb_q05/duckdb:parquet 158594689 / 155988130 / +1.7% 206585746 / 218209281 / -5.3% 0.77 / 0.71 / +7.4%
fineweb_q06/duckdb:parquet 88327031 / 88826520 / -0.6% 150097302 / 150186023 / -0.1% 0.59 / 0.59 / -0.5%
fineweb_q07/duckdb:parquet 92655497 / 90571188 / +2.3% 149245799 / 149441661 / -0.1% 0.62 / 0.61 / +2.4%
fineweb_q08/duckdb:parquet 29808834 / 29405204 / +1.4% 31716995 / 30505031 / +4.0% 0.94 / 0.96 / -2.5%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 27, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on NVME 📖

Commits: PR d704b47a vs base 67b9cf72
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +1.7%
Engines: DataFusion No clear signal (+1.9%, low confidence) · DuckDB No clear signal (+1.4%, low confidence)
Vortex (geomean): hot 1.017x ➖ · cold 0.999x ➖
Parquet (geomean): hot 1.001x ➖ · cold 0.977x ➖
Shifts: Parquet (control) +0.1% · Median polish +0.5%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.019x ➖, 0↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 15669455 / 15452460 / +1.4% 42319342 / 45485189 / -7.0% 0.37 / 0.34 / +9.0%
tpch_q02/datafusion:vortex-file-compressed 17442538 / 16929572 / +3.0% 36112428 / 36625661 / -1.4% 0.48 / 0.46 / +4.5%
tpch_q03/datafusion:vortex-file-compressed 20063904 / 19836392 / +1.1% 49874047 / 52350459 / -4.7% 0.40 / 0.38 / +6.2%
tpch_q04/datafusion:vortex-file-compressed 10637264 / 10853892 / -2.0% 36807536 / 36673503 / +0.4% 0.29 / 0.30 / -2.4%
tpch_q05/datafusion:vortex-file-compressed 37240205 / 37114665 / +0.3% 69907957 / 66651045 / +4.9% 0.53 / 0.56 / -4.3%
tpch_q06/datafusion:vortex-file-compressed 5002855 / 4631480 / +8.0% 29137552 / 28844258 / +1.0% 0.17 / 0.16 / +6.9%
tpch_q07/datafusion:vortex-file-compressed 52039744 / 51798995 / +0.5% 80186862 / 78976694 / +1.5% 0.65 / 0.66 / -1.1%
tpch_q08/datafusion:vortex-file-compressed 51503591 / 51362501 / +0.3% 76669743 / 75277053 / +1.9% 0.67 / 0.68 / -1.5%
tpch_q09/datafusion:vortex-file-compressed 47522056 / 47491888 / +0.1% 79474685 / 77518102 / +2.5% 0.60 / 0.61 / -2.4%
tpch_q10/datafusion:vortex-file-compressed 17887554 / 17513114 / +2.1% 52107904 / 51360350 / +1.5% 0.34 / 0.34 / +0.7%
tpch_q11/datafusion:vortex-file-compressed 14512133 / 14007215 / +3.6% 33520694 / 33291345 / +0.7% 0.43 / 0.42 / +2.9%
tpch_q12/datafusion:vortex-file-compressed 18228473 / 18206314 / +0.1% 42658732 / 45255589 / -5.7% 0.43 / 0.40 / +6.2%
tpch_q13/datafusion:vortex-file-compressed 19021536 / 19066856 / -0.2% 40183567 / 40573513 / -1.0% 0.47 / 0.47 / +0.7%
tpch_q14/datafusion:vortex-file-compressed 15046904 / 14639982 / +2.8% 39748023 / 40342077 / -1.5% 0.38 / 0.36 / +4.3%
tpch_q15/datafusion:vortex-file-compressed 19413877 / 18576944 / +4.5% 44621731 / 45650722 / -2.3% 0.44 / 0.41 / +6.9%
tpch_q16/datafusion:vortex-file-compressed 18528781 / 18320807 / +1.1% 39678577 / 43296477 / -8.4% 0.47 / 0.42 / +10.4%
tpch_q17/datafusion:vortex-file-compressed 27905516 / 28166788 / -0.9% 58198134 / 58602200 / -0.7% 0.48 / 0.48 / -0.2%
tpch_q18/datafusion:vortex-file-compressed 36031836 / 36236763 / -0.6% 59736170 / 58928671 / +1.4% 0.60 / 0.61 / -1.9%
tpch_q19/datafusion:vortex-file-compressed 12650466 / 11084005 / +14.1% 🔴 39172744 / 39413231 / -0.6% 0.32 / 0.28 / +14.8%
tpch_q20/datafusion:vortex-file-compressed 20836880 / 20365887 / +2.3% 46014415 / 46062575 / -0.1% 0.45 / 0.44 / +2.4%
tpch_q21/datafusion:vortex-file-compressed 39562872 / 39902277 / -0.9% 69805032 / 70302815 / -0.7% 0.57 / 0.57 / -0.1%
tpch_q22/datafusion:vortex-file-compressed 10846405 / 10630658 / +2.0% 30879978 / 31792914 / -2.9% 0.35 / 0.33 / +5.0%
datafusion / parquet / ns (1.000x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 71784719 / 72155507 / -0.5% 88345221 / 91097327 / -3.0% 0.81 / 0.79 / +2.6%
tpch_q02/datafusion:parquet 75859439 / 75974002 / -0.2% 93122768 / 94594554 / -1.6% 0.81 / 0.80 / +1.4%
tpch_q03/datafusion:parquet 83357002 / 83516779 / -0.2% 104005240 / 106389261 / -2.2% 0.80 / 0.79 / +2.1%
tpch_q04/datafusion:parquet 40834376 / 40683227 / +0.4% 58689950 / 61611677 / -4.7% 0.70 / 0.66 / +5.4%
tpch_q05/datafusion:parquet 112307694 / 112446390 / -0.1% 136712275 / 144081141 / -5.1% 0.82 / 0.78 / +5.3%
tpch_q06/datafusion:parquet 32281551 / 31943204 / +1.1% 48407085 / 52023990 / -7.0% 0.67 / 0.61 / +8.6%
tpch_q07/datafusion:parquet 115266052 / 115136175 / +0.1% 141539132 / 143707682 / -1.5% 0.81 / 0.80 / +1.6%
tpch_q08/datafusion:parquet 119530196 / 120036676 / -0.4% 144018173 / 150273636 / -4.2% 0.83 / 0.80 / +3.9%
tpch_q09/datafusion:parquet 139747299 / 141189679 / -1.0% 166923174 / 168526029 / -1.0% 0.84 / 0.84 / -0.1%
tpch_q10/datafusion:parquet 106381501 / 107183241 / -0.7% 128184969 / 133487694 / -4.0% 0.83 / 0.80 / +3.4%
tpch_q11/datafusion:parquet 61526432 / 61172414 / +0.6% 78926926 / 82283979 / -4.1% 0.78 / 0.74 / +4.9%
tpch_q12/datafusion:parquet 65350200 / 65301258 / +0.1% 84396047 / 88506565 / -4.6% 0.77 / 0.74 / +4.9%
tpch_q13/datafusion:parquet 147324141 / 146845452 / +0.3% 166580902 / 169631601 / -1.8% 0.88 / 0.87 / +2.2%
tpch_q14/datafusion:parquet 47689359 / 48089440 / -0.8% 69170145 / 72978442 / -5.2% 0.69 / 0.66 / +4.6%
tpch_q15/datafusion:parquet 75079651 / 74806920 / +0.4% 92364017 / 98065309 / -5.8% 0.81 / 0.76 / +6.6%
tpch_q16/datafusion:parquet 43894927 / 43785819 / +0.2% 61124165 / 63389208 / -3.6% 0.72 / 0.69 / +4.0%
tpch_q17/datafusion:parquet 123449579 / 123546231 / -0.1% 147577595 / 151099155 / -2.3% 0.84 / 0.82 / +2.3%
tpch_q18/datafusion:parquet 124767551 / 124374641 / +0.3% 143174556 / 148019160 / -3.3% 0.87 / 0.84 / +3.7%
tpch_q19/datafusion:parquet 57962007 / 58470427 / -0.9% 82250781 / 85195899 / -3.5% 0.70 / 0.69 / +2.7%
tpch_q20/datafusion:parquet 79715604 / 79501515 / +0.3% 102034533 / 103104373 / -1.0% 0.78 / 0.77 / +1.3%
tpch_q21/datafusion:parquet 116481651 / 116424949 / +0.0% 142555957 / 143311034 / -0.5% 0.82 / 0.81 / +0.6%
tpch_q22/datafusion:parquet 52130157 / 52029016 / +0.2% 67261409 / 68809430 / -2.2% 0.78 / 0.76 / +2.5%
duckdb / vortex-file-compressed / ns (1.016x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 10006436 / 9309479 / +7.5% 20301960 / 20773758 / -2.3% 0.49 / 0.45 / +10.0%
tpch_q02/duckdb:vortex-file-compressed 15502615 / 15591851 / -0.6% 25690731 / 25883876 / -0.7% 0.60 / 0.60 / +0.2%
tpch_q03/duckdb:vortex-file-compressed 18805012 / 18233709 / +3.1% 33708571 / 34004610 / -0.9% 0.56 / 0.54 / +4.0%
tpch_q04/duckdb:vortex-file-compressed 12531817 / 12529647 / +0.0% 25895344 / 25650981 / +1.0% 0.48 / 0.49 / -0.9%
tpch_q05/duckdb:vortex-file-compressed 21026079 / 20507764 / +2.5% 34240293 / 32396450 / +5.7% 0.61 / 0.63 / -3.0%
tpch_q06/duckdb:vortex-file-compressed 4648088 / 4710413 / -1.3% 14181712 / 14972846 / -5.3% 0.33 / 0.31 / +4.2%
tpch_q07/duckdb:vortex-file-compressed 24334685 / 23807372 / +2.2% 41087046 / 39941322 / +2.9% 0.59 / 0.60 / -0.6%
tpch_q08/duckdb:vortex-file-compressed 21653511 / 21157408 / +2.3% 37925995 / 39176631 / -3.2% 0.57 / 0.54 / +5.7%
tpch_q09/duckdb:vortex-file-compressed 21821544 / 21172328 / +3.1% 39779070 / 37809052 / +5.2% 0.55 / 0.56 / -2.0%
tpch_q10/duckdb:vortex-file-compressed 27896925 / 27132872 / +2.8% 42958559 / 41159526 / +4.4% 0.65 / 0.66 / -1.5%
tpch_q11/duckdb:vortex-file-compressed 8323640 / 8302560 / +0.3% 17663421 / 17143036 / +3.0% 0.47 / 0.48 / -2.7%
tpch_q12/duckdb:vortex-file-compressed 14797133 / 14094560 / +5.0% 25596571 / 26169350 / -2.2% 0.58 / 0.54 / +7.3%
tpch_q13/duckdb:vortex-file-compressed 23452124 / 23311930 / +0.6% 32209420 / 31899972 / +1.0% 0.73 / 0.73 / -0.4%
tpch_q14/duckdb:vortex-file-compressed 11803902 / 11492258 / +2.7% 24524097 / 23851430 / +2.8% 0.48 / 0.48 / -0.1%
tpch_q15/duckdb:vortex-file-compressed 8541227 / 8685274 / -1.7% 19538063 / 19921081 / -1.9% 0.44 / 0.44 / +0.3%
tpch_q16/duckdb:vortex-file-compressed 16440106 / 16685424 / -1.5% 23272899 / 23771312 / -2.1% 0.71 / 0.70 / +0.6%
tpch_q17/duckdb:vortex-file-compressed 12517585 / 11992150 / +4.4% 27056165 / 26613325 / +1.7% 0.46 / 0.45 / +2.7%
tpch_q18/duckdb:vortex-file-compressed 24215092 / 23286656 / +4.0% 34298917 / 36558914 / -6.2% 0.71 / 0.64 / +10.8%
tpch_q19/duckdb:vortex-file-compressed 11204309 / 11285713 / -0.7% 25498155 / 23720820 / +7.5% 0.44 / 0.48 / -7.6%
tpch_q20/duckdb:vortex-file-compressed 13983910 / 14367360 / -2.7% 29499564 / 28425436 / +3.8% 0.47 / 0.51 / -6.2%
tpch_q21/duckdb:vortex-file-compressed 37937966 / 36995762 / +2.5% 56670540 / 55314522 / +2.5% 0.67 / 0.67 / +0.1%
tpch_q22/duckdb:vortex-file-compressed 19239596 / 19093037 / +0.8% 29304218 / 29071868 / +0.8% 0.66 / 0.66 / -0.0%
duckdb / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 48283283 / 48490603 / -0.4% 54409703 / 54978373 / -1.0% 0.89 / 0.88 / +0.6%
tpch_q02/duckdb:parquet 48783041 / 49044740 / -0.5% 55469732 / 56655743 / -2.1% 0.88 / 0.87 / +1.6%
tpch_q03/duckdb:parquet 60577003 / 60772434 / -0.3% 67873546 / 70255545 / -3.4% 0.89 / 0.87 / +3.2%
tpch_q04/duckdb:parquet 34944887 / 35149956 / -0.6% 42590357 / 44218102 / -3.7% 0.82 / 0.79 / +3.2%
tpch_q05/duckdb:parquet 67623269 / 67958880 / -0.5% 76207533 / 77498747 / -1.7% 0.89 / 0.88 / +1.2%
tpch_q06/duckdb:parquet 22123905 / 22117077 / +0.0% 26749661 / 28602880 / -6.5% 0.83 / 0.77 / +7.0%
tpch_q07/duckdb:parquet 64506843 / 64719091 / -0.3% 73933530 / 74675583 / -1.0% 0.87 / 0.87 / +0.7%
tpch_q08/duckdb:parquet 75880598 / 76280731 / -0.5% 87136221 / 88410627 / -1.4% 0.87 / 0.86 / +0.9%
tpch_q09/duckdb:parquet 108293262 / 108008490 / +0.3% 119611525 / 120681683 / -0.9% 0.91 / 0.89 / +1.2%
tpch_q10/duckdb:parquet 106644360 / 106593793 / +0.0% 117095144 / 118855761 / -1.5% 0.91 / 0.90 / +1.6%
tpch_q11/duckdb:parquet 29685098 / 29770906 / -0.3% 34723888 / 35183935 / -1.3% 0.85 / 0.85 / +1.0%
tpch_q12/duckdb:parquet 37899844 / 38117849 / -0.6% 44576790 / 44895829 / -0.7% 0.85 / 0.85 / +0.1%
tpch_q13/duckdb:parquet 175966821 / 175142462 / +0.5% 182817900 / 184334655 / -0.8% 0.96 / 0.95 / +1.3%
tpch_q14/duckdb:parquet 42770713 / 43005446 / -0.5% 50994131 / 51650681 / -1.3% 0.84 / 0.83 / +0.7%
tpch_q15/duckdb:parquet 33078831 / 32906693 / +0.5% 41306529 / 41915372 / -1.5% 0.80 / 0.79 / +2.0%
tpch_q16/duckdb:parquet 47835448 / 47979201 / -0.3% 53355568 / 53129719 / +0.4% 0.90 / 0.90 / -0.7%
tpch_q17/duckdb:parquet 48373471 / 48260847 / +0.2% 57271006 / 59146568 / -3.2% 0.84 / 0.82 / +3.5%
tpch_q18/duckdb:parquet 74965678 / 74782764 / +0.2% 81185248 / 82154408 / -1.2% 0.92 / 0.91 / +1.4%
tpch_q19/duckdb:parquet 54031103 / 49525661 / +9.1% 63879589 / 57672609 / +10.8% 🔴 0.85 / 0.86 / -1.5%
tpch_q20/duckdb:parquet 63840735 / 64253154 / -0.6% 73017556 / 74419934 / -1.9% 0.87 / 0.86 / +1.3%
tpch_q21/duckdb:parquet 107245654 / 107300133 / -0.1% 117623959 / 117382845 / +0.2% 0.91 / 0.91 / -0.3%
tpch_q22/duckdb:parquet 50795284 / 51093975 / -0.6% 58775471 / 60431024 / -2.7% 0.86 / 0.85 / +2.2%

File Size Changes (8 files changed, -0.0% overall, 0↑ 8↓)
File Scale Format Base HEAD Change %
lineitem_0001.vortex 1.0 vortex-file-compressed 170.43 MB 170.43 MB 712 B -0.0%
orders_0001.vortex 1.0 vortex-file-compressed 42.50 MB 42.50 MB 624 B -0.0%
partsupp_0001.vortex 1.0 vortex-file-compressed 24.95 MB 24.95 MB 544 B -0.0%
customer_0001.vortex 1.0 vortex-file-compressed 9.10 MB 9.10 MB 696 B -0.0%
part_0001.vortex 1.0 vortex-file-compressed 5.40 MB 5.40 MB 688 B -0.0%
supplier_0001.vortex 1.0 vortex-file-compressed 608.40 KB 607.73 KB 688 B -0.1%
nation_0001.vortex 1.0 vortex-file-compressed 11.18 KB 10.68 KB 512 B -4.5%
region_0001.vortex 1.0 vortex-file-compressed 6.64 KB 6.16 KB 488 B -7.2%

Totals:

  • vortex-file-compressed: 253.26 MB → 253.25 MB (-0.0%)

@github-actions

github-actions Bot commented Oct 27, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=10 on NVME 📖

Commits: PR d704b47a vs base c56ee880
Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.2%
Engines: DataFusion No clear signal (+0.0%, low confidence) · DuckDB No clear signal (-4.4%, low confidence)
Vortex (geomean): hot 0.977x ➖ · cold 0.974x ➖
Parquet (geomean): hot 0.999x ➖ · cold 0.969x ➖
Shifts: Parquet (control) -0.1% · Median polish -0.1%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.001x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 86299641 / 90647595 / -4.8% 140953776 / 155212605 / -9.2% 0.61 / 0.58 / +4.8%
tpch_q02/datafusion:vortex-file-compressed 64940513 / 64009353 / +1.5% 99512081 / 96100837 / +3.5% 0.65 / 0.67 / -2.0%
tpch_q03/datafusion:vortex-file-compressed 64279920 / 63449213 / +1.3% 124054612 / 125030964 / -0.8% 0.52 / 0.51 / +2.1%
tpch_q04/datafusion:vortex-file-compressed 35131068 / 33990066 / +3.4% 73690145 / 72567615 / +1.5% 0.48 / 0.47 / +1.8%
tpch_q05/datafusion:vortex-file-compressed 119623233 / 118543067 / +0.9% 181800302 / 185369873 / -1.9% 0.66 / 0.64 / +2.9%
tpch_q06/datafusion:vortex-file-compressed 10499024 / 10528376 / -0.3% 60610579 / 61936933 / -2.1% 0.17 / 0.17 / +1.9%
tpch_q07/datafusion:vortex-file-compressed 134274007 / 135464770 / -0.9% 195202285 / 192680427 / +1.3% 0.69 / 0.70 / -2.2%
tpch_q08/datafusion:vortex-file-compressed 144605912 / 145062913 / -0.3% 207555005 / 211256055 / -1.8% 0.70 / 0.69 / +1.5%
tpch_q09/datafusion:vortex-file-compressed 186146535 / 186881885 / -0.4% 248661185 / 263266684 / -5.5% 0.75 / 0.71 / +5.5%
tpch_q10/datafusion:vortex-file-compressed 70923224 / 70192581 / +1.0% 137489174 / 135020365 / +1.8% 0.52 / 0.52 / -0.8%
tpch_q11/datafusion:vortex-file-compressed 43523194 / 43217129 / +0.7% 72809258 / 68334621 / +6.5% 0.60 / 0.63 / -5.5%
tpch_q12/datafusion:vortex-file-compressed 36551677 / 35693901 / +2.4% 83750072 / 75519143 / +10.9% 🔴 0.44 / 0.47 / -7.7%
tpch_q13/datafusion:vortex-file-compressed 40982995 / 48215962 / -15.0% 🟢 87498189 / 82397335 / +6.2% 0.47 / 0.59 / -20.0%
tpch_q14/datafusion:vortex-file-compressed 22010990 / 21394938 / +2.9% 88946728 / 85178101 / +4.4% 0.25 / 0.25 / -1.5%
tpch_q15/datafusion:vortex-file-compressed 35876284 / 33801616 / +6.1% 95809992 / 95255653 / +0.6% 0.37 / 0.35 / +5.5%
tpch_q16/datafusion:vortex-file-compressed 37654391 / 36684046 / +2.6% 69007628 / 67086221 / +2.9% 0.55 / 0.55 / -0.2%
tpch_q17/datafusion:vortex-file-compressed 175926281 / 175318592 / +0.3% 222686095 / 272059811 / -18.1% 🟢 0.79 / 0.64 / +22.6%
tpch_q18/datafusion:vortex-file-compressed 206583643 / 208336249 / -0.8% 269315327 / 271728212 / -0.9% 0.77 / 0.77 / +0.0%
tpch_q19/datafusion:vortex-file-compressed 30540778 / 29722798 / +2.8% 91298453 / 86589031 / +5.4% 0.33 / 0.34 / -2.5%
tpch_q20/datafusion:vortex-file-compressed 61332506 / 60943549 / +0.6% 125352171 / 121890568 / +2.8% 0.49 / 0.50 / -2.1%
tpch_q21/datafusion:vortex-file-compressed 182918826 / 179665256 / +1.8% 233283415 / 239136977 / -2.4% 0.78 / 0.75 / +4.4%
tpch_q22/datafusion:vortex-file-compressed 24897311 / 25240138 / -1.4% 58126780 / 52974242 / +9.7% 0.43 / 0.48 / -10.1%
datafusion / parquet / ns (1.001x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 87748256 / 88179844 / -0.5% 126312051 / 131627121 / -4.0% 0.69 / 0.67 / +3.7%
tpch_q02/datafusion:parquet 176202774 / 176241642 / -0.0% 204499834 / 200895899 / +1.8% 0.86 / 0.88 / -1.8%
tpch_q03/datafusion:parquet 137976870 / 137918794 / +0.0% 179533476 / 189335739 / -5.2% 0.77 / 0.73 / +5.5%
tpch_q04/datafusion:parquet 58803915 / 58431825 / +0.6% 94912768 / 94161382 / +0.8% 0.62 / 0.62 / -0.2%
tpch_q05/datafusion:parquet 169847288 / 170143515 / -0.2% 221097347 / 225731176 / -2.1% 0.77 / 0.75 / +1.9%
tpch_q06/datafusion:parquet 37163994 / 37350175 / -0.5% 77001057 / 85029121 / -9.4% 0.48 / 0.44 / +9.9%
tpch_q07/datafusion:parquet 219219593 / 219526111 / -0.1% 269504292 / 270736766 / -0.5% 0.81 / 0.81 / +0.3%
tpch_q08/datafusion:parquet 223226063 / 222372412 / +0.4% 282685878 / 291018463 / -2.9% 0.79 / 0.76 / +3.3%
tpch_q09/datafusion:parquet 311738050 / 315888458 / -1.3% 372676843 / 379994141 / -1.9% 0.84 / 0.83 / +0.6%
tpch_q10/datafusion:parquet 320590866 / 320348824 / +0.1% 381630565 / 387757671 / -1.6% 0.84 / 0.83 / +1.7%
tpch_q11/datafusion:parquet 127408115 / 126731713 / +0.5% 148328089 / 148288825 / +0.0% 0.86 / 0.85 / +0.5%
tpch_q12/datafusion:parquet 84398753 / 84150360 / +0.3% 120670467 / 124642001 / -3.2% 0.70 / 0.68 / +3.6%
tpch_q13/datafusion:parquet 216357431 / 216873049 / -0.2% 247208031 / 250943122 / -1.5% 0.88 / 0.86 / +1.3%
tpch_q14/datafusion:parquet 87495681 / 87678052 / -0.2% 185280627 / 202283078 / -8.4% 0.47 / 0.43 / +8.9%
tpch_q15/datafusion:parquet 107528086 / 106249791 / +1.2% 155557648 / 165573982 / -6.0% 0.69 / 0.64 / +7.7%
tpch_q16/datafusion:parquet 98092299 / 96249456 / +1.9% 121315140 / 121528132 / -0.2% 0.81 / 0.79 / +2.1%
tpch_q17/datafusion:parquet 213304172 / 215468801 / -1.0% 259295164 / 268566109 / -3.5% 0.82 / 0.80 / +2.5%
tpch_q18/datafusion:parquet 273605669 / 270991683 / +1.0% 317919463 / 317556862 / +0.1% 0.86 / 0.85 / +0.8%
tpch_q19/datafusion:parquet 108579692 / 108325608 / +0.2% 164174288 / 176981664 / -7.2% 0.66 / 0.61 / +8.1%
tpch_q20/datafusion:parquet 189195976 / 188881572 / +0.2% 259541840 / 262309859 / -1.1% 0.73 / 0.72 / +1.2%
tpch_q21/datafusion:parquet 248952652 / 250644014 / -0.7% 309448297 / 309378116 / +0.0% 0.80 / 0.81 / -0.7%
tpch_q22/datafusion:parquet 154220570 / 153905405 / +0.2% 179989331 / 181338843 / -0.7% 0.86 / 0.85 / +1.0%
duckdb / vortex-file-compressed / ns (0.953x ➖, 4↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 32240573 / 32917318 / -2.1% 57934017 / 71424268 / -18.9% 🟢 0.56 / 0.46 / +20.8%
tpch_q02/duckdb:vortex-file-compressed 31878935 / 32104954 / -0.7% 48547400 / 46126223 / +5.2% 0.66 / 0.70 / -5.7%
tpch_q03/duckdb:vortex-file-compressed 51617868 / 52939936 / -2.5% 99141390 / 102992894 / -3.7% 0.52 / 0.51 / +1.3%
tpch_q04/duckdb:vortex-file-compressed 49241559 / 51412922 / -4.2% 79652428 / 88142331 / -9.6% 0.62 / 0.58 / +6.0%
tpch_q05/duckdb:vortex-file-compressed 70127122 / 67702174 / +3.6% 106039326 / 107882492 / -1.7% 0.66 / 0.63 / +5.4%
tpch_q06/duckdb:vortex-file-compressed 11086769 / 14780367 / -25.0% 🟢 43081232 / 52125316 / -17.4% 🟢 0.26 / 0.28 / -9.2%
tpch_q07/duckdb:vortex-file-compressed 53580111 / 54526905 / -1.7% 105754778 / 109846016 / -3.7% 0.51 / 0.50 / +2.1%
tpch_q08/duckdb:vortex-file-compressed 87860157 / 87824400 / +0.0% 130159823 / 132412767 / -1.7% 0.68 / 0.66 / +1.8%
tpch_q09/duckdb:vortex-file-compressed 97709780 / 98265422 / -0.6% 137186106 / 162694789 / -15.7% 🟢 0.71 / 0.60 / +17.9%
tpch_q10/duckdb:vortex-file-compressed 85574339 / 88055232 / -2.8% 133504716 / 141801640 / -5.9% 0.64 / 0.62 / +3.2%
tpch_q11/duckdb:vortex-file-compressed 13369336 / 13317803 / +0.4% 29938479 / 26728700 / +12.0% 🔴 0.45 / 0.50 / -10.4%
tpch_q12/duckdb:vortex-file-compressed 41091154 / 43299252 / -5.1% 75450259 / 85330461 / -11.6% 🟢 0.54 / 0.51 / +7.3%
tpch_q13/duckdb:vortex-file-compressed 68719507 / 68274934 / +0.7% 95497284 / 87619497 / +9.0% 0.72 / 0.78 / -7.7%
tpch_q14/duckdb:vortex-file-compressed 25077366 / 28703652 / -12.6% 🟢 64594578 / 74156375 / -12.9% 🟢 0.39 / 0.39 / +0.3%
tpch_q15/duckdb:vortex-file-compressed 20100607 / 24520634 / -18.0% 🟢 56778597 / 63563763 / -10.7% 🟢 0.35 / 0.39 / -8.2%
tpch_q16/duckdb:vortex-file-compressed 48772074 / 49408167 / -1.3% 60677627 / 58965838 / +2.9% 0.80 / 0.84 / -4.1%
tpch_q17/duckdb:vortex-file-compressed 33229755 / 34445485 / -3.5% 65371981 / 68631221 / -4.7% 0.51 / 0.50 / +1.3%
tpch_q18/duckdb:vortex-file-compressed 106762202 / 99074718 / +7.8% 119864930 / 121079887 / -1.0% 0.89 / 0.82 / +8.9%
tpch_q19/duckdb:vortex-file-compressed 20661901 / 25403819 / -18.7% 🟢 63251004 / 72699967 / -13.0% 🟢 0.33 / 0.35 / -6.5%
tpch_q20/duckdb:vortex-file-compressed 36333952 / 38881190 / -6.6% 80403609 / 90976381 / -11.6% 🟢 0.45 / 0.43 / +5.7%
tpch_q21/duckdb:vortex-file-compressed 92396204 / 96671980 / -4.4% 139461008 / 145765541 / -4.3% 0.66 / 0.66 / -0.1%
tpch_q22/duckdb:vortex-file-compressed 35324324 / 34792023 / +1.5% 54642478 / 51722900 / +5.6% 0.65 / 0.67 / -3.9%
duckdb / parquet / ns (0.997x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 68661901 / 68838205 / -0.3% 89218140 / 96420883 / -7.5% 0.77 / 0.71 / +7.8%
tpch_q02/duckdb:parquet 87517969 / 87986540 / -0.5% 98620468 / 98081545 / +0.5% 0.89 / 0.90 / -1.1%
tpch_q03/duckdb:parquet 110605536 / 110595281 / +0.0% 145039590 / 151260582 / -4.1% 0.76 / 0.73 / +4.3%
tpch_q04/duckdb:parquet 76893603 / 77767995 / -1.1% 98754412 / 104447984 / -5.5% 0.78 / 0.74 / +4.6%
tpch_q05/duckdb:parquet 123820947 / 124151428 / -0.3% 158652219 / 158521264 / +0.1% 0.78 / 0.78 / -0.3%
tpch_q06/duckdb:parquet 35776557 / 35922537 / -0.4% 61994698 / 68519034 / -9.5% 0.58 / 0.52 / +10.1%
tpch_q07/duckdb:parquet 118072003 / 119884473 / -1.5% 156123389 / 155971560 / +0.1% 0.76 / 0.77 / -1.6%
tpch_q08/duckdb:parquet 149763646 / 149999726 / -0.2% 194960517 / 199222043 / -2.1% 0.77 / 0.75 / +2.0%
tpch_q09/duckdb:parquet 237070453 / 237517337 / -0.2% 279548294 / 290642522 / -3.8% 0.85 / 0.82 / +3.8%
tpch_q10/duckdb:parquet 315348175 / 316089666 / -0.2% 339938514 / 345240774 / -1.5% 0.93 / 0.92 / +1.3%
tpch_q11/duckdb:parquet 43853731 / 43882786 / -0.1% 51655354 / 51389986 / +0.5% 0.85 / 0.85 / -0.6%
tpch_q12/duckdb:parquet 72752862 / 72660876 / +0.1% 91000690 / 96526902 / -5.7% 0.80 / 0.75 / +6.2%
tpch_q13/duckdb:parquet 293491579 / 293858719 / -0.1% 311103460 / 309036286 / +0.7% 0.94 / 0.95 / -0.8%
tpch_q14/duckdb:parquet 103098977 / 102187723 / +0.9% 139980924 / 150667175 / -7.1% 0.74 / 0.68 / +8.6%
tpch_q15/duckdb:parquet 57438425 / 57955909 / -0.9% 88195771 / 89006247 / -0.9% 0.65 / 0.65 / +0.0%
tpch_q16/duckdb:parquet 101105780 / 101908999 / -0.8% 109727903 / 108666464 / +1.0% 0.92 / 0.94 / -1.7%
tpch_q17/duckdb:parquet 83781141 / 83211449 / +0.7% 115931338 / 127636851 / -9.2% 0.72 / 0.65 / +10.9%
tpch_q18/duckdb:parquet 157463918 / 158684121 / -0.8% 168692919 / 170185472 / -0.9% 0.93 / 0.93 / +0.1%
tpch_q19/duckdb:parquet 99301496 / 99419471 / -0.1% 129381202 / 150092047 / -13.8% 🟢 0.77 / 0.66 / +15.9%
tpch_q20/duckdb:parquet 147754448 / 147439929 / +0.2% 186057056 / 195525649 / -4.8% 0.79 / 0.75 / +5.3%
tpch_q21/duckdb:parquet 257712903 / 257499779 / +0.1% 280144986 / 287983328 / -2.7% 0.92 / 0.89 / +2.9%
tpch_q22/duckdb:parquet 169002986 / 169482053 / -0.3% 183887990 / 184494413 / -0.3% 0.92 / 0.92 / +0.0%

No file size changes detected.

@joseph-isaacs
joseph-isaacs requested a review from myrrc October 27, 2026 13:46
@github-actions

github-actions Bot commented Oct 27, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-DS SF=1 on NVME 📖

Commits: PR d704b47a vs base c56ee880
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.7%
Engines: DataFusion No clear signal (+1.7%, low confidence) · DuckDB No clear signal (-0.2%, low confidence)
Vortex (geomean): hot 1.002x ➖ · cold 1.017x ➖
Parquet (geomean): hot 0.995x ➖ · cold 0.990x ➖
Shifts: Parquet (control) -0.5% · Median polish -0.6%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.019x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:vortex-file-compressed 21113890 / 20934480 / +0.9% 40640654 / 39678637 / +2.4% 0.52 / 0.53 / -1.5%
tpcds_q02/datafusion:vortex-file-compressed 45025956 / 45392657 / -0.8% 68059631 / 65926125 / +3.2% 0.66 / 0.69 / -3.9%
tpcds_q03/datafusion:vortex-file-compressed 11676968 / 11294704 / +3.4% 29266339 / 28697242 / +2.0% 0.40 / 0.39 / +1.4%
tpcds_q04/datafusion:vortex-file-compressed 88427623 / 85984156 / +2.8% 121557120 / 121390595 / +0.1% 0.73 / 0.71 / +2.7%
tpcds_q05/datafusion:vortex-file-compressed 58276843 / 56977650 / +2.3% 79580255 / 86638537 / -8.1% 0.73 / 0.66 / +11.4%
tpcds_q06/datafusion:vortex-file-compressed 23305494 / 22649660 / +2.9% 44661128 / 43939189 / +1.6% 0.52 / 0.52 / +1.2%
tpcds_q07/datafusion:vortex-file-compressed 29214048 / 29119804 / +0.3% 52946820 / 51680331 / +2.5% 0.55 / 0.56 / -2.1%
tpcds_q08/datafusion:vortex-file-compressed 25110568 / 24609296 / +2.0% 44062420 / 43859474 / +0.5% 0.57 / 0.56 / +1.6%
tpcds_q09/datafusion:vortex-file-compressed 19367974 / 19327121 / +0.2% 36874004 / 37754857 / -2.3% 0.53 / 0.51 / +2.6%
tpcds_q10/datafusion:vortex-file-compressed 27388176 / 26598360 / +3.0% 54021745 / 50349663 / +7.3% 0.51 / 0.53 / -4.0%
tpcds_q11/datafusion:vortex-file-compressed 54409828 / 51839606 / +5.0% 83880285 / 81880136 / +2.4% 0.65 / 0.63 / +2.5%
tpcds_q12/datafusion:vortex-file-compressed 15075169 / 14871005 / +1.4% 34350495 / 31617778 / +8.6% 0.44 / 0.47 / -6.7%
tpcds_q13/datafusion:vortex-file-compressed 31242156 / 30553850 / +2.3% 56980990 / 56709274 / +0.5% 0.55 / 0.54 / +1.8%
tpcds_q14/datafusion:vortex-file-compressed 489507326 / 486324009 / +0.7% 545744003 / 548580489 / -0.5% 0.90 / 0.89 / +1.2%
tpcds_q15/datafusion:vortex-file-compressed 12744306 / 12572365 / +1.4% 34752043 / 33851833 / +2.7% 0.37 / 0.37 / -1.3%
tpcds_q16/datafusion:vortex-file-compressed 18705660 / 18344172 / +2.0% 39528554 / 38699339 / +2.1% 0.47 / 0.47 / -0.2%
tpcds_q17/datafusion:vortex-file-compressed 48031602 / 54308296 / -11.6% 🟢 74226608 / 70932637 / +4.6% 0.65 / 0.77 / -15.5%
tpcds_q18/datafusion:vortex-file-compressed 64179078 / 63547452 / +1.0% 89493841 / 88902064 / +0.7% 0.72 / 0.71 / +0.3%
tpcds_q19/datafusion:vortex-file-compressed 16839410 / 16414360 / +2.6% 40546577 / 39058715 / +3.8% 0.42 / 0.42 / -1.2%
tpcds_q20/datafusion:vortex-file-compressed 16819803 / 16480630 / +2.1% 38863090 / 37461552 / +3.7% 0.43 / 0.44 / -1.6%
tpcds_q21/datafusion:vortex-file-compressed 15997754 / 16357612 / -2.2% 38975262 / 37387936 / +4.2% 0.41 / 0.44 / -6.2%
tpcds_q22/datafusion:vortex-file-compressed 49550444 / 49399546 / +0.3% 73026876 / 71419747 / +2.3% 0.68 / 0.69 / -1.9%
tpcds_q23/datafusion:vortex-file-compressed 72001249 / 69615680 / +3.4% 99534304 / 99204297 / +0.3% 0.72 / 0.70 / +3.1%
tpcds_q24/datafusion:vortex-file-compressed 65864066 / 65449139 / +0.6% 89024984 / 88039007 / +1.1% 0.74 / 0.74 / -0.5%
tpcds_q25/datafusion:vortex-file-compressed 45564502 / 49129787 / -7.3% 79288303 / 74859909 / +5.9% 0.57 / 0.66 / -12.4%
tpcds_q26/datafusion:vortex-file-compressed 26466196 / 25914234 / +2.1% 50015922 / 46651076 / +7.2% 0.53 / 0.56 / -4.7%
tpcds_q27/datafusion:vortex-file-compressed 59364488 / 59185500 / +0.3% 85312305 / 84113172 / +1.4% 0.70 / 0.70 / -1.1%
tpcds_q28/datafusion:vortex-file-compressed 26339793 / 25452195 / +3.5% 39511368 / 43136296 / -8.4% 0.67 / 0.59 / +13.0%
tpcds_q29/datafusion:vortex-file-compressed 54090070 / 49303198 / +9.7% 79847289 / 76693509 / +4.1% 0.68 / 0.64 / +5.4%
tpcds_q30/datafusion:vortex-file-compressed 25954709 / 26027105 / -0.3% 44710971 / 44362481 / +0.8% 0.58 / 0.59 / -1.1%
tpcds_q31/datafusion:vortex-file-compressed 60229878 / 58144216 / +3.6% 88465189 / 84546491 / +4.6% 0.68 / 0.69 / -1.0%
tpcds_q32/datafusion:vortex-file-compressed 12701452 / 12245718 / +3.7% 31930423 / 31135129 / +2.6% 0.40 / 0.39 / +1.1%
tpcds_q33/datafusion:vortex-file-compressed 27636880 / 27764404 / -0.5% 51383849 / 51867081 / -0.9% 0.54 / 0.54 / +0.5%
tpcds_q34/datafusion:vortex-file-compressed 17894996 / 17451792 / +2.5% 38054566 / 36146716 / +5.3% 0.47 / 0.48 / -2.6%
tpcds_q35/datafusion:vortex-file-compressed 30733266 / 29725388 / +3.4% 58992665 / 54354780 / +8.5% 0.52 / 0.55 / -4.7%
tpcds_q36/datafusion:vortex-file-compressed 47881784 / 47606796 / +0.6% 69526656 / 71321546 / -2.5% 0.69 / 0.67 / +3.2%
tpcds_q37/datafusion:vortex-file-compressed 12069881 / 12194190 / -1.0% 34867713 / 34293888 / +1.7% 0.35 / 0.36 / -2.6%
tpcds_q38/datafusion:vortex-file-compressed 26804016 / 25536150 / +5.0% 52218222 / 47700898 / +9.5% 0.51 / 0.54 / -4.1%
tpcds_q39/datafusion:vortex-file-compressed 65806054 / 64689768 / +1.7% 89888694 / 88728340 / +1.3% 0.73 / 0.73 / +0.4%
tpcds_q40/datafusion:vortex-file-compressed 23207312 / 23192680 / +0.1% 44759542 / 42634362 / +5.0% 0.52 / 0.54 / -4.7%
tpcds_q41/datafusion:vortex-file-compressed 20520264 / 20660826 / -0.7% 32937724 / 33182106 / -0.7% 0.62 / 0.62 / +0.1%
tpcds_q42/datafusion:vortex-file-compressed 11222994 / 10987054 / +2.1% 29873825 / 26807388 / +11.4% 🔴 0.38 / 0.41 / -8.3%
tpcds_q43/datafusion:vortex-file-compressed 12954518 / 12512790 / +3.5% 34427960 / 30822840 / +11.7% 🔴 0.38 / 0.41 / -7.3%
tpcds_q44/datafusion:vortex-file-compressed 29930246 / 28525316 / +4.9% 52424046 / 54507172 / -3.8% 0.57 / 0.52 / +9.1%
tpcds_q45/datafusion:vortex-file-compressed 16116218 / 16040796 / +0.5% 36803772 / 34587614 / +6.4% 0.44 / 0.46 / -5.6%
tpcds_q46/datafusion:vortex-file-compressed 24002231 / 23693183 / +1.3% 49610958 / 47655568 / +4.1% 0.48 / 0.50 / -2.7%
tpcds_q47/datafusion:vortex-file-compressed 76117573 / 75160276 / +1.3% 106626073 / 104262741 / +2.3% 0.71 / 0.72 / -1.0%
tpcds_q48/datafusion:vortex-file-compressed 28737958 / 28423619 / +1.1% 52884493 / 52402813 / +0.9% 0.54 / 0.54 / +0.2%
tpcds_q49/datafusion:vortex-file-compressed 56834938 / 57677104 / -1.5% 79636729 / 83413546 / -4.5% 0.71 / 0.69 / +3.2%
tpcds_q50/datafusion:vortex-file-compressed 30784434 / 30437212 / +1.1% 55906321 / 51435968 / +8.7% 0.55 / 0.59 / -6.9%
tpcds_q51/datafusion:vortex-file-compressed 67570046 / 65983884 / +2.4% 92193595 / 88804993 / +3.8% 0.73 / 0.74 / -1.4%
tpcds_q52/datafusion:vortex-file-compressed 11703231 / 11368268 / +2.9% 29966624 / 27020501 / +10.9% 🔴 0.39 / 0.42 / -7.2%
tpcds_q53/datafusion:vortex-file-compressed 18147825 / 17439267 / +4.1% 38521189 / 38536604 / -0.0% 0.47 / 0.45 / +4.1%
tpcds_q54/datafusion:vortex-file-compressed 32533998 / 31156564 / +4.4% 57584595 / 53636243 / +7.4% 0.56 / 0.58 / -2.7%
tpcds_q55/datafusion:vortex-file-compressed 11359681 / 10635268 / +6.8% 28945208 / 26635629 / +8.7% 0.39 / 0.40 / -1.7%
tpcds_q56/datafusion:vortex-file-compressed 26869384 / 25957364 / +3.5% 48944342 / 48640767 / +0.6% 0.55 / 0.53 / +2.9%
tpcds_q57/datafusion:vortex-file-compressed 62942808 / 62201598 / +1.2% 89446681 / 89164250 / +0.3% 0.70 / 0.70 / +0.9%
tpcds_q58/datafusion:vortex-file-compressed 39103140 / 38288214 / +2.1% 66086190 / 65094465 / +1.5% 0.59 / 0.59 / +0.6%
tpcds_q59/datafusion:vortex-file-compressed 31179541 / 29816476 / +4.6% 57533698 / 54713103 / +5.2% 0.54 / 0.54 / -0.6%
tpcds_q60/datafusion:vortex-file-compressed 26735512 / 25771714 / +3.7% 48959984 / 48587802 / +0.8% 0.55 / 0.53 / +3.0%
tpcds_q61/datafusion:vortex-file-compressed 22136446 / 21321010 / +3.8% 44817262 / 43900720 / +2.1% 0.49 / 0.49 / +1.7%
tpcds_q62/datafusion:vortex-file-compressed 16668640 / 16320839 / +2.1% 37470505 / 35786842 / +4.7% 0.44 / 0.46 / -2.5%
tpcds_q63/datafusion:vortex-file-compressed 17940644 / 17242975 / +4.0% 40067269 / 38926772 / +2.9% 0.45 / 0.44 / +1.1%
tpcds_q64/datafusion:vortex-file-compressed 214899238 / 213772439 / +0.5% 253701974 / 247682679 / +2.4% 0.85 / 0.86 / -1.9%
tpcds_q65/datafusion:vortex-file-compressed 73864835 / 73681822 / +0.2% 95377596 / 93803437 / +1.7% 0.77 / 0.79 / -1.4%
tpcds_q66/datafusion:vortex-file-compressed 50709234 / 50637041 / +0.1% 74644850 / 73002428 / +2.2% 0.68 / 0.69 / -2.1%
tpcds_q67/datafusion:vortex-file-compressed 51297034 / 50958744 / +0.7% 85464922 / 83178450 / +2.7% 0.60 / 0.61 / -2.0%
tpcds_q68/datafusion:vortex-file-compressed 23911608 / 22796372 / +4.9% 48519224 / 45694967 / +6.2% 0.49 / 0.50 / -1.2%
tpcds_q69/datafusion:vortex-file-compressed 26274566 / 25060896 / +4.8% 52754710 / 47117574 / +12.0% 🔴 0.50 / 0.53 / -6.4%
tpcds_q70/datafusion:vortex-file-compressed 72134518 / 70598302 / +2.2% 97581644 / 95141768 / +2.6% 0.74 / 0.74 / -0.4%
tpcds_q71/datafusion:vortex-file-compressed 19852866 / 18706190 / +6.1% 39821768 / 38824078 / +2.6% 0.50 / 0.48 / +3.5%
tpcds_q72/datafusion:vortex-file-compressed 363898038 / 356099302 / +2.2% 395768836 / 418012217 / -5.3% 0.92 / 0.85 / +7.9%
tpcds_q73/datafusion:vortex-file-compressed 16626648 / 16070940 / +3.5% 38830624 / 36366473 / +6.8% 0.43 / 0.44 / -3.1%
tpcds_q74/datafusion:vortex-file-compressed 41008070 / 39464888 / +3.9% 68619344 / 67684026 / +1.4% 0.60 / 0.58 / +2.5%
tpcds_q75/datafusion:vortex-file-compressed 141289118 / 138887040 / +1.7% 169373653 / 161172953 / +5.1% 0.83 / 0.86 / -3.2%
tpcds_q76/datafusion:vortex-file-compressed 29253118 / 29821366 / -1.9% 48752650 / 50982968 / -4.4% 0.60 / 0.58 / +2.6%
tpcds_q77/datafusion:vortex-file-compressed 45932552 / 45130957 / +1.8% 68282014 / 67302878 / +1.5% 0.67 / 0.67 / +0.3%
tpcds_q78/datafusion:vortex-file-compressed 65834244 / 64204074 / +2.5% 98362468 / 93879621 / +4.8% 0.67 / 0.68 / -2.1%
tpcds_q79/datafusion:vortex-file-compressed 21168715 / 19395300 / +9.1% 45452031 / 41387110 / +9.8% 0.47 / 0.47 / -0.6%
tpcds_q80/datafusion:vortex-file-compressed 74276872 / 73609630 / +0.9% 100839984 / 105645206 / -4.5% 0.74 / 0.70 / +5.7%
tpcds_q81/datafusion:vortex-file-compressed 26441876 / 26305350 / +0.5% 44112416 / 44603145 / -1.1% 0.60 / 0.59 / +1.6%
tpcds_q82/datafusion:vortex-file-compressed 12140406 / 12791610 / -5.1% 36587285 / 35035450 / +4.4% 0.33 / 0.37 / -9.1%
tpcds_q83/datafusion:vortex-file-compressed 32811240 / 32476137 / +1.0% 53410654 / 54104795 / -1.3% 0.61 / 0.60 / +2.3%
tpcds_q84/datafusion:vortex-file-compressed 10375314 / 9981420 / +3.9% 26651330 / 26548097 / +0.4% 0.39 / 0.38 / +3.5%
tpcds_q85/datafusion:vortex-file-compressed 53269970 / 53510320 / -0.4% 80428326 / 81433929 / -1.2% 0.66 / 0.66 / +0.8%
tpcds_q86/datafusion:vortex-file-compressed 15981540 / 15845602 / +0.9% 35153983 / 35973404 / -2.3% 0.45 / 0.44 / +3.2%
tpcds_q87/datafusion:vortex-file-compressed 25890350 / 25754445 / +0.5% 54534539 / 48294866 / +12.9% 🔴 0.47 / 0.53 / -11.0%
tpcds_q88/datafusion:vortex-file-compressed 32409762 / 31829664 / +1.8% 51801783 / 53293357 / -2.8% 0.63 / 0.60 / +4.8%
tpcds_q89/datafusion:vortex-file-compressed 21502732 / 21385474 / +0.5% 45367853 / 42954518 / +5.6% 0.47 / 0.50 / -4.8%
tpcds_q90/datafusion:vortex-file-compressed 10286626 / 10088336 / +2.0% 27110530 / 25998634 / +4.3% 0.38 / 0.39 / -2.2%
tpcds_q91/datafusion:vortex-file-compressed 17775270 / 16906608 / +5.1% 37284194 / 37883608 / -1.6% 0.48 / 0.45 / +6.8%
tpcds_q92/datafusion:vortex-file-compressed 12955382 / 12683342 / +2.1% 30220357 / 29592133 / +2.1% 0.43 / 0.43 / +0.0%
tpcds_q93/datafusion:vortex-file-compressed 20571675 / 20196288 / +1.9% 40633558 / 39011306 / +4.2% 0.51 / 0.52 / -2.2%
tpcds_q94/datafusion:vortex-file-compressed 18788346 / 18328310 / +2.5% 37966611 / 37709666 / +0.7% 0.49 / 0.49 / +1.8%
tpcds_q95/datafusion:vortex-file-compressed 43434414 / 42649838 / +1.8% 64438518 / 63354547 / +1.7% 0.67 / 0.67 / +0.1%
tpcds_q96/datafusion:vortex-file-compressed 8136155 / 7551050 / +7.7% 26183962 / 24026807 / +9.0% 0.31 / 0.31 / -1.1%
tpcds_q97/datafusion:vortex-file-compressed 17737796 / 16729780 / +6.0% 41794104 / 37202956 / +12.3% 🔴 0.42 / 0.45 / -5.6%
tpcds_q98/datafusion:vortex-file-compressed 16655408 / 16632964 / +0.1% 37896312 / 39086499 / -3.0% 0.44 / 0.43 / +3.3%
tpcds_q99/datafusion:vortex-file-compressed 16712454 / 15813773 / +5.7% 36551910 / 35091020 / +4.2% 0.46 / 0.45 / +1.5%
datafusion / parquet / ns (1.002x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/datafusion:parquet 42436080 / 41548166 / +2.1% 59426286 / 61366857 / -3.2% 0.71 / 0.68 / +5.5%
tpcds_q02/datafusion:parquet 55713036 / 55610792 / +0.2% 71223438 / 72283453 / -1.5% 0.78 / 0.77 / +1.7%
tpcds_q03/datafusion:parquet 19148160 / 19222620 / -0.4% 31513655 / 33058185 / -4.7% 0.61 / 0.58 / +4.5%
tpcds_q04/datafusion:parquet 179733848 / 181909023 / -1.2% 205044496 / 206151582 / -0.5% 0.88 / 0.88 / -0.7%
tpcds_q05/datafusion:parquet 69131888 / 69494812 / -0.5% 87877521 / 87405755 / +0.5% 0.79 / 0.80 / -1.1%
tpcds_q06/datafusion:parquet 33088722 / 33048404 / +0.1% 48598097 / 48672601 / -0.2% 0.68 / 0.68 / +0.3%
tpcds_q07/datafusion:parquet 47860744 / 46674216 / +2.5% 64869753 / 66350704 / -2.2% 0.74 / 0.70 / +4.9%
tpcds_q08/datafusion:parquet 31579492 / 31013122 / +1.8% 47203058 / 47314878 / -0.2% 0.67 / 0.66 / +2.1%
tpcds_q09/datafusion:parquet 34707222 / 32838784 / +5.7% 43513346 / 45016474 / -3.3% 0.80 / 0.73 / +9.3%
tpcds_q10/datafusion:parquet 45187882 / 44306240 / +2.0% 56291489 / 60103855 / -6.3% 0.80 / 0.74 / +8.9%
tpcds_q11/datafusion:parquet 98438186 / 97987466 / +0.5% 119883909 / 120143861 / -0.2% 0.82 / 0.82 / +0.7%
tpcds_q12/datafusion:parquet 23859892 / 24246722 / -1.6% 36341030 / 37572817 / -3.3% 0.66 / 0.65 / +1.7%
tpcds_q13/datafusion:parquet 46573460 / 46497664 / +0.2% 67268519 / 70539926 / -4.6% 0.69 / 0.66 / +5.0%
tpcds_q14/datafusion:parquet 536659510 / 536175556 / +0.1% 583394231 / 585932897 / -0.4% 0.92 / 0.92 / +0.5%
tpcds_q15/datafusion:parquet 23728643 / 23495046 / +1.0% 38263507 / 37936876 / +0.9% 0.62 / 0.62 / +0.1%
tpcds_q16/datafusion:parquet 36827457 / 36834264 / -0.0% 50423199 / 51519377 / -2.1% 0.73 / 0.71 / +2.2%
tpcds_q17/datafusion:parquet 73523098 / 74610594 / -1.5% 96712711 / 98256650 / -1.6% 0.76 / 0.76 / +0.1%
tpcds_q18/datafusion:parquet 68589800 / 66755054 / +2.7% 94989389 / 89115775 / +6.6% 0.72 / 0.75 / -3.6%
tpcds_q19/datafusion:parquet 29737559 / 29772688 / -0.1% 44483153 / 43447855 / +2.4% 0.67 / 0.69 / -2.4%
tpcds_q20/datafusion:parquet 25427791 / 25087406 / +1.4% 37210754 / 37718667 / -1.3% 0.68 / 0.67 / +2.7%
tpcds_q21/datafusion:parquet 20303078 / 20243922 / +0.3% 31028096 / 33205502 / -6.6% 0.65 / 0.61 / +7.3%
tpcds_q22/datafusion:parquet 78094357 / 76986714 / +1.4% 90130820 / 88516268 / +1.8% 0.87 / 0.87 / -0.4%
tpcds_q23/datafusion:parquet 90582040 / 91768931 / -1.3% 116582818 / 115011777 / +1.4% 0.78 / 0.80 / -2.6%
tpcds_q24/datafusion:parquet 92596691 / 91503038 / +1.2% 114659077 / 115149133 / -0.4% 0.81 / 0.79 / +1.6%
tpcds_q25/datafusion:parquet 81343553 / 79880540 / +1.8% 100790470 / 104181992 / -3.3% 0.81 / 0.77 / +5.3%
tpcds_q26/datafusion:parquet 43348580 / 43489712 / -0.3% 61082919 / 58889584 / +3.7% 0.71 / 0.74 / -3.9%
tpcds_q27/datafusion:parquet 78583640 / 76442255 / +2.8% 98605583 / 96774774 / +1.9% 0.80 / 0.79 / +0.9%
tpcds_q28/datafusion:parquet 28774455 / 28839792 / -0.2% 42975012 / 43652734 / -1.6% 0.67 / 0.66 / +1.3%
tpcds_q29/datafusion:parquet 74081316 / 74888552 / -1.1% 98051603 / 96703895 / +1.4% 0.76 / 0.77 / -2.4%
tpcds_q30/datafusion:parquet 45634338 / 46094123 / -1.0% 59386791 / 62157540 / -4.5% 0.77 / 0.74 / +3.6%
tpcds_q31/datafusion:parquet 79852344 / 82277361 / -2.9% 102795503 / 103400853 / -0.6% 0.78 / 0.80 / -2.4%
tpcds_q32/datafusion:parquet 26432404 / 26280151 / +0.6% 39215555 / 41301366 / -5.1% 0.67 / 0.64 / +5.9%
tpcds_q33/datafusion:parquet 37768508 / 36667497 / +3.0% 54238572 / 53638594 / +1.1% 0.70 / 0.68 / +1.9%
tpcds_q34/datafusion:parquet 24692609 / 24621710 / +0.3% 36180839 / 36617024 / -1.2% 0.68 / 0.67 / +1.5%
tpcds_q35/datafusion:parquet 52365677 / 50226220 / +4.3% 61668637 / 66214011 / -6.9% 0.85 / 0.76 / +11.9%
tpcds_q36/datafusion:parquet 53295303 / 52667970 / +1.2% 73046149 / 69848541 / +4.6% 0.73 / 0.75 / -3.2%
tpcds_q37/datafusion:parquet 21302810 / 21325629 / -0.1% 33704600 / 33385481 / +1.0% 0.63 / 0.64 / -1.1%
tpcds_q38/datafusion:parquet 44619952 / 44490243 / +0.3% 62005436 / 64158627 / -3.4% 0.72 / 0.69 / +3.8%
tpcds_q39/datafusion:parquet 68267438 / 67631284 / +0.9% 85404354 / 84994228 / +0.5% 0.80 / 0.80 / +0.5%
tpcds_q40/datafusion:parquet 30156744 / 30116544 / +0.1% 50322349 / 50600326 / -0.5% 0.60 / 0.60 / +0.7%
tpcds_q41/datafusion:parquet 19947558 / 19686558 / +1.3% 32284893 / 32250916 / +0.1% 0.62 / 0.61 / +1.2%
tpcds_q42/datafusion:parquet 18397538 / 17943531 / +2.5% 29350066 / 29322889 / +0.1% 0.63 / 0.61 / +2.4%
tpcds_q43/datafusion:parquet 19150186 / 19336670 / -1.0% 31912049 / 33079430 / -3.5% 0.60 / 0.58 / +2.7%
tpcds_q44/datafusion:parquet 36159728 / 35622238 / +1.5% 50294972 / 51717692 / -2.8% 0.72 / 0.69 / +4.4%
tpcds_q45/datafusion:parquet 26824744 / 26915576 / -0.3% 41000060 / 48686449 / -15.8% 🟢 0.65 / 0.55 / +18.3%
tpcds_q46/datafusion:parquet 29550187 / 29375717 / +0.6% 46307772 / 47033905 / -1.5% 0.64 / 0.62 / +2.2%
tpcds_q47/datafusion:parquet 98163087 / 98730674 / -0.6% 122924909 / 121554505 / +1.1% 0.80 / 0.81 / -1.7%
tpcds_q48/datafusion:parquet 41189822 / 41205476 / -0.0% 59718644 / 58737760 / +1.7% 0.69 / 0.70 / -1.7%
tpcds_q49/datafusion:parquet 71432157 / 72553979 / -1.5% 96639517 / 93026932 / +3.9% 0.74 / 0.78 / -5.2%
tpcds_q50/datafusion:parquet 47453192 / 47473058 / -0.0% 67339961 / 67184436 / +0.2% 0.70 / 0.71 / -0.3%
tpcds_q51/datafusion:parquet 76353150 / 75618506 / +1.0% 95744464 / 94189019 / +1.7% 0.80 / 0.80 / -0.7%
tpcds_q52/datafusion:parquet 18925118 / 18766608 / +0.8% 30305801 / 31659028 / -4.3% 0.62 / 0.59 / +5.3%
tpcds_q53/datafusion:parquet 22421477 / 22520880 / -0.4% 39118601 / 39140163 / -0.1% 0.57 / 0.58 / -0.4%
tpcds_q54/datafusion:parquet 52463801 / 53541510 / -2.0% 67811404 / 66963079 / +1.3% 0.77 / 0.80 / -3.2%
tpcds_q55/datafusion:parquet 18380852 / 18269870 / +0.6% 29633185 / 30249035 / -2.0% 0.62 / 0.60 / +2.7%
tpcds_q56/datafusion:parquet 42832194 / 42109687 / +1.7% 54973890 / 54424527 / +1.0% 0.78 / 0.77 / +0.7%
tpcds_q57/datafusion:parquet 101935080 / 102463659 / -0.5% 117622739 / 120702775 / -2.6% 0.87 / 0.85 / +2.1%
tpcds_q58/datafusion:parquet 66645405 / 65114536 / +2.4% 84724054 / 84507981 / +0.3% 0.79 / 0.77 / +2.1%
tpcds_q59/datafusion:parquet 47939558 / 48579432 / -1.3% 67099733 / 65975439 / +1.7% 0.71 / 0.74 / -3.0%
tpcds_q60/datafusion:parquet 40331694 / 40583686 / -0.6% 56836669 / 56454505 / +0.7% 0.71 / 0.72 / -1.3%
tpcds_q61/datafusion:parquet 36693340 / 36284218 / +1.1% 50556834 / 52075512 / -2.9% 0.73 / 0.70 / +4.2%
tpcds_q62/datafusion:parquet 25400146 / 24838186 / +2.3% 38562549 / 39619881 / -2.7% 0.66 / 0.63 / +5.1%
tpcds_q63/datafusion:parquet 22562983 / 22267756 / +1.3% 37859703 / 38548751 / -1.8% 0.60 / 0.58 / +3.2%
tpcds_q64/datafusion:parquet 289229864 / 288435819 / +0.3% 332435335 / 329557654 / +0.9% 0.87 / 0.88 / -0.6%
tpcds_q65/datafusion:parquet 123147619 / 122062093 / +0.9% 139271006 / 140430328 / -0.8% 0.88 / 0.87 / +1.7%
tpcds_q66/datafusion:parquet 60598278 / 60101025 / +0.8% 77961439 / 77287900 / +0.9% 0.78 / 0.78 / -0.0%
tpcds_q67/datafusion:parquet 68694282 / 68913863 / -0.3% 92178724 / 93773435 / -1.7% 0.75 / 0.73 / +1.4%
tpcds_q68/datafusion:parquet 29552522 / 29638952 / -0.3% 48920587 / 49583519 / -1.3% 0.60 / 0.60 / +1.1%
tpcds_q69/datafusion:parquet 43450908 / 43942986 / -1.1% 59098204 / 59531110 / -0.7% 0.74 / 0.74 / -0.4%
tpcds_q70/datafusion:parquet 82150840 / 80673492 / +1.8% 98405568 / 100679997 / -2.3% 0.83 / 0.80 / +4.2%
tpcds_q71/datafusion:parquet 24231578 / 26096564 / -7.1% 35734569 / 37680918 / -5.2% 0.68 / 0.69 / -2.1%
tpcds_q72/datafusion:parquet 524774790 / 515725945 / +1.8% 553124791 / 545353269 / +1.4% 0.95 / 0.95 / +0.3%
tpcds_q73/datafusion:parquet 24205696 / 24087532 / +0.5% 36474887 / 36378897 / +0.3% 0.66 / 0.66 / +0.2%
tpcds_q74/datafusion:parquet 71241618 / 69929876 / +1.9% 86561955 / 85942449 / +0.7% 0.82 / 0.81 / +1.1%
tpcds_q75/datafusion:parquet 151779192 / 151668864 / +0.1% 181442906 / 181782193 / -0.2% 0.84 / 0.83 / +0.3%
tpcds_q76/datafusion:parquet 33556350 / 33794108 / -0.7% 48409509 / 48377397 / +0.1% 0.69 / 0.70 / -0.8%
tpcds_q77/datafusion:parquet 56453988 / 57387860 / -1.6% 76023474 / 74755809 / +1.7% 0.74 / 0.77 / -3.3%
tpcds_q78/datafusion:parquet 86226490 / 85801770 / +0.5% 122276501 / 118958582 / +2.8% 0.71 / 0.72 / -2.2%
tpcds_q79/datafusion:parquet 27462482 / 27559169 / -0.4% 42354866 / 42110909 / +0.6% 0.65 / 0.65 / -0.9%
tpcds_q80/datafusion:parquet 80468398 / 80562790 / -0.1% 113320124 / 111058028 / +2.0% 0.71 / 0.73 / -2.1%
tpcds_q81/datafusion:parquet 35675362 / 37472803 / -4.8% 51956926 / 51967587 / -0.0% 0.69 / 0.72 / -4.8%
tpcds_q82/datafusion:parquet 22631103 / 22552399 / +0.3% 36354785 / 36303107 / +0.1% 0.62 / 0.62 / +0.2%
tpcds_q83/datafusion:parquet 58553594 / 57767114 / +1.4% 75387153 / 76671320 / -1.7% 0.78 / 0.75 / +3.1%
tpcds_q84/datafusion:parquet 26241856 / 26388406 / -0.6% 41269870 / 39920005 / +3.4% 0.64 / 0.66 / -3.8%
tpcds_q85/datafusion:parquet 81164760 / 81044592 / +0.1% 103409653 / 107299832 / -3.6% 0.78 / 0.76 / +3.9%
tpcds_q86/datafusion:parquet 21252572 / 20576028 / +3.3% 33558965 / 34127340 / -1.7% 0.63 / 0.60 / +5.0%
tpcds_q87/datafusion:parquet 44840008 / 45522401 / -1.5% 62424246 / 60929069 / +2.5% 0.72 / 0.75 / -3.9%
tpcds_q88/datafusion:parquet 37240487 / 37984655 / -2.0% 51193865 / 53041518 / -3.5% 0.73 / 0.72 / +1.6%
tpcds_q89/datafusion:parquet 26296484 / 26157249 / +0.5% 42069289 / 42433378 / -0.9% 0.63 / 0.62 / +1.4%
tpcds_q90/datafusion:parquet 14977304 / 16083966 / -6.9% 26682238 / 26829453 / -0.5% 0.56 / 0.60 / -6.4%
tpcds_q91/datafusion:parquet 32308372 / 32351950 / -0.1% 47291724 / 45733716 / +3.4% 0.68 / 0.71 / -3.4%
tpcds_q92/datafusion:parquet 27229467 / 26670504 / +2.1% 43374146 / 41130342 / +5.5% 0.63 / 0.65 / -3.2%
tpcds_q93/datafusion:parquet 27026254 / 27072492 / -0.2% 46802009 / 46603952 / +0.4% 0.58 / 0.58 / -0.6%
tpcds_q94/datafusion:parquet 36001569 / 35753564 / +0.7% 49025551 / 49037603 / -0.0% 0.73 / 0.73 / +0.7%
tpcds_q95/datafusion:parquet 62865592 / 64430366 / -2.4% 76714827 / 78139820 / -1.8% 0.82 / 0.82 / -0.6%
tpcds_q96/datafusion:parquet 12644752 / 12548875 / +0.8% 25457950 / 24258176 / +4.9% 0.50 / 0.52 / -4.0%
tpcds_q97/datafusion:parquet 35969038 / 35911505 / +0.2% 50265897 / 52112509 / -3.5% 0.72 / 0.69 / +3.8%
tpcds_q98/datafusion:parquet 24865378 / 24980521 / -0.5% 38984125 / 39446503 / -1.2% 0.64 / 0.63 / +0.7%
tpcds_q99/datafusion:parquet 30053863 / 29531714 / +1.8% 42593868 / 42614741 / -0.0% 0.71 / 0.69 / +1.8%
duckdb / vortex-file-compressed / ns (0.986x ➖, 4↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:vortex-file-compressed 17428898 / 15965885 / +9.2% 26170288 / 24709345 / +5.9% 0.67 / 0.65 / +3.1%
tpcds_q02/duckdb:vortex-file-compressed 16978070 / 16095969 / +5.5% 23421924 / 23766477 / -1.4% 0.72 / 0.68 / +7.0%
tpcds_q03/duckdb:vortex-file-compressed 7260806 / 7134808 / +1.8% 17164480 / 15678848 / +9.5% 0.42 / 0.46 / -7.0%
tpcds_q04/duckdb:vortex-file-compressed 49689064 / 46360756 / +7.2% 60973341 / 56141730 / +8.6% 0.81 / 0.83 / -1.3%
tpcds_q05/duckdb:vortex-file-compressed 23554256 / 23970424 / -1.7% 33991711 / 33246186 / +2.2% 0.69 / 0.72 / -3.9%
tpcds_q06/duckdb:vortex-file-compressed 24673362 / 24567694 / +0.4% 40496420 / 37939810 / +6.7% 0.61 / 0.65 / -5.9%
tpcds_q07/duckdb:vortex-file-compressed 14115850 / 13870934 / +1.8% 25366801 / 25719681 / -1.4% 0.56 / 0.54 / +3.2%
tpcds_q08/duckdb:vortex-file-compressed 17452149 / 17877300 / -2.4% 26199976 / 25152803 / +4.2% 0.67 / 0.71 / -6.3%
tpcds_q09/duckdb:vortex-file-compressed 19019608 / 19830423 / -4.1% 30207632 / 31455393 / -4.0% 0.63 / 0.63 / -0.1%
tpcds_q10/duckdb:vortex-file-compressed 27525646 / 27758822 / -0.8% 43804296 / 41293912 / +6.1% 0.63 / 0.67 / -6.5%
tpcds_q11/duckdb:vortex-file-compressed 40994284 / 36989539 / +10.8% 🔴 50728438 / 46020062 / +10.2% 🔴 0.81 / 0.80 / +0.5%
tpcds_q12/duckdb:vortex-file-compressed 10229243 / 10118112 / +1.1% 18341933 / 17365580 / +5.6% 0.56 / 0.58 / -4.3%
tpcds_q13/duckdb:vortex-file-compressed 21441372 / 20904187 / +2.6% 35021784 / 33760548 / +3.7% 0.61 / 0.62 / -1.1%
tpcds_q14/duckdb:vortex-file-compressed 56078174 / 56515292 / -0.8% 68170594 / 67745470 / +0.6% 0.82 / 0.83 / -1.4%
tpcds_q15/duckdb:vortex-file-compressed 11147409 / 11109962 / +0.3% 18307844 / 19211461 / -4.7% 0.61 / 0.58 / +5.3%
tpcds_q16/duckdb:vortex-file-compressed 24787890 / 24638715 / +0.6% 35279025 / 36289454 / -2.8% 0.70 / 0.68 / +3.5%
tpcds_q17/duckdb:vortex-file-compressed 25009547 / 26274044 / -4.8% 36399414 / 44781928 / -18.7% 🟢 0.69 / 0.59 / +17.1%
tpcds_q18/duckdb:vortex-file-compressed 31525800 / 31445509 / +0.3% 44445886 / 42728601 / +4.0% 0.71 / 0.74 / -3.6%
tpcds_q19/duckdb:vortex-file-compressed 62935499 / 79300730 / -20.6% 🟢 73474494 / 90258210 / -18.6% 🟢 0.86 / 0.88 / -2.5%
tpcds_q20/duckdb:vortex-file-compressed 11127978 / 10960910 / +1.5% 19049035 / 19591880 / -2.8% 0.58 / 0.56 / +4.4%
tpcds_q21/duckdb:vortex-file-compressed 9325340 / 10652774 / -12.5% 🟢 21537884 / 21408665 / +0.6% 0.43 / 0.50 / -13.0%
tpcds_q22/duckdb:vortex-file-compressed 17158892 / 18482504 / -7.2% 28922936 / 28795715 / +0.4% 0.59 / 0.64 / -7.6%
tpcds_q23/duckdb:vortex-file-compressed 36944984 / 38563140 / -4.2% 51139236 / 50024108 / +2.2% 0.72 / 0.77 / -6.3%
tpcds_q24/duckdb:vortex-file-compressed 26397036 / 27604652 / -4.4% 38192493 / 40213051 / -5.0% 0.69 / 0.69 / +0.7%
tpcds_q25/duckdb:vortex-file-compressed 23895454 / 24465443 / -2.3% 36333071 / 39237264 / -7.4% 0.66 / 0.62 / +5.5%
tpcds_q26/duckdb:vortex-file-compressed 12690443 / 13054732 / -2.8% 22613427 / 21349530 / +5.9% 0.56 / 0.61 / -8.2%
tpcds_q27/duckdb:vortex-file-compressed 16286668 / 16273114 / +0.1% 28318748 / 26778601 / +5.8% 0.58 / 0.61 / -5.4%
tpcds_q28/duckdb:vortex-file-compressed 15376762 / 15848636 / -3.0% 26264547 / 25905250 / +1.4% 0.59 / 0.61 / -4.3%
tpcds_q29/duckdb:vortex-file-compressed 23095406 / 24304452 / -5.0% 34775659 / 38881231 / -10.6% 🟢 0.66 / 0.63 / +6.2%
tpcds_q30/duckdb:vortex-file-compressed 17978416 / 15938668 / +12.8% 🔴 26188615 / 24657826 / +6.2% 0.69 / 0.65 / +6.2%
tpcds_q31/duckdb:vortex-file-compressed 18231521 / 18584508 / -1.9% 27601745 / 27064379 / +2.0% 0.66 / 0.69 / -3.8%
tpcds_q32/duckdb:vortex-file-compressed 11869012 / 11894836 / -0.2% 22148966 / 21993665 / +0.7% 0.54 / 0.54 / -0.9%
tpcds_q33/duckdb:vortex-file-compressed 18589530 / 19543931 / -4.9% 30519247 / 29070845 / +5.0% 0.61 / 0.67 / -9.4%
tpcds_q34/duckdb:vortex-file-compressed 12670746 / 12752987 / -0.6% 23448447 / 23107962 / +1.5% 0.54 / 0.55 / -2.1%
tpcds_q35/duckdb:vortex-file-compressed 28203962 / 29082323 / -3.0% 40600032 / 41051960 / -1.1% 0.69 / 0.71 / -1.9%
tpcds_q36/duckdb:vortex-file-compressed 14965517 / 14751654 / +1.4% 25629602 / 25125431 / +2.0% 0.58 / 0.59 / -0.5%
tpcds_q37/duckdb:vortex-file-compressed 10239156 / 9649800 / +6.1% 23724403 / 24286363 / -2.3% 0.43 / 0.40 / +8.6%
tpcds_q38/duckdb:vortex-file-compressed 22841330 / 24782470 / -7.8% 31093365 / 31216554 / -0.4% 0.73 / 0.79 / -7.5%
tpcds_q39/duckdb:vortex-file-compressed 17719358 / 19740790 / -10.2% 🟢 29077203 / 32789852 / -11.3% 🟢 0.61 / 0.60 / +1.2%
tpcds_q40/duckdb:vortex-file-compressed 14781990 / 14604278 / +1.2% 21919981 / 21360684 / +2.6% 0.67 / 0.68 / -1.4%
tpcds_q41/duckdb:vortex-file-compressed 16450740 / 16990861 / -3.2% 23299850 / 24009914 / -3.0% 0.71 / 0.71 / -0.2%
tpcds_q42/duckdb:vortex-file-compressed 7275528 / 7240352 / +0.5% 18530869 / 15864770 / +16.8% 🔴 0.39 / 0.46 / -14.0%
tpcds_q43/duckdb:vortex-file-compressed 9733298 / 10108925 / -3.7% 20496211 / 18435260 / +11.2% 🔴 0.47 / 0.55 / -13.4%
tpcds_q44/duckdb:vortex-file-compressed 13167462 / 13212050 / -0.3% 24925986 / 23329607 / +6.8% 0.53 / 0.57 / -6.7%
tpcds_q45/duckdb:vortex-file-compressed 23193317 / 23775120 / -2.4% 30831017 / 32020489 / -3.7% 0.75 / 0.74 / +1.3%
tpcds_q46/duckdb:vortex-file-compressed 18199470 / 19622900 / -7.3% 27077735 / 28405675 / -4.7% 0.67 / 0.69 / -2.7%
tpcds_q47/duckdb:vortex-file-compressed 33641456 / 34433220 / -2.3% 45004938 / 45461162 / -1.0% 0.75 / 0.76 / -1.3%
tpcds_q48/duckdb:vortex-file-compressed 24256107 / 23768586 / +2.1% 37390837 / 36887045 / +1.4% 0.65 / 0.64 / +0.7%
tpcds_q49/duckdb:vortex-file-compressed 19767988 / 20267890 / -2.5% 30898274 / 33725913 / -8.4% 0.64 / 0.60 / +6.5%
tpcds_q50/duckdb:vortex-file-compressed 16862652 / 17628994 / -4.3% 29174905 / 30381660 / -4.0% 0.58 / 0.58 / -0.4%
tpcds_q51/duckdb:vortex-file-compressed 48994124 / 48601710 / +0.8% 61217342 / 58822546 / +4.1% 0.80 / 0.83 / -3.1%
tpcds_q52/duckdb:vortex-file-compressed 7118490 / 7450219 / -4.5% 16856743 / 16356178 / +3.1% 0.42 / 0.46 / -7.3%
tpcds_q53/duckdb:vortex-file-compressed 11870511 / 11541312 / +2.9% 21829476 / 22101482 / -1.2% 0.54 / 0.52 / +4.1%
tpcds_q54/duckdb:vortex-file-compressed 21253156 / 20739982 / +2.5% 34365896 / 30786714 / +11.6% 🔴 0.62 / 0.67 / -8.2%
tpcds_q55/duckdb:vortex-file-compressed 7076806 / 7231116 / -2.1% 16715350 / 16037446 / +4.2% 0.42 / 0.45 / -6.1%
tpcds_q56/duckdb:vortex-file-compressed 18032707 / 18864106 / -4.4% 31288401 / 29505909 / +6.0% 0.58 / 0.64 / -9.9%
tpcds_q57/duckdb:vortex-file-compressed 24861214 / 25793875 / -3.6% 34479073 / 34131585 / +1.0% 0.72 / 0.76 / -4.6%
tpcds_q58/duckdb:vortex-file-compressed 20760344 / 21190664 / -2.0% 31570939 / 30475196 / +3.6% 0.66 / 0.70 / -5.4%
tpcds_q59/duckdb:vortex-file-compressed 19367902 / 19932393 / -2.8% 28732703 / 28345353 / +1.4% 0.67 / 0.70 / -4.1%
tpcds_q60/duckdb:vortex-file-compressed 19372124 / 19497653 / -0.6% 30100121 / 29821043 / +0.9% 0.64 / 0.65 / -1.6%
tpcds_q61/duckdb:vortex-file-compressed 24565825 / 25684420 / -4.4% 33740516 / 36064970 / -6.4% 0.73 / 0.71 / +2.2%
tpcds_q62/duckdb:vortex-file-compressed 11032924 / 11944898 / -7.6% 18665312 / 19565335 / -4.6% 0.59 / 0.61 / -3.2%
tpcds_q63/duckdb:vortex-file-compressed 11496594 / 11170358 / +2.9% 20601113 / 21258306 / -3.1% 0.56 / 0.53 / +6.2%
tpcds_q64/duckdb:vortex-file-compressed 49648458 / 50817102 / -2.3% 67638831 / 72297245 / -6.4% 0.73 / 0.70 / +4.4%
tpcds_q65/duckdb:vortex-file-compressed 13324888 / 13303212 / +0.2% 24226878 / 22094615 / +9.7% 0.55 / 0.60 / -8.7%
tpcds_q66/duckdb:vortex-file-compressed 28304622 / 30084966 / -5.9% 39610539 / 40985145 / -3.4% 0.71 / 0.73 / -2.7%
tpcds_q67/duckdb:vortex-file-compressed 57558740 / 58624896 / -1.8% 66659879 / 69046586 / -3.5% 0.86 / 0.85 / +1.7%
tpcds_q68/duckdb:vortex-file-compressed 18197982 / 19510060 / -6.7% 27952529 / 28277963 / -1.2% 0.65 / 0.69 / -5.6%
tpcds_q69/duckdb:vortex-file-compressed 22314147 / 22786096 / -2.1% 38537915 / 38739256 / -0.5% 0.58 / 0.59 / -1.6%
tpcds_q70/duckdb:vortex-file-compressed 15814375 / 15991650 / -1.1% 28132934 / 25822088 / +8.9% 0.56 / 0.62 / -9.2%
tpcds_q71/duckdb:vortex-file-compressed 13213452 / 13361411 / -1.1% 24626747 / 23376103 / +5.4% 0.54 / 0.57 / -6.1%
tpcds_q72/duckdb:vortex-file-compressed 54423028 / 55682354 / -2.3% 66987939 / 72153954 / -7.2% 0.81 / 0.77 / +5.3%
tpcds_q73/duckdb:vortex-file-compressed 11627224 / 11565734 / +0.5% 21454777 / 21838564 / -1.8% 0.54 / 0.53 / +2.3%
tpcds_q74/duckdb:vortex-file-compressed 27911416 / 26818021 / +4.1% 35969052 / 34283575 / +4.9% 0.78 / 0.78 / -0.8%
tpcds_q75/duckdb:vortex-file-compressed 28684320 / 29669647 / -3.3% 40142505 / 40761902 / -1.5% 0.71 / 0.73 / -1.8%
tpcds_q76/duckdb:vortex-file-compressed 13938176 / 13436824 / +3.7% 27621805 / 23962125 / +15.3% 🔴 0.50 / 0.56 / -10.0%
tpcds_q77/duckdb:vortex-file-compressed 21394420 / 22130647 / -3.3% 32093206 / 30707756 / +4.5% 0.67 / 0.72 / -7.5%
tpcds_q78/duckdb:vortex-file-compressed 43985641 / 44280434 / -0.7% 54269511 / 53352231 / +1.7% 0.81 / 0.83 / -2.3%
tpcds_q79/duckdb:vortex-file-compressed 12509956 / 13661335 / -8.4% 22626047 / 22200806 / +1.9% 0.55 / 0.62 / -10.1%
tpcds_q80/duckdb:vortex-file-compressed 38435080 / 37922031 / +1.4% 49615587 / 50520244 / -1.8% 0.77 / 0.75 / +3.2%
tpcds_q81/duckdb:vortex-file-compressed 22749029 / 21646494 / +5.1% 31177412 / 29899380 / +4.3% 0.73 / 0.72 / +0.8%
tpcds_q82/duckdb:vortex-file-compressed 10420514 / 9949150 / +4.7% 25123896 / 24942839 / +0.7% 0.41 / 0.40 / +4.0%
tpcds_q83/duckdb:vortex-file-compressed 17759668 / 18651216 / -4.8% 25765113 / 25339383 / +1.7% 0.69 / 0.74 / -6.4%
tpcds_q84/duckdb:vortex-file-compressed 16833214 / 15647526 / +7.6% 25019227 / 23680991 / +5.7% 0.67 / 0.66 / +1.8%
tpcds_q85/duckdb:vortex-file-compressed 24233670 / 24910384 / -2.7% 37132520 / 38997724 / -4.8% 0.65 / 0.64 / +2.2%
tpcds_q86/duckdb:vortex-file-compressed 9730716 / 9787171 / -0.6% 16205215 / 17340539 / -6.5% 0.60 / 0.56 / +6.4%
tpcds_q87/duckdb:vortex-file-compressed 24404022 / 26168744 / -6.7% 33455871 / 33020011 / +1.3% 0.73 / 0.79 / -8.0%
tpcds_q88/duckdb:vortex-file-compressed 31981469 / 33231305 / -3.8% 41450754 / 41046285 / +1.0% 0.77 / 0.81 / -4.7%
tpcds_q89/duckdb:vortex-file-compressed 12040806 / 12135859 / -0.8% 22517392 / 22064435 / +2.1% 0.53 / 0.55 / -2.8%
tpcds_q90/duckdb:vortex-file-compressed 8164665 / 8559680 / -4.6% 15825424 / 16425296 / -3.7% 0.52 / 0.52 / -1.0%
tpcds_q91/duckdb:vortex-file-compressed 14292944 / 14158547 / +0.9% 22959150 / 22520795 / +1.9% 0.62 / 0.63 / -1.0%
tpcds_q92/duckdb:vortex-file-compressed 12245753 / 12135513 / +0.9% 22502927 / 21221466 / +6.0% 0.54 / 0.57 / -4.8%
tpcds_q93/duckdb:vortex-file-compressed 10361934 / 10658744 / -2.8% 23492058 / 26001509 / -9.7% 0.44 / 0.41 / +7.6%
tpcds_q94/duckdb:vortex-file-compressed 22279942 / 22341678 / -0.3% 33695045 / 32277200 / +4.4% 0.66 / 0.69 / -4.5%
tpcds_q95/duckdb:vortex-file-compressed 63287384 / 63269032 / +0.0% 72456065 / 71640984 / +1.1% 0.87 / 0.88 / -1.1%
tpcds_q96/duckdb:vortex-file-compressed 7087830 / 6990965 / +1.4% 16594077 / 15489259 / +7.1% 0.43 / 0.45 / -5.4%
tpcds_q97/duckdb:vortex-file-compressed 23200682 / 23773763 / -2.4% 34156847 / 32308856 / +5.7% 0.68 / 0.74 / -7.7%
tpcds_q98/duckdb:vortex-file-compressed 12225564 / 11465530 / +6.6% 21704438 / 21349587 / +1.7% 0.56 / 0.54 / +4.9%
tpcds_q99/duckdb:vortex-file-compressed 13510738 / 15223684 / -11.3% 🟢 21805915 / 22701572 / -3.9% 0.62 / 0.67 / -7.6%
duckdb / parquet / ns (0.988x ➖, 1↑ 1↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpcds_q01/duckdb:parquet 24590452 / 24673900 / -0.3% 31095996 / 31597103 / -1.6% 0.79 / 0.78 / +1.3%
tpcds_q02/duckdb:parquet 18552813 / 18779242 / -1.2% 24300171 / 25440945 / -4.5% 0.76 / 0.74 / +3.4%
tpcds_q03/duckdb:parquet 10053848 / 10045058 / +0.1% 15938174 / 16027789 / -0.6% 0.63 / 0.63 / +0.7%
tpcds_q04/duckdb:parquet 118396106 / 118810773 / -0.3% 126324157 / 127621241 / -1.0% 0.94 / 0.93 / +0.7%
tpcds_q05/duckdb:parquet 29039132 / 29710364 / -2.3% 33298481 / 34308505 / -2.9% 0.87 / 0.87 / +0.7%
tpcds_q06/duckdb:parquet 26586360 / 27456218 / -3.2% 35912155 / 36559816 / -1.8% 0.74 / 0.75 / -1.4%
tpcds_q07/duckdb:parquet 31309651 / 31650976 / -1.1% 39738012 / 41008948 / -3.1% 0.79 / 0.77 / +2.1%
tpcds_q08/duckdb:parquet 20503372 / 20567182 / -0.3% 26256359 / 25342328 / +3.6% 0.78 / 0.81 / -3.8%
tpcds_q09/duckdb:parquet 28267426 / 28220337 / +0.2% 32662118 / 33362670 / -2.1% 0.87 / 0.85 / +2.3%
tpcds_q10/duckdb:parquet 33139728 / 33894828 / -2.2% 41600986 / 41545958 / +0.1% 0.80 / 0.82 / -2.4%
tpcds_q11/duckdb:parquet 68923336 / 69054548 / -0.2% 75437433 / 75215719 / +0.3% 0.91 / 0.92 / -0.5%
tpcds_q12/duckdb:parquet 14434246 / 14560424 / -0.9% 19610884 / 19683833 / -0.4% 0.74 / 0.74 / -0.5%
tpcds_q13/duckdb:parquet 30696792 / 31287213 / -1.9% 40553306 / 40032508 / +1.3% 0.76 / 0.78 / -3.1%
tpcds_q14/duckdb:parquet 64817692 / 66212438 / -2.1% 70907447 / 72616743 / -2.4% 0.91 / 0.91 / +0.3%
tpcds_q15/duckdb:parquet 17064989 / 17190099 / -0.7% 24457312 / 23909413 / +2.3% 0.70 / 0.72 / -3.0%
tpcds_q16/duckdb:parquet 30848280 / 30960560 / -0.4% 38147223 / 37954246 / +0.5% 0.81 / 0.82 / -0.9%
tpcds_q17/duckdb:parquet 35187242 / 35681960 / -1.4% 41096223 / 42241882 / -2.7% 0.86 / 0.84 / +1.4%
tpcds_q18/duckdb:parquet 48486279 / 48661529 / -0.4% 56557538 / 56341232 / +0.4% 0.86 / 0.86 / -0.7%
tpcds_q19/duckdb:parquet 19143044 / 19338113 / -1.0% 26176475 / 26541668 / -1.4% 0.73 / 0.73 / +0.4%
tpcds_q20/duckdb:parquet 15260056 / 15429160 / -1.1% 20594016 / 20028428 / +2.8% 0.74 / 0.77 / -3.8%
tpcds_q21/duckdb:parquet 11013754 / 11308039 / -2.6% 17495710 / 17426332 / +0.4% 0.63 / 0.65 / -3.0%
tpcds_q22/duckdb:parquet 21107082 / 21265294 / -0.7% 27784883 / 26876313 / +3.4% 0.76 / 0.79 / -4.0%
tpcds_q23/duckdb:parquet 44554880 / 44731359 / -0.4% 47644091 / 48820700 / -2.4% 0.94 / 0.92 / +2.1%
tpcds_q24/duckdb:parquet 32411937 / 31347500 / +3.4% 37184008 / 37647965 / -1.2% 0.87 / 0.83 / +4.7%
tpcds_q25/duckdb:parquet 31302492 / 31439509 / -0.4% 37834656 / 38159167 / -0.9% 0.83 / 0.82 / +0.4%
tpcds_q26/duckdb:parquet 29804802 / 29706251 / +0.3% 35855689 / 36671682 / -2.2% 0.83 / 0.81 / +2.6%
tpcds_q27/duckdb:parquet 33628748 / 34077402 / -1.3% 42328668 / 42499188 / -0.4% 0.79 / 0.80 / -0.9%
tpcds_q28/duckdb:parquet 26602252 / 26598855 / +0.0% 32027511 / 31659247 / +1.2% 0.83 / 0.84 / -1.1%
tpcds_q29/duckdb:parquet 32599546 / 32873102 / -0.8% 40085863 / 40298894 / -0.5% 0.81 / 0.82 / -0.3%
tpcds_q30/duckdb:parquet 36283706 / 36401042 / -0.3% 44945713 / 46141035 / -2.6% 0.81 / 0.79 / +2.3%
tpcds_q31/duckdb:parquet 37263096 / 36256521 / +2.8% 43726496 / 43753866 / -0.1% 0.85 / 0.83 / +2.8%
tpcds_q32/duckdb:parquet 14822142 / 14899110 / -0.5% 21064538 / 21970548 / -4.1% 0.70 / 0.68 / +3.8%
tpcds_q33/duckdb:parquet 24404080 / 26583120 / -8.2% 30246814 / 31205228 / -3.1% 0.81 / 0.85 / -5.3%
tpcds_q34/duckdb:parquet 17812192 / 18277278 / -2.5% 25038130 / 24997911 / +0.2% 0.71 / 0.73 / -2.7%
tpcds_q35/duckdb:parquet 35840488 / 35797408 / +0.1% 43675085 / 44908265 / -2.7% 0.82 / 0.80 / +2.9%
tpcds_q36/duckdb:parquet 40718522 / 41818885 / -2.6% 49645893 / 49153685 / +1.0% 0.82 / 0.85 / -3.6%
tpcds_q37/duckdb:parquet 12872338 / 13253100 / -2.9% 20046730 / 19412016 / +3.3% 0.64 / 0.68 / -5.9%
tpcds_q38/duckdb:parquet 30136246 / 30737380 / -2.0% 34466416 / 34973430 / -1.4% 0.87 / 0.88 / -0.5%
tpcds_q39/duckdb:parquet 23472297 / 23619953 / -0.6% 30750952 / 30125370 / +2.1% 0.76 / 0.78 / -2.6%
tpcds_q40/duckdb:parquet 16487214 / 16726736 / -1.4% 22209214 / 22223436 / -0.1% 0.74 / 0.75 / -1.4%
tpcds_q41/duckdb:parquet 12371954 / 12335388 / +0.3% 18466848 / 19197558 / -3.8% 0.67 / 0.64 / +4.3%
tpcds_q42/duckdb:parquet 9625268 / 9857497 / -2.4% 16498088 / 15926367 / +3.6% 0.58 / 0.62 / -5.7%
tpcds_q43/duckdb:parquet 12529980 / 12789746 / -2.0% 18715187 / 19023336 / -1.6% 0.67 / 0.67 / -0.4%
tpcds_q44/duckdb:parquet 21130956 / 21801771 / -3.1% 29006337 / 26568135 / +9.2% 0.73 / 0.82 / -11.2%
tpcds_q45/duckdb:parquet 21345236 / 21885214 / -2.5% 29052866 / 29404328 / -1.2% 0.73 / 0.74 / -1.3%
tpcds_q46/duckdb:parquet 36324826 / 36606976 / -0.8% 44861178 / 45222466 / -0.8% 0.81 / 0.81 / +0.0%
tpcds_q47/duckdb:parquet 34493004 / 34744946 / -0.7% 41204269 / 41661612 / -1.1% 0.84 / 0.83 / +0.4%
tpcds_q48/duckdb:parquet 29584182 / 32473585 / -8.9% 37803356 / 37608720 / +0.5% 0.78 / 0.86 / -9.4%
tpcds_q49/duckdb:parquet 31063306 / 31260416 / -0.6% 35911107 / 37094137 / -3.2% 0.87 / 0.84 / +2.6%
tpcds_q50/duckdb:parquet 20068765 / 20102320 / -0.2% 26297397 / 26559020 / -1.0% 0.76 / 0.76 / +0.8%
tpcds_q51/duckdb:parquet 52808837 / 52547346 / +0.5% 61351685 / 78821951 / -22.2% 🟢 0.86 / 0.67 / +29.1%
tpcds_q52/duckdb:parquet 9894681 / 9994696 / -1.0% 15677081 / 16339178 / -4.1% 0.63 / 0.61 / +3.2%
tpcds_q53/duckdb:parquet 14060382 / 14444869 / -2.7% 21393502 / 21501383 / -0.5% 0.66 / 0.67 / -2.2%
tpcds_q54/duckdb:parquet 25559076 / 25997418 / -1.7% 33404812 / 33893286 / -1.4% 0.77 / 0.77 / -0.2%
tpcds_q55/duckdb:parquet 9899929 / 9797658 / +1.0% 15390776 / 16049345 / -4.1% 0.64 / 0.61 / +5.4%
tpcds_q56/duckdb:parquet 26392446 / 27533279 / -4.1% 31500916 / 31736565 / -0.7% 0.84 / 0.87 / -3.4%
tpcds_q57/duckdb:parquet 30974404 / 31154568 / -0.6% 36693397 / 36300391 / +1.1% 0.84 / 0.86 / -1.6%
tpcds_q58/duckdb:parquet 24387854 / 25802088 / -5.5% 30501781 / 31132712 / -2.0% 0.80 / 0.83 / -3.5%
tpcds_q59/duckdb:parquet 23683532 / 23818528 / -0.6% 29905436 / 29754601 / +0.5% 0.79 / 0.80 / -1.1%
tpcds_q60/duckdb:parquet 28149132 / 29056988 / -3.1% 32846795 / 33580624 / -2.2% 0.86 / 0.87 / -1.0%
tpcds_q61/duckdb:parquet 25650232 / 25869153 / -0.8% 30131695 / 31039840 / -2.9% 0.85 / 0.83 / +2.1%
tpcds_q62/duckdb:parquet 13443092 / 13740614 / -2.2% 18715743 / 18797537 / -0.4% 0.72 / 0.73 / -1.7%
tpcds_q63/duckdb:parquet 13710664 / 13900613 / -1.4% 20415215 / 20536005 / -0.6% 0.67 / 0.68 / -0.8%
tpcds_q64/duckdb:parquet 71432068 / 71838105 / -0.6% 82497531 / 84146068 / -2.0% 0.87 / 0.85 / +1.4%
tpcds_q65/duckdb:parquet 18758261 / 22019162 / -14.8% 🟢 24787077 / 25626541 / -3.3% 0.76 / 0.86 / -11.9%
tpcds_q66/duckdb:parquet 36101045 / 36373480 / -0.7% 42961263 / 42985868 / -0.1% 0.84 / 0.85 / -0.7%
tpcds_q67/duckdb:parquet 61672300 / 61964835 / -0.5% 70592751 / 69058366 / +2.2% 0.87 / 0.90 / -2.6%
tpcds_q68/duckdb:parquet 33207976 / 29079984 / +14.2% 🔴 37187695 / 37543729 / -0.9% 0.89 / 0.77 / +15.3%
tpcds_q69/duckdb:parquet 26281374 / 26873472 / -2.2% 35464116 / 35330119 / +0.4% 0.74 / 0.76 / -2.6%
tpcds_q70/duckdb:parquet 20128420 / 19919544 / +1.0% 26828057 / 28028592 / -4.3% 0.75 / 0.71 / +5.6%
tpcds_q71/duckdb:parquet 18145058 / 17852386 / +1.6% 24203964 / 24683723 / -1.9% 0.75 / 0.72 / +3.7%
tpcds_q72/duckdb:parquet 55531950 / 55494834 / +0.1% 63208975 / 63109191 / +0.2% 0.88 / 0.88 / -0.1%
tpcds_q73/duckdb:parquet 15094442 / 15372992 / -1.8% 21874858 / 22145965 / -1.2% 0.69 / 0.69 / -0.6%
tpcds_q74/duckdb:parquet 84640083 / 84770996 / -0.2% 92833562 / 91511972 / +1.4% 0.91 / 0.93 / -1.6%
tpcds_q75/duckdb:parquet 46367824 / 46319602 / +0.1% 51134760 / 52185983 / -2.0% 0.91 / 0.89 / +2.2%
tpcds_q76/duckdb:parquet 19579177 / 19989195 / -2.1% 23734658 / 25436467 / -6.7% 0.82 / 0.79 / +5.0%
tpcds_q77/duckdb:parquet 26960382 / 26216292 / +2.8% 31510182 / 33241008 / -5.2% 0.86 / 0.79 / +8.5%
tpcds_q78/duckdb:parquet 79420613 / 78838902 / +0.7% 87738941 / 87540270 / +0.2% 0.91 / 0.90 / +0.5%
tpcds_q79/duckdb:parquet 21812169 / 22883402 / -4.7% 29969311 / 29489535 / +1.6% 0.73 / 0.78 / -6.2%
tpcds_q80/duckdb:parquet 39234644 / 39339602 / -0.3% 44090908 / 45525976 / -3.2% 0.89 / 0.86 / +3.0%
tpcds_q81/duckdb:parquet 37052714 / 37428687 / -1.0% 45914703 / 45503248 / +0.9% 0.81 / 0.82 / -1.9%
tpcds_q82/duckdb:parquet 14233526 / 14159156 / +0.5% 20782474 / 21491615 / -3.3% 0.68 / 0.66 / +4.0%
tpcds_q83/duckdb:parquet 20501661 / 21316366 / -3.8% 25687399 / 26746994 / -4.0% 0.80 / 0.80 / +0.1%
tpcds_q84/duckdb:parquet 23452354 / 23790440 / -1.4% 28924002 / 29208430 / -1.0% 0.81 / 0.81 / -0.5%
tpcds_q85/duckdb:parquet 32924194 / 33547404 / -1.9% 40518673 / 40646288 / -0.3% 0.81 / 0.83 / -1.5%
tpcds_q86/duckdb:parquet 12108002 / 12219688 / -0.9% 17225800 / 17501309 / -1.6% 0.70 / 0.70 / +0.7%
tpcds_q87/duckdb:parquet 31824214 / 32406392 / -1.8% 36118282 / 37409596 / -3.5% 0.88 / 0.87 / +1.7%
tpcds_q88/duckdb:parquet 39749990 / 41986018 / -5.3% 45325125 / 47098988 / -3.8% 0.88 / 0.89 / -1.6%
tpcds_q89/duckdb:parquet 14765750 / 14769328 / -0.0% 21741517 / 21968486 / -1.0% 0.68 / 0.67 / +1.0%
tpcds_q90/duckdb:parquet 10456615 / 10741412 / -2.7% 15083726 / 15926596 / -5.3% 0.69 / 0.67 / +2.8%
tpcds_q91/duckdb:parquet 21750147 / 21998390 / -1.1% 28716249 / 29610224 / -3.0% 0.76 / 0.74 / +1.9%
tpcds_q92/duckdb:parquet 15986944 / 16015634 / -0.2% 22238886 / 23007018 / -3.3% 0.72 / 0.70 / +3.3%
tpcds_q93/duckdb:parquet 14299902 / 14303377 / -0.0% 20673179 / 21308365 / -3.0% 0.69 / 0.67 / +3.0%
tpcds_q94/duckdb:parquet 25713614 / 26302418 / -2.2% 33603137 / 33248380 / +1.1% 0.77 / 0.79 / -3.3%
tpcds_q95/duckdb:parquet 43966309 / 44770982 / -1.8% 49958871 / 50261098 / -0.6% 0.88 / 0.89 / -1.2%
tpcds_q96/duckdb:parquet 8613715 / 8661608 / -0.6% 13963448 / 14205793 / -1.7% 0.62 / 0.61 / +1.2%
tpcds_q97/duckdb:parquet 28150714 / 27960650 / +0.7% 34717744 / 35222259 / -1.4% 0.81 / 0.79 / +2.1%
tpcds_q98/duckdb:parquet 16782534 / 17005148 / -1.3% 24148136 / 23760211 / +1.6% 0.69 / 0.72 / -2.9%
tpcds_q99/duckdb:parquet 19406582 / 19731011 / -1.6% 24319216 / 24804477 / -2.0% 0.80 / 0.80 / +0.3%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 27, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: Clickbench on NVME 📖

Commits: PR aa2cf422 vs base c56ee880
Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.1%
Engines: DataFusion No clear signal (+2.7%, low confidence) · DuckDB No clear signal (+1.5%, low confidence)
Vortex (geomean): hot 1.013x ➖ · cold 1.134x ❌
Parquet (geomean): hot 0.992x ➖ · cold 0.993x ➖
Shifts: Parquet (control) -0.8% · Median polish +0.2%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (1.021x ➖, 0↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:vortex-file-compressed 1241277 / 1228981 / +1.0% 21715178 / 22110569 / -1.8% 0.06 / 0.06 / +2.8%
clickbench_q01/datafusion:vortex-file-compressed 6458826 / 6150722 / +5.0% 53659061 / 33882106 / +58.4% 🔴 0.12 / 0.18 / -33.7%
clickbench_q02/datafusion:vortex-file-compressed 11520976 / 10700122 / +7.7% 58313684 / 45807597 / +27.3% 🔴 0.20 / 0.23 / -15.4%
clickbench_q03/datafusion:vortex-file-compressed 13235882 / 13273293 / -0.3% 58249855 / 55376905 / +5.2% 0.23 / 0.24 / -5.2%
clickbench_q04/datafusion:vortex-file-compressed 58821365 / 58769106 / +0.1% 106691767 / 98305079 / +8.5% 0.55 / 0.60 / -7.8%
clickbench_q05/datafusion:vortex-file-compressed 78288466 / 80357124 / -2.6% 128265402 / 126469775 / +1.4% 0.61 / 0.64 / -3.9%
clickbench_q06/datafusion:vortex-file-compressed 1264079 / 1252257 / +0.9% 22863803 / 22811822 / +0.2% 0.06 / 0.05 / +0.7%
clickbench_q07/datafusion:vortex-file-compressed 9689807 / 9145436 / +6.0% 58312024 / 34667355 / +68.2% 🔴 0.17 / 0.26 / -37.0%
clickbench_q08/datafusion:vortex-file-compressed 79516306 / 77962974 / +2.0% 126070458 / 124301215 / +1.4% 0.63 / 0.63 / +0.6%
clickbench_q09/datafusion:vortex-file-compressed 171151329 / 176549119 / -3.1% 221255323 / 206475942 / +7.2% 0.77 / 0.86 / -9.5%
clickbench_q10/datafusion:vortex-file-compressed 24596033 / 22944346 / +7.2% 73728953 / 70862281 / +4.0% 0.33 / 0.32 / +3.0%
clickbench_q11/datafusion:vortex-file-compressed 25960340 / 26668255 / -2.7% 76282090 / 73622601 / +3.6% 0.34 / 0.36 / -6.0%
clickbench_q12/datafusion:vortex-file-compressed 72074224 / 71499342 / +0.8% 130496859 / 124820774 / +4.5% 0.55 / 0.57 / -3.6%
clickbench_q13/datafusion:vortex-file-compressed 117220536 / 114735826 / +2.2% 183106258 / 185813910 / -1.5% 0.64 / 0.62 / +3.7%
clickbench_q14/datafusion:vortex-file-compressed 76360660 / 76289194 / +0.1% 125749493 / 127065299 / -1.0% 0.61 / 0.60 / +1.1%
clickbench_q15/datafusion:vortex-file-compressed 63923142 / 63295892 / +1.0% 104755568 / 98759667 / +6.1% 0.61 / 0.64 / -4.8%
clickbench_q16/datafusion:vortex-file-compressed 157846342 / 154838390 / +1.9% 220572181 / 217438035 / +1.4% 0.72 / 0.71 / +0.5%
clickbench_q17/datafusion:vortex-file-compressed 154569032 / 153752810 / +0.5% 222329950 / 223428308 / -0.5% 0.70 / 0.69 / +1.0%
clickbench_q18/datafusion:vortex-file-compressed 296613939 / 291592342 / +1.7% 386268421 / 373271723 / +3.5% 0.77 / 0.78 / -1.7%
clickbench_q19/datafusion:vortex-file-compressed 8793168 / 7890074 / +11.4% 🔴 57090617 / 47291886 / +20.7% 🔴 0.15 / 0.17 / -7.7%
clickbench_q20/datafusion:vortex-file-compressed 69046002 / 68313731 / +1.1% 244595999 / 244552326 / +0.0% 0.28 / 0.28 / +1.1%
clickbench_q21/datafusion:vortex-file-compressed 79637926 / 77873896 / +2.3% 293197738 / 288555759 / +1.6% 0.27 / 0.27 / +0.6%
clickbench_q22/datafusion:vortex-file-compressed 100463234 / 95647370 / +5.0% 402533138 / 397097139 / +1.4% 0.25 / 0.24 / +3.6%
clickbench_q23/datafusion:vortex-file-compressed 191061720 / 190831840 / +0.1% 580836209 / 554914300 / +4.7% 0.33 / 0.34 / -4.3%
clickbench_q24/datafusion:vortex-file-compressed 17559926 / 15302571 / +14.8% 🔴 68951507 / 72082867 / -4.3% 0.25 / 0.21 / +20.0%
clickbench_q25/datafusion:vortex-file-compressed 19986755 / 20588595 / -2.9% 68746322 / 60244508 / +14.1% 🔴 0.29 / 0.34 / -14.9%
clickbench_q26/datafusion:vortex-file-compressed 17205170 / 16609218 / +3.6% 68658437 / 71794618 / -4.4% 0.25 / 0.23 / +8.3%
clickbench_q27/datafusion:vortex-file-compressed 103915894 / 102104660 / +1.8% 267706113 / 258324993 / +3.6% 0.39 / 0.40 / -1.8%
clickbench_q28/datafusion:vortex-file-compressed 557591628 / 556225414 / +0.2% 647805993 / 637300135 / +1.6% 0.86 / 0.87 / -1.4%
clickbench_q29/datafusion:vortex-file-compressed 25449692 / 24398267 / +4.3% 70985565 / 55954807 / +26.9% 🔴 0.36 / 0.44 / -17.8%
clickbench_q30/datafusion:vortex-file-compressed 57209028 / 57900836 / -1.2% 109177702 / 108169328 / +0.9% 0.52 / 0.54 / -2.1%
clickbench_q31/datafusion:vortex-file-compressed 66170804 / 66409386 / -0.4% 156282450 / 158157709 / -1.2% 0.42 / 0.42 / +0.8%
clickbench_q32/datafusion:vortex-file-compressed 286621618 / 295356992 / -3.0% 393985484 / 386075545 / +2.0% 0.73 / 0.77 / -4.9%
clickbench_q33/datafusion:vortex-file-compressed 324339722 / 320276246 / +1.3% 443729838 / 432425441 / +2.6% 0.73 / 0.74 / -1.3%
clickbench_q34/datafusion:vortex-file-compressed 320496712 / 324393304 / -1.2% 442547124 / 441057324 / +0.3% 0.72 / 0.74 / -1.5%
clickbench_q35/datafusion:vortex-file-compressed 59754558 / 56576694 / +5.6% 98161404 / 92670428 / +5.9% 0.61 / 0.61 / -0.3%
clickbench_q36/datafusion:vortex-file-compressed 37972294 / 37706178 / +0.7% 70066130 / 69280291 / +1.1% 0.54 / 0.54 / -0.4%
clickbench_q37/datafusion:vortex-file-compressed 21549764 / 21092111 / +2.2% 49017644 / 47561329 / +3.1% 0.44 / 0.44 / -0.9%
clickbench_q38/datafusion:vortex-file-compressed 13367048 / 13246277 / +0.9% 42577399 / 42695683 / -0.3% 0.31 / 0.31 / +1.2%
clickbench_q39/datafusion:vortex-file-compressed 78730250 / 79202518 / -0.6% 114920349 / 112040135 / +2.6% 0.69 / 0.71 / -3.1%
clickbench_q40/datafusion:vortex-file-compressed 10878022 / 10520412 / +3.4% 38018072 / 37956480 / +0.2% 0.29 / 0.28 / +3.2%
clickbench_q41/datafusion:vortex-file-compressed 10504486 / 10213832 / +2.8% 37135211 / 36447248 / +1.9% 0.28 / 0.28 / +0.9%
clickbench_q42/datafusion:vortex-file-compressed 11275882 / 10275152 / +9.7% 37415158 / 37048880 / +1.0% 0.30 / 0.28 / +8.7%
datafusion / parquet / ns (0.993x ➖, 0↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/datafusion:parquet 1276733 / 1265224 / +0.9% 49232694 / 52104785 / -5.5% 0.03 / 0.02 / +6.8%
clickbench_q01/datafusion:parquet 15707733 / 15648428 / +0.4% 64952238 / 68691545 / -5.4% 0.24 / 0.23 / +6.2%
clickbench_q02/datafusion:parquet 18665764 / 19152456 / -2.5% 79894594 / 82031921 / -2.6% 0.23 / 0.23 / +0.1%
clickbench_q03/datafusion:parquet 17127881 / 17249098 / -0.7% 79025145 / 82628389 / -4.4% 0.22 / 0.21 / +3.8%
clickbench_q04/datafusion:parquet 63000436 / 63860547 / -1.3% 127529092 / 128421274 / -0.7% 0.49 / 0.50 / -0.7%
clickbench_q05/datafusion:parquet 88053166 / 88774738 / -0.8% 156784801 / 159914984 / -2.0% 0.56 / 0.56 / +1.2%
clickbench_q06/datafusion:parquet 1284802 / 1273132 / +0.9% 48668288 / 50777079 / -4.2% 0.03 / 0.03 / +5.3%
clickbench_q07/datafusion:parquet 16424336 / 16547823 / -0.7% 67053631 / 69350578 / -3.3% 0.24 / 0.24 / +2.7%
clickbench_q08/datafusion:parquet 84366586 / 84153482 / +0.3% 164947898 / 163839670 / +0.7% 0.51 / 0.51 / -0.4%
clickbench_q09/datafusion:parquet 190122791 / 191862536 / -0.9% 258254825 / 260620040 / -0.9% 0.74 / 0.74 / +0.0%
clickbench_q10/datafusion:parquet 35924468 / 36320928 / -1.1% 99561082 / 102274470 / -2.7% 0.36 / 0.36 / +1.6%
clickbench_q11/datafusion:parquet 41852710 / 42871901 / -2.4% 108997999 / 111478424 / -2.2% 0.38 / 0.38 / -0.2%
clickbench_q12/datafusion:parquet 95888452 / 96304142 / -0.4% 161614308 / 163785926 / -1.3% 0.59 / 0.59 / +0.9%
clickbench_q13/datafusion:parquet 147463242 / 145684786 / +1.2% 225383699 / 230108637 / -2.1% 0.65 / 0.63 / +3.3%
clickbench_q14/datafusion:parquet 100944368 / 101961642 / -1.0% 171780744 / 175825652 / -2.3% 0.59 / 0.58 / +1.3%
clickbench_q15/datafusion:parquet 70128064 / 72680384 / -3.5% 129150082 / 133977054 / -3.6% 0.54 / 0.54 / +0.1%
clickbench_q16/datafusion:parquet 156027774 / 157254348 / -0.8% 234594529 / 239523235 / -2.1% 0.67 / 0.66 / +1.3%
clickbench_q17/datafusion:parquet 156487164 / 157410682 / -0.6% 232678927 / 237906537 / -2.2% 0.67 / 0.66 / +1.6%
clickbench_q18/datafusion:parquet 306758929 / 312692480 / -1.9% 420759617 / 423551774 / -0.7% 0.73 / 0.74 / -1.2%
clickbench_q19/datafusion:parquet 18441589 / 19012652 / -3.0% 77173783 / 78524794 / -1.7% 0.24 / 0.24 / -1.3%
clickbench_q20/datafusion:parquet 177664372 / 180364944 / -1.5% 281216327 / 295565727 / -4.9% 0.63 / 0.61 / +3.5%
clickbench_q21/datafusion:parquet 172452467 / 173628884 / -0.7% 301872697 / 314074373 / -3.9% 0.57 / 0.55 / +3.3%
clickbench_q22/datafusion:parquet 258270132 / 260706438 / -0.9% 427577115 / 458546451 / -6.8% 0.60 / 0.57 / +6.2%
clickbench_q23/datafusion:parquet 1002347456 / 1020670095 / -1.8% 1162795688 / 1202623407 / -3.3% 0.86 / 0.85 / +1.6%
clickbench_q24/datafusion:parquet 30266511 / 30328900 / -0.2% 88367085 / 95408745 / -7.4% 0.34 / 0.32 / +7.7%
clickbench_q25/datafusion:parquet 37469954 / 37741742 / -0.7% 101565812 / 105254472 / -3.5% 0.37 / 0.36 / +2.9%
clickbench_q26/datafusion:parquet 30545391 / 30780454 / -0.8% 89881388 / 91092595 / -1.3% 0.34 / 0.34 / +0.6%
clickbench_q27/datafusion:parquet 192814960 / 193077530 / -0.1% 289609441 / 306529240 / -5.5% 0.67 / 0.63 / +5.7%
clickbench_q28/datafusion:parquet 614991652 / 616773618 / -0.3% 700392699 / 710647670 / -1.4% 0.88 / 0.87 / +1.2%
clickbench_q29/datafusion:parquet 28969997 / 29471605 / -1.7% 89829751 / 91408409 / -1.7% 0.32 / 0.32 / +0.0%
clickbench_q30/datafusion:parquet 89005266 / 89611220 / -0.7% 170081698 / 172239415 / -1.3% 0.52 / 0.52 / +0.6%
clickbench_q31/datafusion:parquet 103999546 / 101971048 / +2.0% 195537777 / 198441811 / -1.5% 0.53 / 0.51 / +3.5%
clickbench_q32/datafusion:parquet 310429452 / 305817985 / +1.5% 428391620 / 423293864 / +1.2% 0.72 / 0.72 / +0.3%
clickbench_q33/datafusion:parquet 375498434 / 377171645 / -0.4% 473848905 / 472988279 / +0.2% 0.79 / 0.80 / -0.6%
clickbench_q34/datafusion:parquet 376383090 / 378637092 / -0.6% 478992578 / 480595747 / -0.3% 0.79 / 0.79 / -0.3%
clickbench_q35/datafusion:parquet 64445634 / 64178382 / +0.4% 123466017 / 122925414 / +0.4% 0.52 / 0.52 / -0.0%
clickbench_q36/datafusion:parquet 73248260 / 73518295 / -0.4% 137201643 / 137636432 / -0.3% 0.53 / 0.53 / -0.1%
clickbench_q37/datafusion:parquet 35257806 / 35379918 / -0.3% 91273106 / 92700841 / -1.5% 0.39 / 0.38 / +1.2%
clickbench_q38/datafusion:parquet 47344302 / 47358285 / -0.0% 108962480 / 107480257 / +1.4% 0.43 / 0.44 / -1.4%
clickbench_q39/datafusion:parquet 143054633 / 143498614 / -0.3% 209388584 / 210166178 / -0.4% 0.68 / 0.68 / +0.1%
clickbench_q40/datafusion:parquet 19916944 / 20060762 / -0.7% 76966662 / 77114767 / -0.2% 0.26 / 0.26 / -0.5%
clickbench_q41/datafusion:parquet 18754576 / 18771977 / -0.1% 75271066 / 75864033 / -0.8% 0.25 / 0.25 / +0.7%
clickbench_q42/datafusion:parquet 18944564 / 19300238 / -1.8% 73719445 / 77226922 / -4.5% 0.26 / 0.25 / +2.8%
duckdb / vortex-file-compressed / ns (1.005x ➖, 4↑ 6↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:vortex-file-compressed 2123876 / 2334830 / -9.0% 48474165 / 22553581 / +114.9% 🔴 0.04 / 0.10 / -57.7%
clickbench_q01/duckdb:vortex-file-compressed 6903921 / 7133323 / -3.2% 53048169 / 23450466 / +126.2% 🔴 0.13 / 0.30 / -57.2%
clickbench_q02/duckdb:vortex-file-compressed 8481748 / 8263174 / +2.6% 57100924 / 34980907 / +63.2% 🔴 0.15 / 0.24 / -37.1%
clickbench_q03/duckdb:vortex-file-compressed 13293612 / 14708860 / -9.6% 63785635 / 55251696 / +15.4% 🔴 0.21 / 0.27 / -21.7%
clickbench_q04/duckdb:vortex-file-compressed 56197078 / 55645276 / +1.0% 106543681 / 93667881 / +13.7% 🔴 0.53 / 0.59 / -11.2%
clickbench_q05/duckdb:vortex-file-compressed 64343540 / 64712058 / -0.6% 113961838 / 93420939 / +22.0% 🔴 0.56 / 0.69 / -18.5%
clickbench_q06/duckdb:vortex-file-compressed 2577434 / 2614999 / -1.4% 52681624 / 27338452 / +92.7% 🔴 0.05 / 0.10 / -48.9%
clickbench_q07/duckdb:vortex-file-compressed 8994206 / 8268904 / +8.8% 54955591 / 25443624 / +116.0% 🔴 0.16 / 0.32 / -49.6%
clickbench_q08/duckdb:vortex-file-compressed 69128124 / 67518272 / +2.4% 120089204 / 112447314 / +6.8% 0.58 / 0.60 / -4.1%
clickbench_q09/duckdb:vortex-file-compressed 90891912 / 89324798 / +1.8% 140486445 / 130718833 / +7.5% 0.65 / 0.68 / -5.3%
clickbench_q10/duckdb:vortex-file-compressed 22906863 / 26620322 / -13.9% 🟢 80252884 / 71130899 / +12.8% 🔴 0.29 / 0.37 / -23.7%
clickbench_q11/duckdb:vortex-file-compressed 25876006 / 28742846 / -10.0% 83155649 / 73511387 / +13.1% 🔴 0.31 / 0.39 / -20.4%
clickbench_q12/duckdb:vortex-file-compressed 69772798 / 69524664 / +0.4% 115622061 / 99322208 / +16.4% 🔴 0.60 / 0.70 / -13.8%
clickbench_q13/duckdb:vortex-file-compressed 123091938 / 128573134 / -4.3% 174235785 / 166410931 / +4.7% 0.71 / 0.77 / -8.6%
clickbench_q14/duckdb:vortex-file-compressed 77250494 / 75132726 / +2.8% 127199502 / 103316255 / +23.1% 🔴 0.61 / 0.73 / -16.5%
clickbench_q15/duckdb:vortex-file-compressed 76622884 / 74775804 / +2.5% 130845358 / 113582884 / +15.2% 🔴 0.59 / 0.66 / -11.0%
clickbench_q16/duckdb:vortex-file-compressed 143325382 / 136058638 / +5.3% 198226872 / 182304914 / +8.7% 0.72 / 0.75 / -3.1%
clickbench_q17/duckdb:vortex-file-compressed 146372742 / 138746019 / +5.5% 199696699 / 175817827 / +13.6% 🔴 0.73 / 0.79 / -7.1%
clickbench_q18/duckdb:vortex-file-compressed 267282898 / 259934016 / +2.8% 340594101 / 317061720 / +7.4% 0.78 / 0.82 / -4.3%
clickbench_q19/duckdb:vortex-file-compressed 8880466 / 9455296 / -6.1% 58623241 / 42822210 / +36.9% 🔴 0.15 / 0.22 / -31.4%
clickbench_q20/duckdb:vortex-file-compressed 75362964 / 65948907 / +14.3% 🔴 221448472 / 170684239 / +29.7% 🔴 0.34 / 0.39 / -11.9%
clickbench_q21/duckdb:vortex-file-compressed 80526056 / 96249222 / -16.3% 🟢 268005213 / 270540517 / -0.9% 0.30 / 0.36 / -15.5%
clickbench_q22/duckdb:vortex-file-compressed 108092571 / 175468344 / -38.4% 🟢 357143253 / 431735231 / -17.3% 🟢 0.30 / 0.41 / -25.5%
clickbench_q23/duckdb:vortex-file-compressed 36986661 / 34123956 / +8.4% 97050858 / 83781047 / +15.8% 🔴 0.38 / 0.41 / -6.4%
clickbench_q24/duckdb:vortex-file-compressed 14552140 / 14529934 / +0.2% 58062429 / 35045073 / +65.7% 🔴 0.25 / 0.41 / -39.6%
clickbench_q25/duckdb:vortex-file-compressed 17959984 / 19138295 / -6.2% 66952737 / 50458933 / +32.7% 🔴 0.27 / 0.38 / -29.3%
clickbench_q26/duckdb:vortex-file-compressed 11978352 / 11701084 / +2.4% 50631784 / 33972449 / +49.0% 🔴 0.24 / 0.34 / -31.3%
clickbench_q27/duckdb:vortex-file-compressed 50178590 / 52918514 / -5.2% 227536208 / 223944910 / +1.6% 0.22 / 0.24 / -6.7%
clickbench_q28/duckdb:vortex-file-compressed 499135697 / 511324678 / -2.4% 573725290 / 578220624 / -0.8% 0.87 / 0.88 / -1.6%
clickbench_q29/duckdb:vortex-file-compressed 16664576 / 16485926 / +1.1% 61981890 / 44353045 / +39.7% 🔴 0.27 / 0.37 / -27.7%
clickbench_q30/duckdb:vortex-file-compressed 56740896 / 59518864 / -4.7% 118947395 / 109860987 / +8.3% 0.48 / 0.54 / -11.9%
clickbench_q31/duckdb:vortex-file-compressed 93583242 / 108852506 / -14.0% 🟢 189426681 / 199383456 / -5.0% 0.49 / 0.55 / -9.5%
clickbench_q32/duckdb:vortex-file-compressed 369376743 / 367098058 / +0.6% 422473115 / 397770638 / +6.2% 0.87 / 0.92 / -5.3%
clickbench_q33/duckdb:vortex-file-compressed 343931086 / 347338180 / -1.0% 431882145 / 444887359 / -2.9% 0.80 / 0.78 / +2.0%
clickbench_q34/duckdb:vortex-file-compressed 360589540 / 361073907 / -0.1% 445005695 / 457277060 / -2.7% 0.81 / 0.79 / +2.6%
clickbench_q35/duckdb:vortex-file-compressed 58361928 / 56497248 / +3.3% 104639326 / 89300321 / +17.2% 🔴 0.56 / 0.63 / -11.8%
clickbench_q36/duckdb:vortex-file-compressed 14936954 / 11090462 / +34.7% 🔴 39733081 / 31755864 / +25.1% 🔴 0.38 / 0.35 / +7.6%
clickbench_q37/duckdb:vortex-file-compressed 8814760 / 7917838 / +11.3% 🔴 29959505 / 26046233 / +15.0% 🔴 0.29 / 0.30 / -3.2%
clickbench_q38/duckdb:vortex-file-compressed 10648437 / 8531555 / +24.8% 🔴 31701172 / 30800045 / +2.9% 0.34 / 0.28 / +21.3%
clickbench_q39/duckdb:vortex-file-compressed 26303586 / 19364225 / +35.8% 🔴 49381391 / 38847970 / +27.1% 🔴 0.53 / 0.50 / +6.9%
clickbench_q40/duckdb:vortex-file-compressed 7257826 / 6818797 / +6.4% 28814977 / 26594371 / +8.3% 0.25 / 0.26 / -1.8%
clickbench_q41/duckdb:vortex-file-compressed 8785710 / 7708448 / +14.0% 🔴 29796768 / 27445780 / +8.6% 0.29 / 0.28 / +5.0%
clickbench_q42/duckdb:vortex-file-compressed 7716680 / 7027993 / +9.8% 29887366 / 26085858 / +14.6% 🔴 0.26 / 0.27 / -4.2%
duckdb / parquet / ns (0.991x ➖, 1↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
clickbench_q00/duckdb:parquet 10161966 / 11291558 / -10.0% 🟢 17888535 / 18744868 / -4.6% 0.57 / 0.60 / -5.7%
clickbench_q01/duckdb:parquet 16952294 / 16616062 / +2.0% 24206804 / 24672429 / -1.9% 0.70 / 0.67 / +4.0%
clickbench_q02/duckdb:parquet 23339520 / 23620260 / -1.2% 37588489 / 34501278 / +8.9% 0.62 / 0.68 / -9.3%
clickbench_q03/duckdb:parquet 24904565 / 25101525 / -0.8% 39020202 / 39838045 / -2.1% 0.64 / 0.63 / +1.3%
clickbench_q04/duckdb:parquet 62726302 / 64239186 / -2.4% 76501872 / 74843654 / +2.2% 0.82 / 0.86 / -4.5%
clickbench_q05/duckdb:parquet 84252426 / 86057160 / -2.1% 104548754 / 103336475 / +1.2% 0.81 / 0.83 / -3.2%
clickbench_q06/duckdb:parquet 22470418 / 22451180 / +0.1% 32855938 / 32342437 / +1.6% 0.68 / 0.69 / -1.5%
clickbench_q07/duckdb:parquet 19053990 / 18983947 / +0.4% 25813954 / 28049923 / -8.0% 0.74 / 0.68 / +9.1%
clickbench_q08/duckdb:parquet 76904154 / 76892890 / +0.0% 94520134 / 92651555 / +2.0% 0.81 / 0.83 / -2.0%
clickbench_q09/duckdb:parquet 104920476 / 103773444 / +1.1% 128139468 / 123717874 / +3.6% 0.82 / 0.84 / -2.4%
clickbench_q10/duckdb:parquet 42369542 / 43132280 / -1.8% 61004282 / 59222251 / +3.0% 0.69 / 0.73 / -4.6%
clickbench_q11/duckdb:parquet 47231826 / 48406035 / -2.4% 64561655 / 64553449 / +0.0% 0.73 / 0.75 / -2.4%
clickbench_q12/duckdb:parquet 93101446 / 94553694 / -1.5% 109366471 / 116649274 / -6.2% 0.85 / 0.81 / +5.0%
clickbench_q13/duckdb:parquet 152452446 / 157125350 / -3.0% 174757845 / 172735383 / +1.2% 0.87 / 0.91 / -4.1%
clickbench_q14/duckdb:parquet 102955172 / 105527730 / -2.4% 127652356 / 130645660 / -2.3% 0.81 / 0.81 / -0.2%
clickbench_q15/duckdb:parquet 88498520 / 89121767 / -0.7% 103856606 / 102948170 / +0.9% 0.85 / 0.87 / -1.6%
clickbench_q16/duckdb:parquet 173411458 / 177473652 / -2.3% 188447678 / 189107474 / -0.3% 0.92 / 0.94 / -1.9%
clickbench_q17/duckdb:parquet 175520330 / 178142842 / -1.5% 191512356 / 194337309 / -1.5% 0.92 / 0.92 / -0.0%
clickbench_q18/duckdb:parquet 312549187 / 305328727 / +2.4% 334724510 / 333432424 / +0.4% 0.93 / 0.92 / +2.0%
clickbench_q19/duckdb:parquet 21585411 / 22834962 / -5.5% 30234723 / 29977721 / +0.9% 0.71 / 0.76 / -6.3%
clickbench_q20/duckdb:parquet 181961916 / 189287996 / -3.9% 232236817 / 234420319 / -0.9% 0.78 / 0.81 / -3.0%
clickbench_q21/duckdb:parquet 222171222 / 224121476 / -0.9% 274117639 / 266498780 / +2.9% 0.81 / 0.84 / -3.6%
clickbench_q22/duckdb:parquet 312643130 / 319273407 / -2.1% 362074842 / 351680167 / +3.0% 0.86 / 0.91 / -4.9%
clickbench_q23/duckdb:parquet 174327374 / 175177536 / -0.5% 239228698 / 231373680 / +3.4% 0.73 / 0.76 / -3.8%
clickbench_q24/duckdb:parquet 32204644 / 33013876 / -2.5% 48237081 / 47089238 / +2.4% 0.67 / 0.70 / -4.8%
clickbench_q25/duckdb:parquet 43491513 / 45058207 / -3.5% 65307248 / 62321597 / +4.8% 0.67 / 0.72 / -7.9%
clickbench_q26/duckdb:parquet 32571374 / 32201552 / +1.1% 53655772 / 38911655 / +37.9% 🔴 0.61 / 0.83 / -26.6%
clickbench_q27/duckdb:parquet 189325618 / 188735747 / +0.3% 232096035 / 230347870 / +0.8% 0.82 / 0.82 / -0.4%
clickbench_q28/duckdb:parquet 982460078 / 984809750 / -0.2% 975373507 / 990967517 / -1.6% 1.01 / 0.99 / +1.4%
clickbench_q29/duckdb:parquet 27037960 / 25683474 / +5.3% 36920140 / 37195490 / -0.7% 0.73 / 0.69 / +6.1%
clickbench_q30/duckdb:parquet 108752608 / 107050366 / +1.6% 141390649 / 136338497 / +3.7% 0.77 / 0.79 / -2.0%
clickbench_q31/duckdb:parquet 148555020 / 160829946 / -7.6% 185215568 / 185311981 / -0.1% 0.80 / 0.87 / -7.6%
clickbench_q32/duckdb:parquet 404339577 / 393919709 / +2.6% 420026859 / 431479408 / -2.7% 0.96 / 0.91 / +5.4%
clickbench_q33/duckdb:parquet 491973708 / 477734250 / +3.0% 449421760 / 457855359 / -1.8% 1.09 / 1.04 / +4.9%
clickbench_q34/duckdb:parquet 476216884 / 484221756 / -1.7% 482277745 / 472442816 / +2.1% 0.99 / 1.02 / -3.7%
clickbench_q35/duckdb:parquet 63771310 / 63679261 / +0.1% 75913097 / 80571852 / -5.8% 0.84 / 0.79 / +6.3%
clickbench_q36/duckdb:parquet 32144492 / 31834046 / +1.0% 40653403 / 40056906 / +1.5% 0.79 / 0.79 / -0.5%
clickbench_q37/duckdb:parquet 24525298 / 25026544 / -2.0% 34329310 / 34026298 / +0.9% 0.71 / 0.74 / -2.9%
clickbench_q38/duckdb:parquet 25589564 / 25806470 / -0.8% 34655322 / 34620583 / +0.1% 0.74 / 0.75 / -0.9%
clickbench_q39/duckdb:parquet 53775258 / 54225480 / -0.8% 64268857 / 64355464 / -0.1% 0.84 / 0.84 / -0.7%
clickbench_q40/duckdb:parquet 15916050 / 15588969 / +2.1% 25159231 / 26053951 / -3.4% 0.63 / 0.60 / +5.7%
clickbench_q41/duckdb:parquet 16730578 / 16638638 / +0.6% 24354180 / 24395416 / -0.2% 0.69 / 0.68 / +0.7%
clickbench_q42/duckdb:parquet 16071192 / 15802064 / +1.7% 25033005 / 25616239 / -2.3% 0.64 / 0.62 / +4.1%

No file size changes detected.

@github-actions

github-actions Bot commented Oct 27, 2026 •

Copy link
Copy Markdown
Contributor

Benchmarks: TPC-H SF=1 on S3 📖

Commits: PR d704b47a vs base 1c2f6eb3
Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +5.5%
Engines: DataFusion No clear signal (-12.2%, environment too noisy confidence) · DuckDB No clear signal (+26.9%, environment too noisy confidence)
Vortex (geomean): hot 0.977x ➖ · cold 0.977x ➖
Parquet (geomean): hot 0.926x ➖ · cold 0.943x ➖
Shifts: Parquet (control) -7.4% · Median polish -1.8%

How to read Verdict and Engines
  • Verdict: Overall PR-level signal after subtracting baseline drift estimated from Parquet control rows. It can be Likely improvement, Likely regression, or No clear signal.
  • Engines: Per-engine attribution. DataFusion is compared against DataFusion/Parquet controls; DuckDB is compared against DuckDB/Parquet controls. This answers whether each engine improved or regressed independently.
  • Confidence: Based on directional consistency, share of rows above the noise floor, and control-run noise.
  • Hot vs cold: Every measurement is run several times. The first run is reported as the cold run, and the median of the runs after it is reported as the hot run. The verdict and significance use hot runs; each target's geomean reports hot and cold beside each other where the individual runs were recorded and hot alone where they were not, the cold column shows first-run cost per row, and hot/cold is how much of each run the warm path saves. Rows whose results predate per-run reporting show only one value, taken from the value the runner reported.
  • Table cells: Each cell reads PR / base / %diff. The hot and cold columns mark a change as 🔴 slower or 🟢 faster once it clears this suite's threshold; anything smaller is noise here and is left unmarked, as is hot/cold, because a shift in the warm-up ratio is not a win or a loss by itself.

datafusion / vortex-file-compressed / ns (0.907x ➖, 4↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:vortex-file-compressed 206330550 / 200082960 / +3.1% 1117471554 / 761341667 / +46.8% 🔴 0.18 / 0.26 / -29.7%
tpch_q02/datafusion:vortex-file-compressed 356069209 / 639595754 / -44.3% 🟢 723277206 / 1062197775 / -31.9% 🟢 0.49 / 0.60 / -18.2%
tpch_q03/datafusion:vortex-file-compressed 386069582 / 410576715 / -6.0% 1203119224 / 1313669828 / -8.4% 0.32 / 0.31 / +2.7%
tpch_q04/datafusion:vortex-file-compressed 266202427 / 231526919 / +15.0% 436243344 / 638279724 / -31.7% 🟢 0.61 / 0.36 / +68.2%
tpch_q05/datafusion:vortex-file-compressed 432100931 / 1207028139 / -64.2% 🟢 657462248 / 890579343 / -26.2% 0.66 / 1.36 / -51.5%
tpch_q06/datafusion:vortex-file-compressed 173660081 / 186456531 / -6.9% 332699884 / 302499471 / +10.0% 0.52 / 0.62 / -15.3%
tpch_q07/datafusion:vortex-file-compressed 449919201 / 920654461 / -51.1% 🟢 665883139 / 1084761139 / -38.6% 🟢 0.68 / 0.85 / -20.4%
tpch_q08/datafusion:vortex-file-compressed 475161377 / 456287377 / +4.1% 613147931 / 576499476 / +6.4% 0.77 / 0.79 / -2.1%
tpch_q09/datafusion:vortex-file-compressed 466914216 / 463630458 / +0.7% 540515638 / 618453240 / -12.6% 0.86 / 0.75 / +15.2%
tpch_q10/datafusion:vortex-file-compressed 364343688 / 669622120 / -45.6% 🟢 542559104 / 1144085714 / -52.6% 🟢 0.67 / 0.59 / +14.7%
tpch_q11/datafusion:vortex-file-compressed 335549787 / 285003237 / +17.7% 513325178 / 411238318 / +24.8% 0.65 / 0.69 / -5.7%
tpch_q12/datafusion:vortex-file-compressed 260642201 / 274961342 / -5.2% 627015091 / 343509467 / +82.5% 🔴 0.42 / 0.80 / -48.1%
tpch_q13/datafusion:vortex-file-compressed 143748760 / 137432413 / +4.6% 325615930 / 346698692 / -6.1% 0.44 / 0.40 / +11.4%
tpch_q14/datafusion:vortex-file-compressed 206833867 / 208824416 / -1.0% 368460276 / 390198804 / -5.6% 0.56 / 0.54 / +4.9%
tpch_q15/datafusion:vortex-file-compressed 316793177 / 317914271 / -0.4% 577064674 / 606144341 / -4.8% 0.55 / 0.52 / +4.7%
tpch_q16/datafusion:vortex-file-compressed 134557491 / 152376486 / -11.7% 305162509 / 248799164 / +22.7% 0.44 / 0.61 / -28.0%
tpch_q17/datafusion:vortex-file-compressed 560762084 / 287875914 / +94.8% 🔴 597754742 / 428334515 / +39.6% 🔴 0.94 / 0.67 / +39.6%
tpch_q18/datafusion:vortex-file-compressed 661496548 / 437080154 / +51.3% 🔴 659848567 / 688452914 / -4.2% 1.00 / 0.63 / +57.9%
tpch_q19/datafusion:vortex-file-compressed 256836610 / 256013517 / +0.3% 405848319 / 422159914 / -3.9% 0.63 / 0.61 / +4.4%
tpch_q20/datafusion:vortex-file-compressed 287343978 / 289152277 / -0.6% 420580489 / 429541903 / -2.1% 0.68 / 0.67 / +1.5%
tpch_q21/datafusion:vortex-file-compressed 489407716 / 562257639 / -13.0% 741821447 / 1121342542 / -33.8% 🟢 0.66 / 0.50 / +31.6%
tpch_q22/datafusion:vortex-file-compressed 161180882 / 207677975 / -22.4% 385405313 / 417462321 / -7.7% 0.42 / 0.50 / -15.9%
datafusion / parquet / ns (1.033x ➖, 1↑ 2↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/datafusion:parquet 170102529 / 145293434 / +17.1% 528713444 / 452498221 / +16.8% 0.32 / 0.32 / +0.2%
tpch_q02/datafusion:parquet 298059063 / 286589912 / +4.0% 592932185 / 481373758 / +23.2% 0.50 / 0.60 / -15.6%
tpch_q03/datafusion:parquet 254101382 / 264303409 / -3.9% 702368692 / 977823278 / -28.2% 0.36 / 0.27 / +33.8%
tpch_q04/datafusion:parquet 143284868 / 154468960 / -7.2% 317705606 / 356293821 / -10.8% 0.45 / 0.43 / +4.0%
tpch_q05/datafusion:parquet 349416687 / 388529689 / -10.1% 514130187 / 594762008 / -13.6% 0.68 / 0.65 / +4.0%
tpch_q06/datafusion:parquet 151024906 / 137757742 / +9.6% 289471432 / 279214667 / +3.7% 0.52 / 0.49 / +5.7%
tpch_q07/datafusion:parquet 349128249 / 352348151 / -0.9% 468803874 / 539449645 / -13.1% 0.74 / 0.65 / +14.0%
tpch_q08/datafusion:parquet 421387793 / 485448167 / -13.2% 544618805 / 545394407 / -0.1% 0.77 / 0.89 / -13.1%
tpch_q09/datafusion:parquet 445072718 / 411269065 / +8.2% 630972226 / 683592995 / -7.7% 0.71 / 0.60 / +17.2%
tpch_q10/datafusion:parquet 333337519 / 349886480 / -4.7% 521641990 / 490476338 / +6.4% 0.64 / 0.71 / -10.4%
tpch_q11/datafusion:parquet 300861641 / 271563188 / +10.8% 403808040 / 412328197 / -2.1% 0.75 / 0.66 / +13.1%
tpch_q12/datafusion:parquet 166093496 / 177991517 / -6.7% 310992928 / 381455633 / -18.5% 0.53 / 0.47 / +14.5%
tpch_q13/datafusion:parquet 276568300 / 295469006 / -6.4% 411714337 / 428891818 / -4.0% 0.67 / 0.69 / -2.5%
tpch_q14/datafusion:parquet 246089809 / 181615976 / +35.5% 🔴 388685112 / 297783575 / +30.5% 🔴 0.63 / 0.61 / +3.8%
tpch_q15/datafusion:parquet 335509660 / 494496329 / -32.2% 🟢 487753586 / 594287944 / -17.9% 0.69 / 0.83 / -17.3%
tpch_q16/datafusion:parquet 102227731 / 98697991 / +3.6% 205816596 / 227831943 / -9.7% 0.50 / 0.43 / +14.7%
tpch_q17/datafusion:parquet 264492862 / 347860112 / -24.0% 431391589 / 495409078 / -12.9% 0.61 / 0.70 / -12.7%
tpch_q18/datafusion:parquet 332788253 / 317150596 / +4.9% 508499477 / 461643136 / +10.1% 0.65 / 0.69 / -4.7%
tpch_q19/datafusion:parquet 210724418 / 170925656 / +23.3% 527933004 / 354220137 / +49.0% 🔴 0.40 / 0.48 / -17.3%
tpch_q20/datafusion:parquet 563648829 / 234279213 / +140.6% 🔴 967554282 / 577652513 / +67.5% 🔴 0.58 / 0.41 / +43.6%
tpch_q21/datafusion:parquet 335446234 / 347787429 / -3.5% 464110728 / 495573132 / -6.3% 0.72 / 0.70 / +3.0%
tpch_q22/datafusion:parquet 155528001 / 150763535 / +3.2% 319035039 / 302238237 / +5.6% 0.49 / 0.50 / -2.3%
duckdb / vortex-file-compressed / ns (1.053x ➖, 0↑ 3↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:vortex-file-compressed 254861333 / 248010407 / +2.8% 234524840 / 270166155 / -13.2% 1.09 / 0.92 / +18.4%
tpch_q02/duckdb:vortex-file-compressed 443130524 / 471382265 / -6.0% 583005807 / 581559368 / +0.2% 0.76 / 0.81 / -6.2%
tpch_q03/duckdb:vortex-file-compressed 414239495 / 407105643 / +1.8% 508741469 / 541662246 / -6.1% 0.81 / 0.75 / +8.3%
tpch_q04/duckdb:vortex-file-compressed 292843202 / 322850661 / -9.3% 291279593 / 400778585 / -27.3% 1.01 / 0.81 / +24.8%
tpch_q05/duckdb:vortex-file-compressed 635799870 / 562945140 / +12.9% 782767322 / 692420636 / +13.0% 0.81 / 0.81 / -0.1%
tpch_q06/duckdb:vortex-file-compressed 167276409 / 162813434 / +2.7% 393268107 / 204662450 / +92.2% 🔴 0.43 / 0.80 / -46.5%
tpch_q07/duckdb:vortex-file-compressed 752712860 / 433631464 / +73.6% 🔴 663849372 / 501269922 / +32.4% 🔴 1.13 / 0.87 / +31.1%
tpch_q08/duckdb:vortex-file-compressed 732140643 / 813383725 / -10.0% 639993595 / 801554897 / -20.2% 1.14 / 1.01 / +12.7%
tpch_q09/duckdb:vortex-file-compressed 536686002 / 520301372 / +3.1% 458558908 / 530579875 / -13.6% 1.17 / 0.98 / +19.3%
tpch_q10/duckdb:vortex-file-compressed 531856753 / 573629126 / -7.3% 706420367 / 538030826 / +31.3% 🔴 0.75 / 1.07 / -29.4%
tpch_q11/duckdb:vortex-file-compressed 291319331 / 300416633 / -3.0% 329608589 / 557181552 / -40.8% 🟢 0.88 / 0.54 / +63.9%
tpch_q12/duckdb:vortex-file-compressed 244215160 / 259452321 / -5.9% 283085502 / 297274796 / -4.8% 0.86 / 0.87 / -1.2%
tpch_q13/duckdb:vortex-file-compressed 269524488 / 293128085 / -8.1% 308053388 / 275584112 / +11.8% 0.87 / 1.06 / -17.7%
tpch_q14/duckdb:vortex-file-compressed 213652583 / 249160427 / -14.3% 264613805 / 306223214 / -13.6% 0.81 / 0.81 / -0.8%
tpch_q15/duckdb:vortex-file-compressed 248163200 / 251521587 / -1.3% 301276376 / 347644370 / -13.3% 0.82 / 0.72 / +13.8%
tpch_q16/duckdb:vortex-file-compressed 210215552 / 210167738 / +0.0% 300942896 / 274107058 / +9.8% 0.70 / 0.77 / -8.9%
tpch_q17/duckdb:vortex-file-compressed 676059764 / 399336176 / +69.3% 🔴 651487902 / 350208654 / +86.0% 🔴 1.04 / 1.14 / -9.0%
tpch_q18/duckdb:vortex-file-compressed 654657211 / 469046443 / +39.6% 🔴 416963826 / 416598626 / +0.1% 1.57 / 1.13 / +39.4%
tpch_q19/duckdb:vortex-file-compressed 347305429 / 374045554 / -7.1% 328725400 / 388558898 / -15.4% 1.06 / 0.96 / +9.8%
tpch_q20/duckdb:vortex-file-compressed 374083245 / 428424720 / -12.7% 508866099 / 490874198 / +3.7% 0.74 / 0.87 / -15.8%
tpch_q21/duckdb:vortex-file-compressed 744852961 / 625185525 / +19.1% 781753286 / 704154529 / +11.0% 0.95 / 0.89 / +7.3%
tpch_q22/duckdb:vortex-file-compressed 287335509 / 231856311 / +23.9% 284639949 / 290103159 / -1.9% 1.01 / 0.80 / +26.3%
duckdb / parquet / ns (0.830x ➖, 5↑ 0↓)
name hot ns (PR / base / %diff) cold ns (PR / base / %diff) hot/cold (PR / base / %diff)
tpch_q01/duckdb:parquet 163109510 / 391603934 / -58.3% 🟢 211837256 / 484775478 / -56.3% 🟢 0.77 / 0.81 / -4.7%
tpch_q02/duckdb:parquet 428444385 / 499530579 / -14.2% 437238795 / 608640620 / -28.2% 0.98 / 0.82 / +19.4%
tpch_q03/duckdb:parquet 397582420 / 376543161 / +5.6% 436718025 / 633211972 / -31.0% 🟢 0.91 / 0.59 / +53.1%
tpch_q04/duckdb:parquet 240408957 / 370378185 / -35.1% 🟢 309169663 / 346941685 / -10.9% 0.78 / 1.07 / -27.2%
tpch_q05/duckdb:parquet 615484898 / 580589271 / +6.0% 653673715 / 648781867 / +0.8% 0.94 / 0.89 / +5.2%
tpch_q06/duckdb:parquet 178960353 / 232713319 / -23.1% 189899006 / 221864905 / -14.4% 0.94 / 1.05 / -10.2%
tpch_q07/duckdb:parquet 481785093 / 469695930 / +2.6% 574677707 / 444681905 / +29.2% 0.84 / 1.06 / -20.6%
tpch_q08/duckdb:parquet 760600802 / 944957209 / -19.5% 811898767 / 774625630 / +4.8% 0.94 / 1.22 / -23.2%
tpch_q09/duckdb:parquet 551803434 / 573795807 / -3.8% 677712329 / 666494510 / +1.7% 0.81 / 0.86 / -5.4%
tpch_q10/duckdb:parquet 530850349 / 789454357 / -32.8% 🟢 654976010 / 733082053 / -10.7% 0.81 / 1.08 / -24.7%
tpch_q11/duckdb:parquet 263575133 / 319492335 / -17.5% 322114040 / 285764956 / +12.7% 0.82 / 1.12 / -26.8%
tpch_q12/duckdb:parquet 237575542 / 305165707 / -22.1% 318862204 / 365670746 / -12.8% 0.75 / 0.83 / -10.7%
tpch_q13/duckdb:parquet 418187070 / 386637718 / +8.2% 498980372 / 469736331 / +6.2% 0.84 / 0.82 / +1.8%
tpch_q14/duckdb:parquet 259356463 / 325970878 / -20.4% 304240731 / 397540822 / -23.5% 0.85 / 0.82 / +4.0%
tpch_q15/duckdb:parquet 223112272 / 250299776 / -10.9% 327622299 / 230940930 / +41.9% 🔴 0.68 / 1.08 / -37.2%
tpch_q16/duckdb:parquet 326018212 / 300198366 / +8.6% 302899898 / 290575454 / +4.2% 1.08 / 1.03 / +4.2%
tpch_q17/duckdb:parquet 277094986 / 357833054 / -22.6% 328684217 / 368216299 / -10.7% 0.84 / 0.97 / -13.2%
tpch_q18/duckdb:parquet 344931990 / 518856896 / -33.5% 🟢 505747039 / 474513405 / +6.6% 0.68 / 1.09 / -37.6%
tpch_q19/duckdb:parquet 289074678 / 418749552 / -31.0% 🟢 299874231 / 583861016 / -48.6% 🟢 0.96 / 0.72 / +34.4%
tpch_q20/duckdb:parquet 425118903 / 447545512 / -5.0% 446205019 / 555095756 / -19.6% 0.95 / 0.81 / +18.2%
tpch_q21/duckdb:parquet 565785249 / 632619828 / -10.6% 618439135 / 689032313 / -10.2% 0.91 / 0.92 / -0.4%
tpch_q22/duckdb:parquet 308601480 / 323820213 / -4.7% 351770443 / 489321333 / -28.1% 0.88 / 0.66 / +32.6%

@joseph-isaacs joseph-isaacs changed the title DuckDB V2 scan: cut chunks on file boundaries, default it for TPC-DS and ClickBench V2 scans: bound shared reads with row claims and queue DuckDB file chunks Oct 28, 2026
@joseph-isaacs joseph-isaacs added the changelog/break A breaking API change label Oct 28, 2026 — with ChatGPT Codex Connector
@joseph-isaacs joseph-isaacs removed the changelog/chore A trivial change label Oct 28, 2026
@joseph-isaacs
joseph-isaacs marked this pull request as ready for review October 28, 2026 15:58
@joseph-isaacs joseph-isaacs removed the changelog/break A breaking API change label Oct 28, 2026
@joseph-isaacs joseph-isaacs added the changelog/performance A performance improvement label Oct 28, 2026 — with ChatGPT Codex Connector
@joseph-isaacs joseph-isaacs changed the title V2 scans: bound shared reads with row claims and queue DuckDB file chunks V2 scans: bound shared reads with row claims and use static DuckDB chunks Oct 28, 2026
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 28, 2026
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 28, 2026
@myrrc

myrrc commented Oct 29, 2026

Copy link
Copy Markdown
Contributor

We'd need to tackle ClickBench regression before merging

@joseph-isaacs joseph-isaacs changed the title V2 scans: bound shared reads with row claims and use static DuckDB chunks Bound V2 shared reads and partition DuckDB scan work Oct 29, 2026
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 29, 2026 — with ChatGPT Codex Connector
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 29, 2026
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 29, 2026 — with ChatGPT Codex Connector
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 29, 2026
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 30, 2026 — with ChatGPT Codex Connector
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 30, 2026
…unks

Fall back to the driver's normal partitioning when a lazy chunk's metadata
cannot be initialized. Selection and pruning may avoid executing that chunk.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 30, 2026 — with ChatGPT Codex Connector
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 30, 2026
Only coalesce tiny dictionary regions below 8192 rows, allowing workers to
balance dictionary expressions without cutting their cached value domains.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 30, 2026 — with ChatGPT Codex Connector
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 30, 2026
Run the PR and its develop base on the same ClickBench runner, with warmed ABBA timings, scan metrics, and native CPU profiles.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 30, 2026 — with ChatGPT Codex Connector
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 30, 2026
Avoid mixing current develop workflow actions with an older PR checkout during the controlled comparison.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 30, 2026 — with ChatGPT Codex Connector
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 30, 2026
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 30, 2026 — with ChatGPT Codex Connector
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 30, 2026
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 30, 2026 — with ChatGPT Codex Connector
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 30, 2026
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 30, 2026 — with ChatGPT Codex Connector
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 30, 2026
The shared chunk planner had stopped emitting independent work, moving DataFusion scans onto the root task's step-by-step execution. Allow DataFusion to opt into independent chunks while DuckDB keeps its own work queue policy. Cover the independent planner's bounded selection scope.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
@joseph-isaacs joseph-isaacs added the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 30, 2026 — with ChatGPT Codex Connector
@github-actions github-actions Bot removed the action/bench-sql Run SQL benchmarks without Vortex Compact on this PR label Oct 30, 2026
The active benchmark run retains its pinned diagnostic workflow. Keep the PR change limited to DataFusion chunk scheduling and its regression coverage.

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants