Skip to content

Unwrap top level slice and filter in duckdbexport and build bitpacked export - #10624

Open
robert3005 wants to merge 5 commits into
developfrom
rk/duckdb-exporter
Open

robert3005 wants to merge 5 commits into
developfrom
rk/duckdb-exporter

Conversation

@robert3005

Copy link
Copy Markdown
Contributor
  • Run slice kernels when a flat reader slices a chunk
  • Export filtered run-end columns without decoding them
  • Expect sliced run-length columns to export as dictionaries
  • Unpack bit-packed columns per exported vector in DuckDB scans
  • Export run-end arrays of short runs as flat vectors

Loading
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/performance A performance improvement ext/duckdb Relates to the DuckDB integration

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants