Skip to content
Navigation Menu
Sign in
Appearance settings
Platform
AI CODE CREATION
GitHub Copilot
Write better code with AI
GitHub Copilot app
Direct agents from issue to merge
MCP Registry
Integrate external tools
DEVELOPER WORKFLOWS
Actions
Automate any workflow
Codespaces
Instant dev environments
Issues
Plan and track work
Code Review
Manage code changes
Code Quality
Enforce quality at merge
APPLICATION SECURITY
GitHub Advanced Security
Find and fix vulnerabilities
Code security
Secure your code as you build
Secret protection
Stop leaks before they start
EXPLORE
Why GitHub
Documentation
Blog
Changelog
Marketplace
View all features
Solutions
BY COMPANY SIZE
Enterprises
Small and medium teams
Startups
Nonprofits
BY USE CASE
App Modernization
DevSecOps
DevOps
CI/CD
View all use cases
BY INDUSTRY
Healthcare
Financial services
Manufacturing
Government
View all industries
View all solutions
Resources
EXPLORE BY TOPIC
AI
Software Development
DevOps
Security
View all topics
EXPLORE BY TYPE
Customer stories
Events & webinars
Ebooks & reports
Business insights
GitHub Skills
SUPPORT & SERVICES
Documentation
Customer support
Community forum
Trust center
Partners
View all resources
Open Source
COMMUNITY
GitHub Sponsors
Fund open source developers
PROGRAMS
Security Lab
Maintainer Community
GitHub Stars
Archive Program
REPOSITORIES
Topics
Trending
Collections
Enterprise
ENTERPRISE SOLUTIONS
Enterprise platform
AI-powered developer platform
AVAILABLE ADD-ONS
GitHub Advanced Security
Enterprise-grade security features
Copilot for Business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Pricing
Search
/
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
apache
/
datafusion
Public
Notifications
You must be signed in to change notification settings
Fork
2.4k
Star
9.3k
Code
Issues
1.9k
Pull requests
390
Discussions
Actions
Security and quality
0
Insights
Additional navigation options
Code
Issues
Pull requests
Discussions
Actions
Security and quality
Insights
Fix GroupValues retained memory accounting
- #25188
#25188
Open
kosiew
wants to merge 21 commits into
apache:main
apache/datafusion:main
from
kosiew:memcalc-11-23393
kosiew/datafusion:memcalc-11-23393
Copy head branch name to clipboard
Conversation
Commits
21
(21)
Checks
Files changed
Open
Fix GroupValues retained memory accounting
#25188
kosiew
wants to merge 21 commits into
apache:main
apache/datafusion:main
from
kosiew:memcalc-11-23393
kosiew/datafusion:memcalc-11-23393
Copy head branch name to clipboard
Commits
Commits on Sep 11, 2026
fix GroupValues*::size()
Show description for 5b8d63e
kosiew
committed
5b8d63e
View commit details
Copy full SHA for 5b8d63e
Browse repository at this point
fix: subtract inline RowConverter/Rows descriptors from nested .size() calls
Show description for b453da8
kosiew
committed
b453da8
View commit details
Copy full SHA for b453da8
Browse repository at this point
test: add independent scratch-capacity/reuse test for multi_group_by
Show description for 0eca435
kosiew
committed
0eca435
View commit details
Copy full SHA for 0eca435
Browse repository at this point
feat(groupcolumn): charge missing GroupColumn owner descriptors, dedupe row‑backed inline nested descriptors, add primitive row‑backed multi‑column tests, and enable 1,024 spill limit
Show description for ac44e83
kosiew
committed
ac44e83
View commit details
Copy full SHA for ac44e83
Browse repository at this point
feat: add row.rs emit/reuse accounting tests
Show description for 4d8f7de
kosiew
committed
4d8f7de
View commit details
Copy full SHA for 4d8f7de
Browse repository at this point
refactor: move comment to correct emit test
Show description for b3d2b21
kosiew
committed
b3d2b21
View commit details
Copy full SHA for b3d2b21
Browse repository at this point
feat: improve SLT peak measurement and spill test assertions
Show description for 617b0ed
kosiew
committed
617b0ed
View commit details
Copy full SHA for 617b0ed
Browse repository at this point
Commits on Sep 12, 2026
fix: Disable partial‑agg skip only under memory limits and shrink DISTINCT pool
Show description for a57639a
kosiew
committed
a57639a
View commit details
Copy full SHA for a57639a
Browse repository at this point
fix: increase DISTINCT spill test budget to stabilize flaky nested_nullability spill test
Show description for 3388a4d
kosiew
committed
3388a4d
View commit details
Copy full SHA for 3388a4d
Browse repository at this point
fix: stabilize DISTINCT spill case in nested_nullability.rs
Show description for 069dd3f
kosiew
committed
069dd3f
View commit details
Copy full SHA for 069dd3f
Browse repository at this point
fix(memory): release accumulator capacity before reservation reconciliation during spill recovery
Show description for ec95c89
kosiew
committed
ec95c89
View commit details
Copy full SHA for ec95c89
Browse repository at this point
refactor(nested_nullability): wrap FairSpillPool in TrackConsumersPool
Show description for 66d3441
kosiew
committed
66d3441
View commit details
Copy full SHA for 66d3441
Browse repository at this point
fix: disable single_distinct_aggregation_to_group_by for DISTINCT spill regression and adjust spill behavior
Show description for 8a2095b
kosiew
committed
8a2095b
View commit details
Copy full SHA for 8a2095b
Browse repository at this point
fix(partial_oom_drain): emit partial OOM drain states via EmitTo::First and rebuild empty partial table
Show description for fe8f8ed
kosiew
committed
fe8f8ed
View commit details
Copy full SHA for fe8f8ed
Browse repository at this point
fix(datafusion/core/tests/memory_limit/mod.rs): correct expected error messages to match FinalHashAggregateStream
kosiew
committed
dde38d4
View commit details
Copy full SHA for dde38d4
Browse repository at this point
Commits on Sep 13, 2026
feat(test): add memory limit and target partitions for case G in aggregate memory spill test
kosiew
committed
43f4724
View commit details
Copy full SHA for 43f4724
Browse repository at this point
fix: safely reset capacities in GroupValuesColumn::clear_shrink and add regression test
Show description for 95d7ce6
kosiew
committed
95d7ce6
View commit details
Copy full SHA for 95d7ce6
Browse repository at this point
fix: refine cached_values to `Option<Weak<dyn Array>>` and adjust cache ownership
Show description for fe3d616
kosiew
committed
fe3d616
View commit details
Copy full SHA for fe3d616
Browse repository at this point
perf(datafusion/physical-plan/src/aggregates/group_values/multi_group_by): shrink_to remaining_row_indices instead of clear
Show description for cf77086
kosiew
committed
cf77086
View commit details
Copy full SHA for cf77086
Browse repository at this point
Commits on Sep 16, 2026
Merge branch 'main' into memcalc-11-23393
kosiew
committed
3bfe7f6
View commit details
Copy full SHA for 3bfe7f6
Browse repository at this point
Commits on Sep 19, 2026
Merge branch 'main' into memcalc-11-23393
kosiew
committed
88acc2b
View commit details
Copy full SHA for 88acc2b
Browse repository at this point
You can’t perform that action at this time.