Is your feature request related to a problem or challenge?
There is no way to set the target batch size for RepartitionExec's output coalescer on a per-node basis. The coalescer always reads SessionConfig::batch_size, so callers who want a different batch size for a specific repartition step must change the global session config, which affects all operators. A with_batch_size builder method would allow per-node override without touching the session.
Describe the solution you'd like
have a field on RepartitionExec's that allows the coalescer to be fine tuned
Describe alternatives you've considered
No response
Additional context
No response
Is your feature request related to a problem or challenge?
There is no way to set the target batch size for RepartitionExec's output coalescer on a per-node basis. The coalescer always reads SessionConfig::batch_size, so callers who want a different batch size for a specific repartition step must change the global session config, which affects all operators. A with_batch_size builder method would allow per-node override without touching the session.
Describe the solution you'd like
have a field on
RepartitionExec'sthat allows the coalescer to be fine tunedDescribe alternatives you've considered
No response
Additional context
No response