Skip to content

Distributed multi-shard query#3759

Merged
jotare merged 7 commits into
multi-shard-searchfrom
multi-shard-search-2
Jul 1, 2026
Merged

Distributed multi-shard query#3759
jotare merged 7 commits into
multi-shard-searchfrom
multi-shard-search-2

Conversation

@jotare

@jotare jotare commented Jun 24, 2026

Copy link
Copy Markdown
Contributor

Description

The next step towards moving multi-shard querying to Rust. This PR implements forwarding of search requests with grouped shards between nidx-searcher nodes

How was this PR tested?

New integration tests

@jotare jotare requested review from a team as code owners June 24, 2026 12:45
@jotare jotare marked this pull request as draft June 24, 2026 12:45
@jotare jotare force-pushed the multi-shard-search-2 branch from 0cfc8d9 to a9907c0 Compare July 1, 2026 09:48
Comment thread nidx/src/searcher/grpc.rs
}

let mut tasks = JoinSet::new();
for (node, shard_ids) in shard_groups {

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm getting lost reading this function since it's quite long and nested. Maybe the contents of this loop can be extracted?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm not sure extracting the whole loop would make it more readable. I'll see what I can do

@jotare jotare merged commit c117d01 into multi-shard-search Jul 1, 2026
1 check passed
@jotare jotare deleted the multi-shard-search-2 branch July 1, 2026 13:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants