Skip to content

storage: delete_prefix, more retries, reduce concurrency#3369

Merged
GuillaumeGomez merged 2 commits into
rust-lang:mainfrom
syphar:rate-limit
Jun 13, 2026
Merged

storage: delete_prefix, more retries, reduce concurrency#3369
GuillaumeGomez merged 2 commits into
rust-lang:mainfrom
syphar:rate-limit

Conversation

@syphar

@syphar syphar commented Jun 13, 2026

Copy link
Copy Markdown
Member

it seems like I'm hitting S3 with too many requests, even when I reduce the network concurrency.

So here I'm

  • doing more retries, in the main delete_objects request
  • remove concurrent delete calls.

( error message I'm seeing is "SlowDown: Please reduce your request rate")

@syphar syphar requested a review from a team as a code owner June 13, 2026 03:59
@github-actions github-actions Bot added the S-waiting-on-review Status: This pull request has been implemented and needs to be reviewed label Jun 13, 2026
@syphar syphar self-assigned this Jun 13, 2026
@GuillaumeGomez

Copy link
Copy Markdown
Member

Thanks!

@GuillaumeGomez GuillaumeGomez merged commit 886bc7a into rust-lang:main Jun 13, 2026
12 checks passed
@GuillaumeGomez GuillaumeGomez deleted the rate-limit branch June 13, 2026 10:52
@github-actions github-actions Bot added S-waiting-on-deploy This PR is ready to be merged, but is waiting for an admin to have time to deploy it and removed S-waiting-on-review Status: This pull request has been implemented and needs to be reviewed labels Jun 13, 2026
@syphar syphar removed the S-waiting-on-deploy This PR is ready to be merged, but is waiting for an admin to have time to deploy it label Jun 14, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants