Repository navigation
Address recurring CodSpeed warnings - #10839
7 benchmarks regressed
3 warnings
⚠️ Walltime results may be unreliableSome benchmarks used the Walltime instrument outside CodSpeed Macro Runners, which can make the results inconsistent.
⚠️ 1 benchmark is dominated by system callsSystem calls cannot be simulated consistently and are left out of the measure. The reported value understates the real cost. Switch to the Walltime instrument to measure them.
⚠️ Base and head ran on different runner typesSome benchmarks with significant performance changes were compared across different runner types, so the changes might not come from the code. Run base and head on the same runner type, or use CodSpeed Macro Runners for more stable results.
⚡ 14 improved benchmarks
❌ 7 regressed benchmarks
✅ 2408 untouched benchmarks
⏩ 126 skipped benchmarks1
🗄️ 43 archived benchmarks run2
Warning
Please fix the performance issues or acknowledge them on CodSpeed.
Performance Changes
| Mode | Benchmark | BASE |
HEAD |
Efficiency | |
|---|---|---|---|---|---|
| ❌ | Walltime | threshold_neon[8] |
1.4 µs | 2.6 µs | -45.99% |
| ❌ | Walltime | filter_neon[8] |
922 ns | 1,516 ns | -39.18% |
| ❌ | Walltime | threshold_neon[64] |
2.6 µs | 4.2 µs | -37.52% |
| ❌ | Walltime | filter_neon[64] |
1.8 µs | 2.7 µs | -34.65% |
| ❌ | CPU Simulation | chunked_dict_primitive_canonical_into[f64, (1000, 1000, 10)] |
141 µs | 203.9 µs | -30.82% |
| ❌ | Walltime | threshold_neon[80] |
3.5 µs | 4.7 µs | -26.06% |
| ❌ | Walltime | filter_neon[80] |
2.5 µs | 3.3 µs | -23.69% |
| ⚡ | CPU Simulation | filter_run_end[len=4096_run=16_density=0.1] |
153.9 µs | 53.4 µs | ×2.9 |
| ⚡ | CPU Simulation | density_sweep_random[0.001] |
46.9 µs | 19.3 µs | ×2.4 |
| ⚡ | CPU Simulation | filter_powerlaw_by_correlated_runs[10000] |
29.4 µs | 13.9 µs | ×2.1 |
| ⚡ | CPU Simulation | test_repeated_scan_scalar_at[int_float] |
365.1 µs | 307.8 µs | +18.65% |
| ⚡ | CPU Simulation | test_repeated_scan_scalar_at[int_str] |
396.6 µs | 335.2 µs | +18.34% |
| ⚡ | CPU Simulation | test_repeated_scan_scalar_at[int_str_float] |
477.8 µs | 410 µs | +16.52% |
| ⚡ | CPU Simulation | filter_powerlaw_by_power_law[250000] |
182.9 µs | 158.1 µs | +15.67% |
| ⚡ | Walltime | mul_u16_nonnull_avx512 |
12.5 µs | 10.9 µs | +15.42% |
| ⚡ | Walltime | filter_avx2[80] |
2 µs | 1.7 µs | +14.38% |
| ⚡ | CPU Simulation | like_per_row_patterns |
191.5 µs | 168.1 µs | +13.94% |
| ⚡ | Walltime | subtract_shapes_avx512[(32768, PerRowPerRow)] |
13.1 µs | 11.6 µs | +13.03% |
| ⚡ | CPU Simulation | test_repeated_scan_filter[int] |
2.7 ms | 2.4 ms | +12.29% |
| ⚡ | CPU Simulation | test_repeated_scan_scalar_at[int] |
235.4 µs | 211.4 µs | +11.32% |
| ... | ... | ... | ... | ... | ... |
ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.
Tip
Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.
Comparing ct/trusting-goodall-2kfoac (83d7d47) with develop (fb4a037)
Footnotes
-
126 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩
-
43 benchmarks were run, but are now archived. If they were deleted in another branch, consider rebasing to remove them from the report. Instead if they were added back, click here to restore them. ↩