Skip to content

Stabilize CodSpeed microbenchmarks - #11110

Merged
connortsui20 merged 8 commits into
developfrom
ct/codspeed-repeatability
Nov 2, 2026
Merged

Stabilize CodSpeed microbenchmarks#11110
connortsui20 merged 8 commits into
developfrom
ct/codspeed-repeatability

Keep unstable x86 chunked take measurements local

7da7699
Select commit
Loading
Failed to load commit list.
CodSpeed / CodSpeed Performance Analysis succeeded Nov 2, 2026 in 0s

Performance Gate Passed

1 warning

⚠️ Walltime results may be unreliable

Some benchmarks used the Walltime instrument outside CodSpeed Macro Runners, which can make the results inconsistent.

Learn more about Macro Runners

See affected benchmarks

⚡ 9 improved benchmarks
✅ 2271 untouched benchmarks
🆕 27 new benchmarks
⏩ 38 skipped benchmarks1
🗄️ 47 archived benchmarks run2

Performance Changes

Mode Benchmark BASE HEAD Efficiency
⚡ Walltime filter_avx512[80] 1.7 µs 1.3 µs +29.86%
⚡ Walltime threshold_avx2[80] 2.9 µs 2.3 µs +24.61%
⚡ Walltime filter_avx512[64] 1.7 µs 1.4 µs +23.64%
⚡ Walltime filter_avx2[64] 1.7 µs 1.4 µs +23.43%
⚡ Walltime threshold_avx512[80] 2.7 µs 2.2 µs +20.96%
⚡ Walltime filter_avx2[80] 1.8 µs 1.5 µs +19.31%
⚡ Walltime threshold_avx512[64] 2.5 µs 2.2 µs +18.09%
⚡ Walltime threshold_avx2[64] 2.5 µs 2.2 µs +13.17%
⚡ Walltime starts_with_avx512[8, VarBinView] 76.2 µs 68.3 µs +11.59%
🆕 Walltime take_neon[core/shuffled/primitive/nonnull/chunks=16/indices=1000] N/A 30 µs N/A
🆕 Walltime take_neon[core/shuffled/primitive/nonnull/chunks=16/indices=250] N/A 18.1 µs N/A
🆕 Walltime take_neon[core/shuffled/primitive/nonnull/chunks=4/indices=1000] N/A 17.2 µs N/A
🆕 Walltime take_neon[core/shuffled/primitive/nonnull/chunks=4/indices=250] N/A 8.4 µs N/A
🆕 Walltime take_neon[core/sorted/primitive/nonnull/chunks=16/indices=1000] N/A 20.5 µs N/A
🆕 Walltime take_neon[core/sorted/primitive/nonnull/chunks=16/indices=250] N/A 17.4 µs N/A
🆕 Walltime take_neon[core/sorted/primitive/nonnull/chunks=4/indices=1000] N/A 9.4 µs N/A
🆕 Walltime take_neon[core/sorted/primitive/nonnull/chunks=4/indices=250] N/A 6.5 µs N/A
🆕 Walltime take_neon[duplicates/duplicate90/primitive/nonnull/chunks=16/indices=1000] N/A 29.1 µs N/A
🆕 Walltime take_neon[duplicates/duplicate99/primitive/nonnull/chunks=16/indices=1000] N/A 24.1 µs N/A
🆕 Walltime take_neon[nullable/sorted/primitive/nullable_10pct_null/chunks=16/indices=1000] N/A 26.6 µs N/A
... ... ... ... ... ...

ℹ️ Only the first 20 benchmarks are displayed. Go to the app to view all benchmarks.

Tip

Curious why performance improved? Comment @codspeedbot explain why performance improved on this PR, or directly use the CodSpeed MCP with your agent.

Comparing ct/codspeed-repeatability (7da7699) with develop (d8e7467)

Open in CodSpeed

Footnotes

  1. 38 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩

  2. 47 benchmarks were run, but are now archived. If they were deleted in another branch, consider rebasing to remove them from the report. Instead if they were added back, click here to restore them. ↩

View more details on CodSpeed