Repository navigation
Prepare fixed-grid MEPV scans and share stable response pairs - #93
Merged
Merged
Conversation
Benchmark Results
Benchmark PlotsA plot of the benchmark results have been uploaded as an artifact to the workflow run for this PR. |
Collaborator
Coverage Report for CI Build 42667679524Coverage increased (+0.8%) to 55.022%Details
Uncovered ChangesNo uncovered changes found. Coverage Regressions8 previously-covered lines in 2 files lost coverage.
Coverage Stats
💛 - Coveralls |
frankier
marked this pull request as draft
November 7, 2026 22:32
frankier
force-pushed
the
codex/grid-preallocation-scratch
branch
3 times, most recently
from
November 7, 2026 23:08
ad2bf87 to
ed6205c
Compare
This was referenced Nov 8, 2026
frankier
force-pushed
the
codex/grid-preallocation-scratch
branch
from
November 8, 2026 17:28
66bfb13 to
51781f2
Compare
frankier
marked this pull request as ready for review
November 8, 2026 17:48
frankier
marked this pull request as draft
November 9, 2026 10:54
This was referenced Nov 9, 2026
frankier
marked this pull request as ready for review
November 9, 2026 17:26
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Fixed-grid MEPV prepares the history density and point estimate once per scan, reuses private candidate buffers, and delegates centered moments to PBB. Supported binary linear scans share FIB's stable response pairs; binary log scans share native log-response pairs. Range coordinates are materialized once per scan so range indexing does not obstruct response-loop vectorization.
The workspace uses the registered releases PsychometricsBazaarBase 0.8.11 (including PBB PRs #21 and #22) and FittedItemBanks 0.7.7. The Julia 1.12 CI job checks minimum supported versions.
Prepared contexts incorporate speculative response deltas and belong to one history/scan. The binary linear moment call uses
skip_checks=truebecause preparation owns equally indexed, disjoint buffers and supported banks return two response factors. PBB retains mass and denominator checks. Its merged channel-pair reductions require no additional CAT call-site changes.The prepared path currently requires scalar Float64 grids, mean ability estimation and a multiplicative density model. Supported linear banks are FIB transfer/CDF-MIRT banks and guess/slip wrappers. Custom banks retain scalar evaluation; unsupported configurations retain generic speculation. Log variances preserve absolute-denominator semantics, including extreme scales.
Validation
The rerun of CI on the current CAT head passes Julia 1.12 and 1.13 tests, coverage, and documentation against merged PBB main. The fresh benchmark compares every candidate score between linear/log Float64 and the Float32 probe up to 100,000 items, and checks the generic from-scratch reference at 1,000 items. All selections match the historical fixture: 21 / 809 / 9424 / 30483. Maximum relative criterion error is 1.82e-15 for log Float64 and 3.78e-7 for the Float32 probe.
Fresh Julia 1.13.3 benchmarks — merged PBB main
Median milliseconds per complete
next_itemcall, except the explicitly labelled Float32 prepared-scan probe:Original 10^8-item RNG prefix, the same first ten responses, Normal(0,1) prior and 33 points on [-4,4]. One thread pinned to CPU 0; 51 randomized interleaved warmed rounds through 10,000 items, 31 at 100,000. All timed compilation/recompilation and GC are zero. At 100,000 the median within-round CAT-linear/SFC ratio is 1.186 and Float32-probe/SFC is 0.674.
Float32 is not a shipped end-to-end path in this PR. A Float32 grid currently takes the generic fallback and fails on
SqDev{Float64}(Float32). The Float32 probe explicitly constructs a prepared state, converts the existing Float64 history cache on every scan, and uses a local precision-preserving guess/slip adapter: FIB 0.7.7's1.0scale otherwise promotes those responses to Float64. No package methods were replaced. Leaving that FIB promotion intact gives a mixed-precision prepared probe of 34.455 ms at 100,000 items. These probe results show potential, not production Float32 performance.LLVM shows four-wide Float64 response production and eight-wide Float32 production in the probe. The log-density producer remains scalar. The benchmark still uses the current generic FIB normalization, with no unit-scale specialization.
Driver, raw timings, type/path diagnostics, correctness checks, LLVM and immutable environment provenance are retained in CATExperiments under
bench/merged_paths_20261109/anddata/analysis/20261109-merged-paths/.The
pull_request_targetbenchmark workflow still reads main's Julia 1.12 workflow until merge; that automatic run was cancelled. All direct measurements above use Julia 1.13.3.