Skip to content

perf(index): bound parallel source retention for low RAM#685

Open
nguyentamdat wants to merge 1 commit into
DeusData:mainfrom
nguyentamdat:low-ram-index-retention-pr
Open

perf(index): bound parallel source retention for low RAM#685
nguyentamdat wants to merge 1 commit into
DeusData:mainfrom
nguyentamdat:low-ram-index-retention-pr

Conversation

@nguyentamdat

Copy link
Copy Markdown

Summary

  • bound parallel indexing source retention by memory budget instead of retaining every source file unconditionally
  • fall back to short-lived source reads during fused cross-LSP resolution when a file was not retained
  • add regression coverage for Python cross-file LSP resolution when retain_sources=false

Verification

  • make -f Makefile.cbm test -> 5728 passed

Notes

Split out from #684 so the low-RAM indexing change is reviewed independently from the JVM callgraph fix.

Limit source retention to a fraction of the memory budget, skip retention when cross-file LSP is disabled or incremental indexing cannot use it, and fail cleanly on extract allocation failures.

Verify: make -f Makefile.cbm test
Signed-off-by: nguyentamdat <nguyentamdat@gmail.com>
@nguyentamdat nguyentamdat force-pushed the low-ram-index-retention-pr branch from 4c38514 to 08319e8 Compare June 29, 2026 07:01
@DeusData

Copy link
Copy Markdown
Owner

Huge thanks for opening this PR and for the work you put into it.

The maintainer shop is currently full, so this may sit for a bit before it gets a proper review. We will come back to this as soon as possible with real feedback; I wanted to make sure it did not sit unacknowledged in the meantime.

@DeusData DeusData added stability/performance Server crashes, OOM, hangs, high CPU/memory priority/high Needs near-term maintainer attention; high-impact bug, regression, safety issue, or release blocker. labels Jun 29, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

priority/high Needs near-term maintainer attention; high-impact bug, regression, safety issue, or release blocker. stability/performance Server crashes, OOM, hangs, high CPU/memory

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants