Skip to content

Add Basilisk to conformance results#2316

Merged
JelleZijlstra merged 3 commits into
python:mainfrom
Nimblesite:add-basilisk-conformance
Jul 6, 2026
Merged

Add Basilisk to conformance results#2316
JelleZijlstra merged 3 commits into
python:mainfrom
Nimblesite:add-basilisk-conformance

Conversation

@MelbourneDeveloper

Copy link
Copy Markdown
Contributor

Adds Basilisk to the typing conformance report.

Basilisk is published as basilisk-python on PyPI and installs a basilisk console script, matching the conformance suite's locked uv dependency model.

Local verification run from this branch:

cd conformance
uv sync --python 3.12 --frozen
uv run --python 3.12 --frozen python src/main.py
uv run --python 3.12 --frozen python src/validate_results.py

The run validated 987 conformance result files with no invariant violations and left conformance/results clean. Basilisk reports 141/141 manual Pass, automated Pass, and zero errors_diff entries with basilisk-python==0.27.0.

@python-cla-bot

python-cla-bot Bot commented Jul 5, 2026

Copy link
Copy Markdown

All commit authors signed the Contributor License Agreement.

CLA signed

Comment thread conformance/src/type_checker.py Outdated
@MelbourneDeveloper

Copy link
Copy Markdown
Contributor Author

CLA is now signed. Could a maintainer please approve the GitHub Actions workflows for this fork PR so the Conformance, Test and lint, and Build the documentation workflows can run?

For context, the submitted results were regenerated from the public basilisk-python==0.27.0 PyPI wheel using the upstream conformance harness on Python 3.12. Local verification showed 141/141 graded conformance files passing, 0 errors_diff, and a clean validate_results.py run.

@JelleZijlstra

Copy link
Copy Markdown
Member

I let CI run. Congratulations on building this tool!

@MelbourneDeveloper

Copy link
Copy Markdown
Contributor Author

I let CI run. Congratulations on building this tool!

🙏

Thanks. Happy to contribute to the Python community and glad to be part of the process that brings the ecosystem forward

@JelleZijlstra JelleZijlstra merged commit f051625 into python:main Jul 6, 2026
5 checks passed
MelbourneDeveloper added a commit to Nimblesite/Basilisk that referenced this pull request Jul 6, 2026
… 100%

Basilisk is now listed in the official python/typing conformance results
(python/typing#2316). Surface that across the site and READMEs, and re-stamp
the graded commit to the current upstream tip.

- Comparison tables (EN + zh homepage) and the /docs/comparison leaderboard now
  show every graded checker's official score, including pycroscope (92.2%), the
  7th tool previously omitted. Basilisk tops the board as the only tool at a
  perfect 100%; each score links to that tool's live results folder.
- READMEs (EN + zh): restore the "only Python type checker with a perfect 100%"
  claim now that it is substantiated by the official results.html and link it
  there (Documentation Honesty: comparative claim carries its source).
- Re-stamp conformance references c94dfce -> f051625 (still 141/141, 0 FP) in
  conformance_report.json, README, and CHECKER-ARCHITECTURE-SPEC to match the
  fixtures the gate now scores against.
- Expand vscode-extension/NOTICES to the full third-party notice set.

pycroscope facts (Python, Apache-2.0, no LSP/debugger/editor extension) verified
against its repository; all conformance figures verified against the live
python/typing results.html at f051625.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants