Skip to content

Pull requests: open-compass/opencompass

New pull request New
70 Open 1,242 Closed
70 Open 1,242 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[Update] Add SciReasoner config and support for Retrievers using RawPromptTemplate
#2422 opened Mar 25, 2026 by Myhs-phz Loading…
[Doc] Add guide for RawPromptTemplate
#2420 opened Mar 23, 2026 by Myhs-phz Loading…
@bittersweet1999
feat: upgrade MiniMax provider with M2.7 models and OpenAI-compatible API
#2418 opened Mar 20, 2026 by octo-patch Loading…
2 of 3 tasks
@tonysy
[Fix] CEval ModelScope load and HF generate for causal LMs
#2416 opened Mar 19, 2026 by DeliWang Loading…
6 tasks
@acylam
1
Add support for Azure OpenAI models and managed identity auth
#2415 opened Mar 18, 2026 by jgbradley1 Loading…
2 of 6 tasks
[Fix] Fix eval stage is extremely slow
#2409 opened Mar 5, 2026 by xming521 Loading…
6 tasks
@acylam
3
fix: correct typo 'seperated' to 'separated'
#2397 opened Feb 9, 2026 by thecaptain789 Loading…
@bittersweet1999
Update README.md for mmlu
#2374 opened Dec 29, 2025 by freemedom Loading…
@bittersweet1999
[Dataset] Add dataset arena-hard-v2
#2362 opened Dec 16, 2025 by Myhs-phz Loading…
@liushz
[Fix] fix eval_postprocess in gpqa
#2357 opened Dec 11, 2025 by qianyp18 Loading…
@acylam
Add IBM Granite client and configs for supported watsonx.ai models
#2344 opened Dec 3, 2025 by RonalddMatias Loading…
[Fix] Rename smolinstruct_pp_acc_0_shot_instruct dataset list as {}_datasets
#2340 opened Dec 2, 2025 by cnlnpjhsy Loading…
@liushz
feat(config): add Meta-Llama-3.1-8B-Instruct for MMLU benchmark
#2325 opened Nov 25, 2025 by 6taco Loading…
6 tasks
@liushz
1
Refactor backend switch logic with support for SGLang and OpenAI backends
#2286 opened Oct 8, 2025 by Copilot AI • Draft
@tonysy
[fix] Handle None value for max_out_len parameter in HuggingFace model
#2271 opened Sep 15, 2025 by Nexround Loading…
@bittersweet1999
Reasonzoo
#2256 opened Sep 1, 2025 by epsilondylan Loading…
2 tasks
@bittersweet1999
[Feature] Support pass@1 evaluation for multi predictions in MathEvaluator
#2253 opened Aug 28, 2025 by BeingIsA Loading…
@acylam
3
[Update] compassbench subjective config
#2238 opened Aug 14, 2025 by Myhs-phz Loading…
@acylam
feat: Add Zebra Grid dataset support with ZeroEval alignment
#2234 opened Aug 11, 2025 by max-yue Loading…
@bittersweet1999
[fix] switch think mode
#2233 opened Aug 10, 2025 by Tianhao-Peng Loading…
2 of 6 tasks
@tonysy
[Fix] add tqdm for BlueLMAPI
#2226 opened Aug 1, 2025 by Myhs-phz Loading…
@tonysy
[Feature] Support eval for C-Eval test split
#2218 opened Jul 24, 2025 by HYZ17 Loading…
@acylam
1
[Fix] Modify error handling and fix typo
#2216 opened Jul 24, 2025 by Owen-Qin Loading…
@acylam
[Fix] Deprecate unused and error formated math500 gen file
#2206 opened Jul 17, 2025 by liushz Loading…
6 tasks
@acylam
[Fix] livecodebench serialization and timeout errors
#2204 opened Jul 15, 2025 by f14-bertolotti Loading…
6 tasks
@liushz
ProTip! Exclude everything labeled bug with -label:bug.