Search results

[DEV] change nt-based xmake config to op-based

Status: Open.

#251 In InfiniTensor/InfiniLM;

· wooway777 opened on Mar 3, 2026

[DEV] 接入flash-attention库

Status: Open.

#248 In InfiniTensor/InfiniLM;

· PanZezhong1725 opened on Mar 2, 2026

[DEV] 将Paged KVCache的默认blocksize改为256可提升性能

Status: Open.

#246 In InfiniTensor/InfiniLM;

· PanZezhong1725 opened on Mar 2, 2026

[DEV] cuda swiglu

Status: Open.

#245 In InfiniTensor/InfiniLM;

· wooway777 opened on Feb 27, 2026

[DEV] 推理服务static cache支持缓存复用

Status: Open.

#244 In InfiniTensor/InfiniLM;

· ma-hang opened on Feb 27, 2026

[DEV] 支持awq w4a16(fp16)模型推理

Status: Open.

#243 In InfiniTensor/InfiniLM;

· qinyiqun opened on Feb 27, 2026

[DEV] vllm性能测试脚本

Status: Open.

#239 In InfiniTensor/InfiniLM;

· PanZezhong1725 opened on Feb 25, 2026

[DEV] 改进请求生命周期管理和超时处理

Status: Open.

#233 In InfiniTensor/InfiniLM;

· ma-hang opened on Feb 13, 2026

[DEV] InfiniLM inference_server.py 摩尔平台问题修复

Status: Open.

#229 In InfiniTensor/InfiniLM;

· spike-zhu opened on Feb 12, 2026

[DEV] 摩尔平台使用 silu_and_mul，以及推理脚本增加 warmup

Status: Open.

#224 In InfiniTensor/InfiniLM;

· spike-zhu opened on Feb 11, 2026

[DEV] 支持寒武纪encode_plus

Status: Open.

#221 In InfiniTensor/InfiniLM;

· wooway777 opened on Feb 11, 2026

[DEV]server 支持vllm bench

Status: Open.

#219 In InfiniTensor/InfiniLM;

· Ceng23333 opened on Feb 10, 2026