[BugFix] Change count_tokens_per_expert_func declaration(Tensor -> vector<Tensor>)
#5794
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Motivation
修复 #5762 导致的ERNIE系列模型启动BUG,这也太坑了,只抛一个🤬🤬:
Modifications
函数声明处已经修改返回值为
std::vector<paddle::Tensor>FastDeploy/custom_ops/gpu_ops/moe/deepgemm_preprocess.cu
Line 44 in 724045c
所以 C++ extension 的声明也要改:
FastDeploy/custom_ops/gpu_ops/cpp_extensions.cc
Line 517 in 724045c
Usage or Command
NULL
Accuracy Tests
NULL
Checklist
[FDConfig],[APIServer],[Engine],[Scheduler],[PD Disaggregation],[Executor],[Graph Optimization],[Speculative Decoding],[RL],[Models],[Quantization],[Loader],[OP],[KVCache],[DataProcessor],[BugFix],[Docs],[CI],[Optimization],[Feature],[Benchmark],[Others],[XPU],[HPU],[GCU],[DCU],[Iluvatar],[Metax]]pre-commitbefore commit.releasebranch, make sure the PR has been submitted to thedevelopbranch, then cherry-pick it to thereleasebranch with the[Cherry-Pick]PR tag.