Discussions

• 1 You must be logged in to vote

  🙏

  llm judge eval error:failed with code 134

  daimeiquan asked Oct 2, 2025 in Q&A · Unanswered

  

  

  0
• 2 You must be logged in to vote

  🙏

  如何对已经生成了的回答进行评估而不是使用模型重新跑

  AqualCross asked Sep 29, 2025 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  #️⃣

  在使用opencompass的时候使用--max-num-workers=2 就会卡死

  yanchenmochen started Sep 18, 2025 in Community Task

  

  

  1
• 1 You must be logged in to vote

  🙏

  FileNotFoundError - What is the correct location for the data folder?

  ZJUCQR asked Sep 11, 2025 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  How to evaluate infer results of multipl_e?

  MichaelYang-lyx asked Sep 9, 2025 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  base模型的cot如何测试

  aricelover asked Sep 4, 2025 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  跑T-Eval时出问题

  baowj-678 asked Sep 4, 2025 in Q&A · Unanswered

  

  

  0
• 0 You must be logged in to vote

  🙏

  评测数学能力pass@1如何生成多个结果来评估？

  DELEnomore asked Aug 26, 2025 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  请问hf-type字段只支持base和chat。那么请问Instruct模型应该选哪个？

  BigFishLi asked Mar 10, 2025 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  运行mathbench测试，不停的提示stopping criteria

  whyseu asked Jul 6, 2025 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  模型配置文件的path路径必须写死不能传入变量吗？

  DELEnomore asked Aug 15, 2025 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  想问一下目前支持对GLM4-32B本地模型的测试吗，如果可以的话可以给个示例吗？

  pioneer-pi asked Aug 15, 2025 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  OpenCompassData-core数据集下载失败

  yangxinQA asked Aug 9, 2025 in Q&A · Unanswered

  

  

  0
• 3 You must be logged in to vote

  🙏

  The evaluation of MBPP is 1-shot or 3-shot？

  xiaoshengjun asked Feb 4, 2024 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  如何对数据集的训练集进行推理？

  huangkr03 asked May 12, 2025 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  请教下，一次评估多个模型，模型在数据集推理时，是串行的还是并行的，还是某种形式的并发态？

  Redias asked May 8, 2025 in Q&A · Unanswered

  

  

  0
• 4 You must be logged in to vote

  🙏

  Evaluating VLMs on text-only datasets.

  sbdzdz asked May 7, 2025 in Q&A · Unanswered

  

  

  0
• 2 You must be logged in to vote

  🙏

  cache_size_limit reached when evaluating the accuracy

  WillLester asked Apr 28, 2025 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  在评估BoolQ时并不计算acc，只显示了extract_rate

  ZV-Liu asked Apr 10, 2025 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💬

  AIME2024 dataset on opencompass is different from the dataset on huggingface

  ljliu started Mar 25, 2025 in View all discussions

  

  

  

  

  2
• 1 You must be logged in to vote

  🙌

  Deepseek-r1测试效果不好（Deepseek-r1's testing results weren't great）

  lissettecarlr started Feb 14, 2025 in Show and tell

  

  

  

  

  6
• 1 You must be logged in to vote

  🙏

  执行脚本没有反应

  rangehow asked Apr 8, 2025 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  如何在prompt template后加入某些字符？

  CurryxIaoHu asked Mar 25, 2025 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  使用Ollama框架测试AIME2024精度异常

  AaroAaron asked Mar 17, 2025 in Q&A · Unanswered

  

  

  3
• 2 You must be logged in to vote

  🙏

  使用VLLM推理速度慢，吞吐量低

  sunsn1997 asked Mar 11, 2025 in Q&A · Unanswered

  

  

  0