Skip to content

Actions: AISBench/benchmark

Actions

Prevent Issue Close with not_fixed Label

Actions

Loading...
Loading

Show workflow options

Create status badge

Loading
prevent_issue_close.yml
68 workflow runs
68 workflow runs

Filter by Event

⌥ + click/return to exclude

Filter by Status

⌥ + click/return to exclude

Filter by Branch

⌥ + click/return to exclude

Filter by Actor

⌥ + click/return to exclude
[需求] swe-bench_pro数据集特有错误提示优化 Prevent Issue Close with not_fixed Label #68: Issue #399 closed by SJTUyh
10s
10s
[需求] 优化SWE-Bench_Pro数据集资源清理逻辑 Prevent Issue Close with not_fixed Label #67: Issue #380 closed by SJTUyh
7s
7s
[Bug] Prevent Issue Close with not_fixed Label #66: Issue #403 closed by kalandramo
9s
9s
[疑问] AisBench和Evalscope在性能测试指标计算上有什么差异吗？相同的服务配置，测试相同的场景，性能结果差异较大。 Prevent Issue Close with not_fixed Label #65: Issue #375 closed by Zz-Dai
8s
8s
[文档] livecodebench的指导文档中目录结构缺失code_generation_lite.py文件 Prevent Issue Close with not_fixed Label #64: Issue #134 closed by Keithwwa
5s
5s
[文档] generated_prompts_path参数描述不够完善，可用数据集任务名称应为mooncake_trace_gen Prevent Issue Close with not_fixed Label #63: Issue #154 closed by Keithwwa
6s
6s
[文档] ARC-e下载结果与文档描述不符 Prevent Issue Close with not_fixed Label #62: Issue #158 closed by Keithwwa
9s
9s
[文档] 如需进一步配置、使用 CLI 或 Python 脚本发起评测任务，请参考快速入门指南。跳转错误 Prevent Issue Close with not_fixed Label #61: Issue #221 closed by Keithwwa
5s
5s
[文档] 点击链接出现404 error Prevent Issue Close with not_fixed Label #60: Issue #295 closed by Keithwwa
9s
9s
[enhancement] Set SWE-bench LiteLLM inference timeout default from 600s to 200s Prevent Issue Close with not_fixed Label #59: Issue #382 closed by SJTUyh
6s
6s
[需求] SWE-bench 示例配置缺少 temperature/top_k/top_p 等 generation_kwargs 示范 Prevent Issue Close with not_fixed Label #58: Issue #376 closed by SJTUyh
8s
8s
[需求] aisbench容器内没有vim工具，影响离线场景使用 Prevent Issue Close with not_fixed Label #57: Issue #362 closed by SJTUyh
8s
8s
[疑问] 如何在性能测试输出结果那里自定义生成P50的结果 Prevent Issue Close with not_fixed Label #56: Issue #378 closed by SJTUyh
6s
6s
[Bug] 自定义数据集中直接指定路径和mm_custom_gen的方式测试结果有差异 Prevent Issue Close with not_fixed Label #55: Issue #91 closed by jschen069
7s
7s
[Bug] aisbench在构造请求体时是否会增加额外的内容，导致请求体大小比预估的大很多 Prevent Issue Close with not_fixed Label #54: Issue #122 closed by SJTUyh
7s
7s
[Bug] longbenchv2精度测评无结果输出 Prevent Issue Close with not_fixed Label #53: Issue #220 closed by SJTUyh
8s
8s
[Bug] TextVQA，输出predcition正确，但是result精度为0 Prevent Issue Close with not_fixed Label #52: Issue #187 closed by SJTUyh
8s
8s
[Bug] 精度测试匹配问题 Prevent Issue Close with not_fixed Label #51: Issue #329 closed by SJTUyh
9s
9s
[Bug] Prevent Issue Close with not_fixed Label #50: Issue #257 closed by SJTUyh
5s
5s
[Bug] prompts组合role HUMAN是否为正常现象 Prevent Issue Close with not_fixed Label #49: Issue #255 closed by SJTUyh
6s
6s
[Bug] vllm-api-general-chat/omnidocbench报错pyarrow.lib.ArrowInvalid: Could not convert 'box_id_0' with type str: tried to convert to int64 Prevent Issue Close with not_fixed Label #48: Issue #260 closed by GaoHuaZhang
6s
6s
[Bug] terminal-bench-2的文档和自定义配置文件中无法执行模型输出长度，temperature等额外请求参数 Prevent Issue Close with not_fixed Label #47: Issue #322 closed by GaoHuaZhang
8s
8s
[Bug] Qwen3-Coder-Next跑humanevalx数据集报错 Prevent Issue Close with not_fixed Label #46: Issue #139 closed by SJTUyh
5s
5s
[Bug] vllm_api_general_chat.py配置中URL末尾未加/导致访问地址不对 Prevent Issue Close with not_fixed Label #45: Issue #311 closed by SJTUyh
6s
6s
[Bug] AttributeError: 'dict' object has no attribute 'model_type' Prevent Issue Close with not_fixed Label #44: Issue #76 closed by GaoHuaZhang
8s
8s