Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
8 changes: 4 additions & 4 deletions ais_bench/benchmark/tasks/swebench_pro/swebench_pro_infer.py
Original file line number Diff line number Diff line change
Expand Up @@ -199,7 +199,8 @@ def run(self, task_state_manager: TaskStateManager):
raise AISBenchImportError(
SWEBP_CODES.MINISWEAGENT_IMPORT_ERROR,
"SWEBenchProInferTask requires mini-swe-agent. "
"Install with: pip install mini-swe-agent",
"Refer to the Prerequisites section in the swe_bench_pro.md file. "
"Install with: git clone https://github.com/scaleapi/mini-swe-agent.git",
Comment thread
ivanbao9783 marked this conversation as resolved.
) from e

dataset_cfg = self.dataset_cfgs[0]
Expand Down Expand Up @@ -270,9 +271,8 @@ def run(self, task_state_manager: TaskStateManager):
if not (model_name or "").strip():
raise AISBenchValueError(
SWEBP_CODES.MODEL_NOT_SET,
"No model set for SWEBenchPro infer. In your config, set "
"models[0]['model'], models[0]['url'], and models[0]['api_key']. "
Comment thread
ivanbao9783 marked this conversation as resolved.
"Example for local vLLM: model='hosted_vllm/qwen3', url='http://127.0.0.1:2998/v1', api_key='EMPTY'.",
"No model set for SWEBenchPro infer in your config "
"Example for local vLLM: model='qwen3', url='http://127.0.0.1:2998/v1', api_key='EMPTY'.",
)
our_config.setdefault("environment", {})["environment_class"] = "docker"
# SWE-bench Pro images have hardcoded entrypoint=bin/bash which prevents sleep command execution, need to override to empty for default bin/sh
Expand Down
2 changes: 1 addition & 1 deletion docs/source_en/faqs/error_codes.md
Original file line number Diff line number Diff line change
Expand Up @@ -1409,7 +1409,7 @@ If you use a virtual environment, make sure `ais_bench` and `mini-swe-agent` are
No valid model config is detected for SWE-Bench Pro infer (required fields like `model/url/api_key` are missing or empty).
### Solution
Check `models[0]` in your task config and provide at least:
1. `model`, for example `hosted_vllm/qwen3`
1. `model`, for example `qwen3`
2. `url`, for example `http://127.0.0.1:2998/v1`
3. `api_key`, `EMPTY` is acceptable for local tests

Expand Down
2 changes: 1 addition & 1 deletion docs/source_zh_cn/faqs/error_codes.md
Original file line number Diff line number Diff line change
Expand Up @@ -1375,7 +1375,7 @@ pip install -e .
SWE-Bench Pro infer 未检测到可用模型配置(`model/url/api_key` 等关键字段缺失或为空)。
### 解决办法
检查任务配置中的 `models[0]`,至少补齐以下字段:
1. `model`:如 `hosted_vllm/qwen3`
1. `model`:如 `qwen3`
2. `url`:如 `http://127.0.0.1:2998/v1`
3. `api_key`:本地测试可设为 `EMPTY`

Expand Down
Loading