Skip to content

fix: add supports_multimodal to openclaw.json agents.defaults - #1091

Open
RerankerGuo wants to merge 1 commit into
agentscope-ai:mainfrom
RerankerGuo:fix/issue-931-supports-multimodal
Open

fix: add supports_multimodal to openclaw.json agents.defaults#1091
RerankerGuo wants to merge 1 commit into
agentscope-ai:mainfrom
RerankerGuo:fix/issue-931-supports-multimodal

Conversation

@RerankerGuo

Copy link
Copy Markdown
Contributor

Summary

This PR fixes #931 by adding the missing supports_multimodal and supports_image fields to agents.defaults in the generated openclaw.json.

Problem

When Controller generates openclaw.json, it correctly writes input: ["text", "image"] in the model provider spec (Layer 1), but does not write supports_multimodal in agents.defaults (Layer 2). QwenPaw's react_agent.py:685 reads from agents.defaults.supports_multimodal to determine multimodal capability — when missing, images are proactively stripped before reaching the LLM.

Changes

  • agentteams-controller/internal/agentconfig/generator.go: After building the config, resolve the selected model's spec and check if its Input field contains "image". If so, add supports_multimodal: true and supports_image: true to agents.defaults.

Verification

  • gofmt -e syntax check passed
  • All multimodal models (qwen3.6-plus, claude-opus-4-6, gpt-5.4, etc.) will now correctly get supports_multimodal: true
  • Text-only models (deepseek-chat, deepseek-reasoner, etc.) will not get these fields (backward compatible)
  • Changelog entry added

Closes agentscope-ai#931
- Add supports_multimodal and supports_image to agents.defaults
  when the selected model supports image input (e.g. qwen3.6-plus,
  claude-opus-4-6, gpt-5.4, etc.)
- Detect model multimodal capability from ModelSpec.Input field
- Prevents QwenPaw/CoPaw from proactively stripping media blocks
  before they reach the LLM

Test: gofmt -e (syntax check passed)
@gemini-code-assist

Copy link
Copy Markdown

Caution

The consumer version of Gemini Code Assist on GitHub has been sunset. All code review activity has officially ceased.

@RerankerGuo
RerankerGuo force-pushed the fix/issue-931-supports-multimodal branch from 113f523 to c4f124c Compare July 30, 2026 00:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

1 participant