Skip to content

Fix Qwen3-VL normalization: use 0.5/0.5/0.5 from checkpoint#105

Open
stikves wants to merge 3 commits into
apple:mainfrom
stikves:fix/qwen3-vl-normalization
Open

Fix Qwen3-VL normalization: use 0.5/0.5/0.5 from checkpoint#105
stikves wants to merge 3 commits into
apple:mainfrom
stikves:fix/qwen3-vl-normalization

Conversation

@stikves

@stikves stikves commented Jul 15, 2026

Copy link
Copy Markdown
Contributor

The qwen3-vl VLMSpec hardcoded OpenAI-CLIP normalization stats, but Qwen3-VL checkpoints specify image_mean=image_std=[0.5, 0.5, 0.5]. This caused a silent ~1.86x overscale on every pixel fed to the vision encoder.

Fixes #82.

Tested locally. Now it identifies background colors more correctly.

The qwen3-vl VLMSpec hardcoded OpenAI-CLIP normalization stats, but
Qwen3-VL checkpoints specify image_mean=image_std=[0.5, 0.5, 0.5].
This caused a silent ~1.86x overscale on every pixel fed to the
vision encoder.

Fixes apple#82.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

VLM: qwen3-vl exports CLIP normalization stats, but Qwen3-VL checkpoints specify image_mean = image_std = [0.5, 0.5, 0.5]

2 participants