Skip to content

Add the system role into messages array#967

Merged
Spherrrical merged 4 commits into
katanemo:mainfrom
ShivaniKumar1:skumar/add-role-messages-array
Jun 12, 2026
Merged

Add the system role into messages array#967
Spherrrical merged 4 commits into
katanemo:mainfrom
ShivaniKumar1:skumar/add-role-messages-array

Conversation

@ShivaniKumar1

@ShivaniKumar1 ShivaniKumar1 commented Jun 12, 2026

Copy link
Copy Markdown
Contributor

Inf-proxy accepts system as a top-level param and also inside the messages array. Anthropic also accepts both: https://platform.claude.com/docs/en/api/go/messages/create & https://platform.claude.com/docs/en/build-with-claude/mid-conversation-system-messages.

Plano seems to only accept system as a top-level param and NOT in the messages array. Otherwise, plano is returning this error:

failed to obtain model route: plano returned status 400: {"error":{"code":"InvalidRequest","message":"Invalid request","details":{"reason":"Failed to parse request: unknown variant `system`, expected `user` or `assistant` at line 1 column 4677"}}}

Changes:

  • Clients can now send "role": "system" inside the Anthropic messages array.
  • The remaining messages array contains only user/assistant (so it stays valid for Bedrock).

@Spherrrical Spherrrical merged commit ecf864d into katanemo:main Jun 12, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants