Refactor to work with local model like LLMStudio - neet to change on…#9
Refactor to work with local model like LLMStudio - neet to change on…#9marekkacprzak wants to merge 3 commits into
Conversation
…y appsettings.json - anthropic-cluster anthropic-api url to http://localhost:1234
|
Thanks for this, Marek. There is real value in here, especially the hop-by-hop header handling and the idea of a configurable upstream. To get it merged smoothly, I would like to ask for a few changes, mainly around splitting this into focused PRs. Right now it bundles four independent changes, which makes it hard to review and test as a unit: 1. Please split into separate PRs. Ideally:
2. The dark/light theme changes are already in 3. Please keep Anthropic as the default. The change switches the default upstream to 4. One question on the LM Studio path. Claude Code sends requests in the Anthropic Messages API format, but LM Studio's server is OpenAI-compatible. Since this PR changes the destination but does not translate the request and response bodies, I am curious how you got it working end to end. Could you share how you tested it? A screenshot of a successful exchange in the dashboard would be great. That will help me decide whether we should document a compatibility requirement, namely that the upstream must speak the Anthropic API. Really appreciate the contribution, the header fix especially. Happy to review the split PRs as soon as they are up. |
…ly appsettings.json - anthropic-cluster anthropic-api url to http://localhost:1234