Skip to content

agent: document Vercel, Mistral, llama.cpp providers and effort defaults#71

Merged
krichprollsch merged 1 commit into
mainfrom
docs/agent-new-providers
Jun 18, 2026
Merged

agent: document Vercel, Mistral, llama.cpp providers and effort defaults#71
krichprollsch merged 1 commit into
mainfrom
docs/agent-new-providers

Conversation

@arrufat

@arrufat arrufat commented Jun 18, 2026

Copy link
Copy Markdown
Collaborator

Summary

Updates the lightpanda agent docs to match recent changes in the browser and zenai repos. The agent gained new LLM providers and effort behavior that the docs didn't reflect.

Providers

  • Vercel AI Gateway--provider vercel, env AI_GATEWAY_API_KEY
  • Mistral--provider mistral, env MISTRAL_API_KEY
  • llama.cpp--provider llama_cpp, local (no key), base http://localhost:8080/v1, probed alongside Ollama

Note the Vercel flag is vercel even though its env var is AI_GATEWAY_API_KEY.

Other changes

  • API-key auto-detection order extended with AI_GATEWAY_API_KEYMISTRAL_API_KEY
  • Documented HF_BILL_TO for billing Hugging Face routed requests to an org
  • Explained effort resolution order (flag > remembered > provider default > mode default); Mistral now defaults to none because its default model rejects reasoning effort

Files

  • src/content/usage/agent.mdx — providers table, auto-detect order, local probing, HF billing, effort
  • src/content/run-locally/commands/agent.mdx--provider allowed values & env lists, --base-url, --effort defaults

Note for maintainers

browser/src/help.zon (the source of the --help text mirrored in commands/agent.mdx) is also stale — it still lists only anthropic, openai, gemini, huggingface, ollama and omits the new env vars. These docs now reflect reality; a follow-up in the browser repo should refresh help.zon so --help and the docs reconverge.

Verification

Verified every flag / env var / default against the source: zenai/src/provider.zig (openAiPreset, default_candidates, defaultEffort), browser/src/agent/settings.zig (api_keys_hint, resolveEffort), and browser/src/Config.zig (agent option set). Biome/typecheck can't run here (the package needs the parent monorepo workspace for @lightpanda/common); changes are pure markdown prose/tables.

- Add Vercel AI Gateway, Mistral, and llama.cpp to the providers table
  and the --provider allowed values / env-key lists
- Extend the API-key auto-detection order with AI_GATEWAY_API_KEY and
  MISTRAL_API_KEY
- Note llama.cpp as a probed local server (localhost:8080) alongside Ollama
- Document HF_BILL_TO for Hugging Face org billing
- Explain effort resolution (flag > remembered > provider default > mode
  default) and the Mistral none default
@arrufat arrufat force-pushed the docs/agent-new-providers branch from b7cc022 to 2a77cdd Compare June 18, 2026 11:36
@arrufat arrufat requested a review from francisbouvier June 18, 2026 11:37
@krichprollsch krichprollsch merged commit ad945b3 into main Jun 18, 2026
1 check passed
@krichprollsch krichprollsch deleted the docs/agent-new-providers branch June 18, 2026 11:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants