Skip to content

Provider preset: FriendliAI (serverless) #3

Description

@frostyhand

Any OpenAI-compatible provider already works via custom; this issue is the one-line nickname.

Verified 2026-07-12:

  • Base URL: https://api.friendli.ai/serverless/v1 (serverless plane; dedicated endpoints use a different base)
  • Keyless smoke: POST {base}/chat/completions returns 401 {"message":"Unauthorized. Please provide a valid credential."}
  • Docs: https://friendli.ai/docs/guides/serverless_endpoints/openai-compatibility
  • Example model: Qwen/Qwen3-235B-A22B-Instruct-2507 (HF-style id with a slash; worth one test asserting the model id is not path-mangled)

Acceptance: one entry in src/router/upstream.ts PRESETS with a comment noting the serverless vs dedicated split, README provider table row, tests green.

Metadata

Metadata

Assignees

No one assigned

    Labels

    good first issueGood for newcomersprovider-presetRequest or add a named provider preset (one line)

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions