🎯
Focusing
Privately deploy open-source LLMs like Llama 3.3, Qwen 3.6, and Gemma 4 on dedicated private GPUs. OpenAI-compatible API in mins — no shared infra, no MLOps.
Pinned Loading
-
open-llm-benchmarks
open-llm-benchmarks PublicOpen-source LLM inference benchmarks — TTFT, TPOT, Throughput, Latency & Cost-per-token for models like Llama, Qwen, Gemma, DeepSeek, Gpt-Oss etc. deployed on different dedicated GPUs.
Python 1
Something went wrong, please refresh the page to try again.
If the problem persists, check the GitHub status page or contact support.
If the problem persists, check the GitHub status page or contact support.