Pinned Loading

1. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 86.7k 19.6k

2. vllm-project/vllm-ascend vllm-project/vllm-ascend Public

   Community maintained hardware plugin for vLLM on Ascend

   C++ 2.4k 1.7k

3. sgl-project/sglang sgl-project/sglang Public

   SGLang is a high-performance serving framework for large language models and multimodal models.

   Python 30.5k 7.3k

4. Trae-AI/TRAE Trae-AI/TRAE Public

   TRAE official

   912 49