Popular repositories Loading

1. DeepSpec-Ascend DeepSpec-Ascend Public

   Forked from deepseek-ai/DeepSpec

   DeepSpec: a full-stack codebase for training and evaluating speculative decoding algorithms

   Python 1 1

2. git-lean-test git-lean-test Public

   A test for learnning git

3. Foundations-of-LLMs Foundations-of-LLMs Public

   Forked from ZJU-LLMs/Foundations-of-LLMs

4. speculators speculators Public

   Forked from vllm-project/speculators

   A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM

   Python

5. sglang sglang Public

   Forked from sgl-project/sglang

   SGLang is a high-performance serving framework for large language models and multimodal models.

   Python

6. SpecForge SpecForge Public

   Forked from sgl-project/SpecForge

   Train speculative decoding models effortlessly and port them smoothly to SGLang serving.

   Python