Popular repositories Loading

1. FastVideo FastVideo Public

   A unified inference and post-training framework for accelerated video generation.

   Python 2.5k 191

2. LookaheadDecoding LookaheadDecoding Public

   [ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding

   Python 1.3k 77

3. Consistency_LLM Consistency_LLM Public

   [ICML 2024] CLLMs: Consistency Large Language Models

   Python 405 18

4. Dynasor Dynasor Public

   [NeurIPS 2025] Simple extension on vLLM to help you speed up reasoning model without training.

   Python 198 26

5. MuxServe MuxServe Public

   Jupyter Notebook 74 10

6. vllm-ltr vllm-ltr Public

   [NeurIPS 2024] Efficient LLM Scheduling by Learning to Rank

   Python 61 14