Pinned Loading

1. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 64.8k 11.8k

2. sgl-project/sglang sgl-project/sglang Public

   SGLang is a fast serving framework for large language models and vision language models.

   Python 21k 3.6k

3. volcengine/verl volcengine/verl Public

   verl: Volcano Engine Reinforcement Learning for LLMs

   Python 17.3k 2.8k

4. NVIDIA/Megatron-LM NVIDIA/Megatron-LM Public

   Ongoing research training transformer models at scale

   Python 14.4k 3.3k

5. aliyun/SimAI aliyun/SimAI Public

   C++ 755 125

6. aliyun/aicb aliyun/aicb Public

   HTML 227 47