Popular repositories Loading

1. sglang sglang Public

   Forked from sgl-project/sglang

   SGLang is a fast serving framework for large language models and vision language models.

   Python

2. DeepSeek-V3 DeepSeek-V3 Public

   Forked from deepseek-ai/DeepSeek-V3

   Python

3. TensorRT-Model-Optimizer TensorRT-Model-Optimizer Public

   Forked from NVIDIA/Model-Optimizer

   A unified library of state-of-the-art model optimization techniques like quantization, pruning, distillation, speculative decoding, etc. It compresses deep learning models for downstream deployment…

   Python

4. Mooncake Mooncake Public

   Forked from kvcache-ai/Mooncake

   Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

   C++

5. tilelang tilelang Public

   Forked from tile-ai/tilelang

   Domain-specific language designed to streamline the development of high-performance GPU/CPU/Accelerators kernels

   C++

6. flashinfer flashinfer Public

   Forked from flashinfer-ai/flashinfer

   FlashInfer: Kernel Library for LLM Serving

   Cuda