Skip to content
@vllm-project

vLLM

Pinned Loading

  1. vllm vllm Public

    A high-throughput and memory-efficient inference and serving engine for LLMs

    Python 61.7k 11k

  2. llm-compressor llm-compressor Public

    Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

    Python 2.2k 272

  3. recipes recipes Public

    Common recipes to run vLLM

    Jupyter Notebook 197 68

Repositories

Showing 10 of 26 repositories
  • tpu-inference Public

    TPU inference for vLLM, with unified JAX and PyTorch support.

    vllm-project/tpu-inference’s past year of commit activity
    Python 140 Apache-2.0 21 8 (1 issue needs help) 51 Updated Nov 2, 2025
  • vllm Public

    A high-throughput and memory-efficient inference and serving engine for LLMs

    vllm-project/vllm’s past year of commit activity
    Python 61,718 Apache-2.0 10,962 1,878 (27 issues need help) 1,219 Updated Nov 2, 2025
  • guidellm Public

    Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs

    vllm-project/guidellm’s past year of commit activity
    Python 675 Apache-2.0 92 83 (5 issues need help) 23 Updated Nov 2, 2025
  • aibrix Public

    Cost-efficient and pluggable Infrastructure components for GenAI inference

    vllm-project/aibrix’s past year of commit activity
    Go 4,328 Apache-2.0 478 240 (20 issues need help) 20 Updated Nov 1, 2025
  • semantic-router Public

    Intelligent Router for Mixture-of-Models

    vllm-project/semantic-router’s past year of commit activity
    Rust 2,121 Apache-2.0 274 86 (17 issues need help) 26 Updated Nov 1, 2025
  • vllm-ascend Public

    Community maintained hardware plugin for vLLM on Ascend

    vllm-project/vllm-ascend’s past year of commit activity
    Python 1,291 Apache-2.0 530 639 (8 issues need help) 180 Updated Nov 1, 2025
  • ci-infra Public

    This repo hosts code for vLLM CI & Performance Benchmark infrastructure.

    vllm-project/ci-infra’s past year of commit activity
    HCL 24 Apache-2.0 43 0 21 Updated Nov 1, 2025
  • vllm-neuron Public

    Community maintained hardware plugin for vLLM on AWS Neuron

    vllm-project/vllm-neuron’s past year of commit activity
    Python 11 Apache-2.0 0 0 0 Updated Oct 31, 2025
  • vllm-spyre Public

    Community maintained hardware plugin for vLLM on Spyre

    vllm-project/vllm-spyre’s past year of commit activity
    Python 37 Apache-2.0 26 6 17 Updated Oct 31, 2025
  • llm-compressor Public

    Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

    vllm-project/llm-compressor’s past year of commit activity
    Python 2,170 Apache-2.0 271 56 (11 issues need help) 42 Updated Nov 1, 2025
View all repositories

Sponsors

  • @G-Research-OSS
  • @kevATin
  • @yankay
  • @brickfrog
  • @GabrielBianconi
  • @imkero
  • @comet-ml
  • @thomas-hiddenpeak
  • @terrytangyuan
  • @dvlpjrs
  • @vincentkoc
  • @robertgshaw2-redhat
  • Private Sponsor
  • Private Sponsor