Skip to content
@vllm-project

vLLM

Pinned Loading

  1. vllm vllm Public

    A high-throughput and memory-efficient inference and serving engine for LLMs

    Python 63.6k 11.5k

  2. llm-compressor llm-compressor Public

    Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

    Python 2.3k 292

  3. recipes recipes Public

    Common recipes to run vLLM

    Jupyter Notebook 238 84

Repositories

Showing 10 of 27 repositories
  • vllm Public

    A high-throughput and memory-efficient inference and serving engine for LLMs

    vllm-project/vllm’s past year of commit activity
    Python 63,647 Apache-2.0 11,462 1,911 (34 issues need help) 1,236 Updated Nov 22, 2025
  • tpu-inference Public

    TPU inference for vLLM, with unified JAX and PyTorch support.

    vllm-project/tpu-inference’s past year of commit activity
    Python 163 Apache-2.0 39 17 (1 issue needs help) 58 Updated Nov 22, 2025
  • guidellm Public

    Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs

    vllm-project/guidellm’s past year of commit activity
    Python 712 Apache-2.0 100 41 (3 issues need help) 15 Updated Nov 22, 2025
  • semantic-router Public

    Intelligent Router for Mixture-of-Models

    vllm-project/semantic-router’s past year of commit activity
    Rust 2,305 Apache-2.0 296 111 (27 issues need help) 33 Updated Nov 22, 2025
  • ci-infra Public

    This repo hosts code for vLLM CI & Performance Benchmark infrastructure.

    vllm-project/ci-infra’s past year of commit activity
    HCL 26 Apache-2.0 45 0 23 Updated Nov 21, 2025
  • aibrix Public

    Cost-efficient and pluggable Infrastructure components for GenAI inference

    vllm-project/aibrix’s past year of commit activity
    Go 4,424 Apache-2.0 485 242 (19 issues need help) 22 Updated Nov 21, 2025
  • vllm-spyre Public

    Community maintained hardware plugin for vLLM on Spyre

    vllm-project/vllm-spyre’s past year of commit activity
    Python 37 Apache-2.0 28 5 18 Updated Nov 21, 2025
  • llm-compressor Public

    Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

    vllm-project/llm-compressor’s past year of commit activity
    Python 2,259 Apache-2.0 291 69 (12 issues need help) 44 Updated Nov 21, 2025
  • vllm-gaudi Public

    Community maintained hardware plugin for vLLM on Intel Gaudi

    vllm-project/vllm-gaudi’s past year of commit activity
    Python 16 Apache-2.0 71 1 61 Updated Nov 21, 2025
  • production-stack Public

    vLLM’s reference system for K8S-native cluster-wide deployment with community-driven performance optimization

    vllm-project/production-stack’s past year of commit activity
    Python 1,972 Apache-2.0 323 90 (3 issues need help) 54 Updated Nov 21, 2025
View all repositories

Sponsors

  • @hippoley
  • @kXborg
  • @bgyukim
  • @G-Research-OSS
  • @kevATin
  • @yankay
  • @brickfrog
  • @GabrielBianconi
  • @imkero
  • @comet-ml
  • @thomas-hiddenpeak
  • @terrytangyuan
  • Private Sponsor
View all