Repositories list

• vllm

  Public

  vllm-project/vllm’s past year of commit activity
  A high-throughput and memory-efficient inference and serving engine for LLMs

  amdcudainference+ 17pytorchtransformeropenaimoellamagptmodel-serving+ 10

  Python

  •

  Apache License 2.0

  •12k•65k•1.9k•1.3k•Updated Dec 6, 2025Dec 6, 2025

• router

  Public

  vllm-project/router’s past year of commit activity
  A high-performance and light-weight router for vLLM large scale deployment

  Rust

  •

  Apache License 2.0

  •1•8•1•2•Updated Dec 6, 2025Dec 6, 2025

• aibrix

  Public

  vllm-project/aibrix’s past year of commit activity
  Cost-efficient and pluggable Infrastructure components for GenAI inference

  Go

  •

  Apache License 2.0

  •493•4.5k•258•24•Updated Dec 6, 2025Dec 6, 2025

• vllm-ascend

  Public

  vllm-project/vllm-ascend’s past year of commit activity
  Community maintained hardware plugin for vLLM on Ascend

  inferencetransformermodel-serving+ 6mlopsascendllmllmopsllm-servingvllm

  Python

  •

  Apache License 2.0

  •629•1.4k•799•279•Updated Dec 6, 2025Dec 6, 2025

• vllm-omni

  Public

  vllm-project/vllm-omni’s past year of commit activity
  A framework for efficient model inference with omni-modality models

  inferencepytorchtransformer+ 6image-generationdiffusionmodel-servingmultimodalvideo-generationaudio-generation

  Python

  •

  Apache License 2.0

  •79•684•41•27•Updated Dec 6, 2025Dec 6, 2025

• tpu-inference

  Public

  vllm-project/tpu-inference’s past year of commit activity
  TPU inference for vLLM, with unified JAX and PyTorch support.

  Python

  •

  Apache License 2.0

  •53•178•17•68•Updated Dec 6, 2025Dec 6, 2025

• ci-infra

  Public

  vllm-project/ci-infra’s past year of commit activity
  This repo hosts code for vLLM CI & Performance Benchmark infrastructure.

  HCL

  •

  Apache License 2.0

  •48•27•0•26•Updated Dec 6, 2025Dec 6, 2025

• guidellm

  Public

  vllm-project/guidellm’s past year of commit activity
  Evaluate and Enhance Your LLM Deployments for Real-World Inference Needs

  Python

  •

  Apache License 2.0

  •105•733•43•19•Updated Dec 6, 2025Dec 6, 2025

• llm-compressor

  Public

  vllm-project/llm-compressor’s past year of commit activity
  Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM

  sparsitycompressionquantization

  Python

  •

  Apache License 2.0

  •306•2.3k•77•46•Updated Dec 6, 2025Dec 6, 2025

• vllm-neuron

  Public

  vllm-project/vllm-neuron’s past year of commit activity
  Community maintained hardware plugin for vLLM on AWS Neuron

  Python

  •1•13•0•0•Updated Dec 6, 2025Dec 6, 2025

• vllm-spyre

  Public

  vllm-project/vllm-spyre’s past year of commit activity
  Community maintained hardware plugin for vLLM on Spyre

  Python

  •

  Apache License 2.0

  •30•37•4•15•Updated Dec 5, 2025Dec 5, 2025

• speculators

  Public

  vllm-project/speculators’s past year of commit activity
  A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM

  Python

  •

  Apache License 2.0

  •20•142•10•19•Updated Dec 5, 2025Dec 5, 2025

• vllm-gaudi

  Public

  vllm-project/vllm-gaudi’s past year of commit activity
  Community maintained hardware plugin for vLLM on Intel Gaudi

  Python

  •

  Apache License 2.0

  •77•19•0•67•Updated Dec 5, 2025Dec 5, 2025

• recipes

  Public

  vllm-project/recipes’s past year of commit activity
  Common recipes to run vLLM

  Jupyter Notebook

  •

  Apache License 2.0

  •98•263•9•9•Updated Dec 5, 2025Dec 5, 2025

• vllm-xpu-kernels

  Public

  vllm-project/vllm-xpu-kernels’s past year of commit activity
  The vLLM XPU kernels for Intel GPU

  C++

  •

  Apache License 2.0

  •15•12•1•5•Updated Dec 5, 2025Dec 5, 2025

• semantic-router

  Public

  vllm-project/semantic-router’s past year of commit activity
  Intelligent Router for Mixture-of-Models

  pythonkubernetesrust+ 17golangmcpfine-tuningenvoyproxypii-detectionmixture-of-modelshuggingface-transformers+ 10

  Go

  •

  Apache License 2.0

  •302•2.4k•97•37•Updated Dec 5, 2025Dec 5, 2025

• compressed-tensors

  Public

  vllm-project/compressed-tensors’s past year of commit activity
  A safetensors extension to efficiently store sparse quantized tensors on disk

  Python

  •

  Apache License 2.0

  •41•214•3•14•Updated Dec 4, 2025Dec 4, 2025

• vllm-openvino

  Public

  vllm-project/vllm-openvino’s past year of commit activity
  Python

  •

  Apache License 2.0

  •10•27•2•0•Updated Dec 4, 2025Dec 4, 2025

• vllm-project.github.io

  Public

  vllm-project/vllm-project.github.io’s past year of commit activity
  JavaScript

  •47•24•0•2•Updated Dec 3, 2025Dec 3, 2025

• production-stack

  Public

  vllm-project/production-stack’s past year of commit activity
  vLLM’s reference system for K8S-native cluster-wide deployment with community-driven performance optimization

  Python

  •

  Apache License 2.0

  •331•2k•93•53•Updated Nov 30, 2025Nov 30, 2025

• flash-attention

  Public

  vllm-project/flash-attention’s past year of commit activity
  Fast and memory-efficient exact attention

  Python

  •

  BSD 3-Clause "New" or "Revised" License

  •2.2k•102•0•18•Updated Nov 21, 2025Nov 21, 2025

• FlashMLA

  Public

  vllm-project/FlashMLA’s past year of commit activity
  C++

  •

  MIT License

  •909•8•0•3•Updated Oct 22, 2025Oct 22, 2025

• media-kit

  Public

  vllm-project/media-kit’s past year of commit activity
  vLLM Logo Assets

  4•6•0•0•Updated Oct 22, 2025Oct 22, 2025

• DeepGEMM

  Public

  vllm-project/DeepGEMM’s past year of commit activity
  DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling

  Cuda

  •

  MIT License

  •767•0•0•0•Updated Sep 29, 2025Sep 29, 2025

• rfcs

  Public
  0•1•0•0•Updated Jun 3, 2025Jun 3, 2025

• vllm-project.github.io-static

  Public archive

  vllm-project/vllm-project.github.io-static’s past year of commit activity
  HTML

  •

  MIT License

  •7•9•0•1•Updated Feb 7, 2025Feb 7, 2025

• vllm-nccl

  Public archive

  vllm-project/vllm-nccl’s past year of commit activity
  Manages vllm-nccl dependency

  Python

  •

  Apache License 2.0

  •3•17•2•0•Updated Jun 3, 2024Jun 3, 2024

• dashboard

  Public

  vllm-project/dashboard’s past year of commit activity
  vLLM performance dashboard

  Python

  •

  Apache License 2.0

  •8•39•0•0•Updated Apr 26, 2024Apr 26, 2024