Skip to main content

vLLM Semantic RouterDocumentation Publications Blog News

vLLM-SR Team
Work Groups
Membership Promotion
Contributing Guide
Code of Conduct
GitHub Discussions
GitHub Issues

v0.1

GitHub 🤗 Hugging Face

Recent Posts

2025

vLLM Semantic Router + Milvus: How Semantic Routing and Caching Build Scalable AI Systems the Smart Way
Semantic Router Q4 2025 Roadmap: Journey to Iris
vLLM Semantic Router: Next Phase in LLM inference

Tags

A

ai-systems1
announcement1

C

caching1

I

iris1

M

milvus1

R

release1
roadmap1

S

scalability1
semantic-router2

V

v0.11
vllm1

W

welcome1

Documentation

Installation
Architecture
API Reference

Community

GitHub
Hugging Face

More

License
Contributing

Copyright © 2025 vLLM Semantic Router Team. Built with Docusaurus.