vllm

v0.30.0 latest

A high-throughput and memory-efficient inference and serving engine for LLMs

1M downloads/month
92k stars
Published 7 days ago
Homepage Repository Documentation
Calculating…

Security

Calculating…

Maintenance

Calculating…

Dependencies

Calculating…

Popularity

Calculating…

Security Overview

Current Version

This version has no known vulnerabilities, but there are 20 historical vulnerabilities

Dependencies

Resolving dependency vulnerability information...

Code Overview

Full repository

Preparing to analyze...