lmcache

v0.5.6 latest

A LLM serving engine extension to reduce TTFT and increase throughput, especially under long-context scenarios.

61k downloads/month
12k stars
Published 1 day ago
Homepage Repository Documentation
Calculating…

Security

Calculating…

Maintenance

Calculating…

Dependencies

Calculating…

Popularity

Calculating…

Security Overview

Current Version

This version has no known vulnerabilities, but there are 2 historical vulnerabilities

Dependencies

Resolving dependency vulnerability information...

Code Overview

Full repository

Preparing to analyze...

Dependencies

Direct Deps
40
This package has 40 direct runtime dependencies.
Unique Pkgs
41
This package depends on 41 different packages transitively.
Total Pkgs
40
This package depends on 40 different package versions transitively.
Licenses
1
Top licenses
  • Apache-2.0 — 1 packages
Issues
No known issues
No known issues
Vuln Pkgs
None
No vulnerable packages
Initializing resolution...

Deprecation checks not assessed

Outdated checks not assessed