tensorrt-llm

v1.3.0 latest

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs.

5k downloads/month
15k stars
Recorded licensing details

pypi_metadata — license

NVIDIA Software License Agreement, Apache License 2.0, and others
Published 2 days ago
Calculating…

Security

Calculating…

Maintenance

Calculating…

Dependencies

Calculating…

Popularity

Calculating…

Security Overview

Current Version

1 issues

This version has 1 known vulnerability

Dependencies

Resolving dependency vulnerability information...

Code Overview

Full repository

Preparing to analyze...