TensorRT-LLM, every mention
1 scene (2024) · ← back to TensorRT-LLM
tap a year for its mentions
every year 2024 anyone Yining Zhang 10Kyle Kranen 2Chris Lattner 2Stefano Ermon 1Ben Firshman 1Ali Taha 1
Verbatim, from the transcripts: the passages where TensorRT-LLM comes up
A Brief History of the Open Source AI Hacker - with Ben Firshman of Replicate
- ▶ 1:06:35 Ben Firshman Um, we've, um, we've had success using inference servers like VLM and TRT LLM, um, and we're using those kind of things to serve language models.