StarZero All shows Try the podcast clipper →

Gateway

2 statements across 1 episodes · 2 bullish · 0 bearish · 1 people on the record · first statement Feb 5, 2025 by Rohit Agarwal · across every show →

Everything said about Gateway, oldest first

Feb 5, 2025 positive
Assertion Partly supported
Agarwal: Portkey open source gateway has a 21 MB memory footprint
“So the gateway, when it runs, has a memory footprint of like, 21 MB, and the way we've been able to do it is just using a very interesting architecture where we're using transformers in JSON to do everything out of the box.”
Rohit Agarwal Feb 5, 2025 ▶ 6:14 Why every AI Engineer needs an AI Gateway (ft Portkey.ai CEO)
Feb 5, 2025 positive
Insight
Agarwal: Gateways produce the best LLM metrics without manual codebase instrumentation
“We're saying that the best LLM metrics can be produced directly on the gateway. Without every team having to instrument their own code bases to pick out these metrics.”
Rohit Agarwal Feb 5, 2025 ▶ 15:01 Why every AI Engineer needs an AI Gateway (ft Portkey.ai CEO)
Made with StarZero

Turn any episode into a week of clips.

This entire site, over 200 episodes transcribed, diarized, checked and made playable, runs on the StarZero media pipeline. Drop in your own episode and the podcast clipper finds the moments worth sharing, cuts them, captions them, and reframes them for every feed.

Try the podcast clipper Learn more