Karan Vaidya: Composio runs an internal agent to build and evaluate skills
Karan Vaidya · ⚡️Composio: 10,000+ tools that evolve for Agents — Karan Vaidya and Soham Ganatra · Aug 4, 2025 · at 5:38
Karan Vaidya, co-founder of Composio, explains to Swyx how Composio benchmarks and evaluates evolving tool capabilities for AI agents.
0:00 / 0:17exact quote · 17.8s
▶ Watch the full episode on YouTube → 720p mp4 · rendered on demand · StarZero watermark
“We have an agent essentially, which builds a lot of these skills and kind of like does a lot of like testing as well as eval. So it's like, you can say like agent as an eval where our internal agent uses these tools and kind of like we figured out where it is messing up and improve our time, even asking agent what we can do better.”
quote is from the automated transcript, cleaned for reading: filler sounds and stutters are removed, nothing is rephrased. names can be misheard (the analysis reads context, assessments check outside sources). how →
More from Karan Vaidya
Vaidya: Composio evolves agent skills by analyzing usage patterns
“We are kind of self evolving skills now for agents. So people building or using agents want to like basically make Agents interact with their apps. They can use Composio. We manage all the authentication and user account related stuff for them so that they don…”