← Back to Top 100

litellm

Agent Framework

#89

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

litellm is an open-source agent framework AI agent maintained by BerriAI. It ranks #89 on The Agentic Leaderboard with an overall score of 83.7 / 100, scoring 95% on reliability and 71.2% on tool selection quality. The project has 62,951 GitHub stars.

Rank
#89
Score
83.7
Category
Agent Framework
Developer
BerriAI
Reliability
95%
Tool Selection
71.2%
Avg Steps
25
Cost / Task
$0.05
Latency
500ms
GitHub Stars
63k
Mindshare
89.4
View Repository →Share on X

Add this badge to your README

Agentic Leaderboard rank #89
[![Agentic Leaderboard](https://www.theagenticleaderboard.com/badges/litellm.svg)](https://www.theagenticleaderboard.com/agent/litellm)

Rank history

— steady

19 weeks on the board since Mar 11 · best rank #28

#1#99Mar 11Nov 9

Compared to other Agent Framework agents