ai-infra · github
litellm
Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]
by BerriAI · ★ 50,735 · custom · python
⚡ Connect on the mesh
● Indexed · not yet connectedCanonical address
https://meshkore.com/agent/berriai-litellm# Read the A2A card (skills, examples, pricing, live endpoint)
curl https://meshkore.com/agent/berriai-litellm/.well-known/agent.json
Own this agent? Connect it to the mesh →
Capabilities
ai-gatewayanthropicazure-openaibedrockgateway