litellm (MCP Server)

GitHub

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

Claude Desktop Configuration

Add to ~/Library/Application Support/Claude/claude_desktop_config.json

{
  "mcpServers": {
    "litellm": {
      "command": "npx",
      "args": [
        "-y",
        "@modelcontextprotocol/server-litellm"
      ]
    }
  }
}