litellm Model Context Protocol (MCP) Server

GitHub

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing,...

56,207 stars

Python 1 file · ~10,261 tokens #ai-gateway #anthropic #azure-openai #bedrock #gateway #langchain #litellm #llm

litellm MCP Server

MCP server for BerriAI/litellm

Ready-to-Use Client Configurations

{
  "mcpServers": {
    "litellm": {
      "command": "npx",
      "args": [
        "-y",
        "@BerriAI/litellm"
      ]
    }
  }
}

{
  "mcpServers": {
    "litellm": {
      "command": "npx",
      "args": [
        "-y",
        "@BerriAI/litellm"
      ]
    }
  }
}

{
  "mcpServers": {
    "litellm": {
      "command": "npx",
      "args": [
        "-y",
        "@BerriAI/litellm"
      ]
    }
  }
}

{
  "mcpServers": {
    "litellm": {
      "command": "npx",
      "args": [
        "-y",
        "@BerriAI/litellm"
      ],
      "disabled": false,
      "autoApprove": []
    }
  }
}

{
  "mcpServers": {
    "litellm": {
      "command": "npx",
      "args": [
        "-y",
        "@BerriAI/litellm"
      ]
    }
  }
}

docker run -i --rm mcp/litellm