inference
GitHubSwap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.
Claude Desktop Configuration
Add to ~/Library/Application Support/Claude/claude_desktop_config.json
{
"mcpServers": {
"inference": {
"command": "npx",
"args": [
"-y",
"@modelcontextprotocol/server-inference"
]
}
}
}