OpenLLM Model Context Protocol (MCP) Server
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
12,561 stars
Python
1 file · ~2,288 tokens
#bentoml#fine-tuning#llama#llama2#llama3-1#llama3-2#llama3-2-vision#llm
OpenLLM MCP Server
MCP server for bentoml/OpenLLM
Ready-to-Use Client Configurations
{
"mcpServers": {
"OpenLLM": {
"command": "npx",
"args": [
"-y",
"@bentoml/OpenLLM"
]
}
}
}