inference
Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.
Repository Details
- Repository: stas00/inference
- GitHub Stars: ⭐ 9,486
- Primary Language: Python
Note: High-volume repository documentation is actively indexed and synchronized by YakaAI.