BentoML Apps & Release Installers

GitHub

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

8,634 stars Python Python 1 file · ~26,512 tokens #ai-inference#deep-learning#generative-ai#inference-platform#llm#llm-inference#llm-serving#llmops
JSON Releases API
No Standalone Desktop App (.exe / .dmg) Detected

bentoml/BentoML is engineered as a server, cloud service, or developer package. It is primarily deployed via Docker containers or package managers rather than a single desktop executable.

Deploy with Docker
Copy intact docker-compose.yml and launch with 1-click Docker run.
Full Documentation
Explore setup instructions, configuration flags, and API specs.
Browse Desktop Apps
Discover verified standalone software and installable tools.
Quick Terminal & Package Manager Commands
brew install BentoML
docker run -d --name BentoML --restart always bentoml/BentoML:latest