omlx

GitHub

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

18,558 stars Python #apple-silicon#inference-server#llm#macos#mlx#openai-api
JSON Releases API
Recommended For Your System
oMLX-0.6.0rc1-macos15-sequoia.dmg
735 MB • Version v0.6.0rc1
Download for Windows

All Downloadable Installers by Operating System

Windows (.exe / .msi)
0 files

No Windows-specific binaries in this release.

macOS (.dmg / .pkg)
2 files
oMLX-0.6.0rc1-macos15-sequoia.dmg
735 MB • Universal • 39 dl
Download
oMLX-0.6.0rc1-macos26-27.dmg
757 MB • Universal • 489 dl
Download
Linux (.AppImage / .deb)
0 files

No Linux-specific binaries in this release.

Quick Terminal & Package Manager Commands
brew install omlx
winget install jundot.omlx