omlx

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

18,558 stars Python #apple-silicon #inference-server #llm #macos #mlx #openai-api

RAW Rules

This repository does not currently contain dedicated AI agent rule files (.cursorrules, CLAUDE.md, AGENTS.md).