tiny-llm Apps & Release Installers

GitHub

A course of learning LLM inference serving on Apple Silicon for systems engineers: build a tiny vLLM + Qwen.

4,168 stars Python Python 1 file ยท ~1,782 tokens #course#large-language-model#llm#python#qwen#qwen2#serving#vllm
JSON Releases API
No Standalone Desktop App (.exe / .dmg) Detected

skyzh/tiny-llm is engineered as a server, cloud service, or developer package. It is primarily deployed via Docker containers or package managers rather than a single desktop executable.

Quick Terminal & Package Manager Commands
brew install tiny-llm
docker run -d --name tiny-llm --restart always skyzh/tiny-llm:latest