VLMEvalKit Apps & Release Installers

GitHub

Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks

4,114 stars Python Python 1 file · ~12,318 tokens #chatgpt#claude#clip#computer-vision#evaluation#gemini#gpt#gpt-4v
JSON Releases API
No Standalone Desktop App (.exe / .dmg) Detected

open-compass/VLMEvalKit is engineered as a server, cloud service, or developer package. It is primarily deployed via Docker containers or package managers rather than a single desktop executable.

Deploy with Docker
Copy intact docker-compose.yml and launch with 1-click Docker run.
Full Documentation
Explore setup instructions, configuration flags, and API specs.
Browse Desktop Apps
Discover verified standalone software and installable tools.
Quick Terminal & Package Manager Commands
brew install VLMEvalKit
docker run -d --name VLMEvalKit --restart always open-compass/VLMEvalKit:latest