Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks
open-compass/VLMEvalKit is engineered as a server, cloud service, or developer package. It is primarily deployed via Docker containers or package managers rather than a single desktop executable.
Topic hubs, agent specifications, and quick tools