evals Docker & Self-Hosted Deployment

GitHub

Evals is a framework for evaluating LLMs and LLM systems, and an open-source registry of benchmarks.

18,413 stars Python Python 1 file · ~18,362 tokens
1. Pull Image (DOCKERHUB) docker pull openai/evals:latest
2. Docker Run (1-Click Launch) docker run -d --name evals --restart always openai/evals:latest
3. Podman Run podman run -d --name evals --restart always openai/evals:latest
4. Skopeo Inspect (Zero-Pull Manifest) skopeo inspect docker://docker.io/openai/evals:latest
5. ORAS Pull (OCI Artifact) oras pull openai/evals:latest
evals/elsuite/multistep_web_tasks/docker/homepage/Dockerfile 
FROM python:3.8-slim-buster

# install wget for container ready check
RUN apt-get update && apt-get install -y wget
WORKDIR /app
COPY . .
COPY docker-entrypoint.sh /docker-entrypoint.sh
RUN pip3 install -r requirements.txt

ENTRYPOINT ["/docker-entrypoint.sh"]