LLM-Engineers-Handbook Docker & Self-Hosted Deployment

GitHub

The LLM's practical guide: From the fundamentals to deploying advanced LLM and RAG apps to AWS using LLMOps best practices

5,017 stars Python Python 1 file · ~8,271 tokens #aws#fine-tuning-llm#genai#llm#llm-evaluation#llmops#ml-system-design#mlops
RAW Compose
1. Pull Image (DOCKERHUB) docker pull library/mongo
2. Docker Run (1-Click Launch) docker run -d --name llm-engineers-handbook -p 27017:27017 --restart always mongo:latest
3. Podman Run podman run -d --name llm-engineers-handbook -p 27017:27017 --restart always mongo:latest
4. Skopeo Inspect (Zero-Pull Manifest) skopeo inspect docker://docker.io/library/mongo:latest
5. ORAS Pull (OCI Artifact) oras pull mongo:latest
6. Compose Deployment docker compose up -d
docker-compose.yml
Download .yml 
services:
  mongo:
    image: mongo:latest
    container_name: "llm_engineering_mongo"
    logging:
      options:
        max-size: 1g
    environment:
      MONGO_INITDB_ROOT_USERNAME: "llm_engineering"
      MONGO_INITDB_ROOT_PASSWORD: "llm_engineering"
    ports:
      - 27017:27017
    volumes:
      - mongo_data:/data/db
    networks:
      - local
    restart: always

  qdrant:
    image: qdrant/qdrant:latest
    container_name: "llm_engineering_qdrant"
    ports:
      - 6333:6333
      - 6334:6334
    expose:
      - 6333
      - 6334
    volumes:
      - qdrant_data:/qdrant/storage
    networks:
      - local
    restart: always

volumes:
  mongo_data:
  qdrant_data:

networks:
  local:
    driver: bridge