agents-towards-production Documentation

End-to-end, code-first tutorials for building production-grade GenAI agents. From prototype to enterprise deployment.

21,223 stars Jupyter Notebook 1 file ยท ~3,887 tokens #agent#agent-framework#agentic-ai#agents#ai-agents#deployment#genai#generative-ai
RAW Doc

๐ŸŽ“ From prototype to production, as a method



๐Ÿ’ฌ Join Our Community

Stay connected with the latest in GenAI and agent development:

r/EducationalAI

Join our growing community discussing cutting-edge AI research, agent development, and production insights!


โœจ Introduction

Agents Towards Production is your hands-on guide to every building block of a GenAI agent stack.
All knowledge is delivered through runnable tutorials covering orchestration, memory, observability, deployment, security, and more. Each tutorial lives in its own folder with ready-to-run notebooks or code files, so you can move from concept to working agent in minutes.


๐Ÿ—๏ธ AI Agent Architecture


๐Ÿ“š Tutorials

๐Ÿ”Œ Tool Integration

Tutorial Description View
Secure Tool Calling (Arcade) Enable agents to securely call external tools (Gmail, Slack, Notion) with OAuth2 authentication and human-in-the-loop safety controls. Learn production-ready tool integration with user isolation and approval workflows.

๐Ÿ“Š Data Processing

Tutorial Description View
Agent File Conversion, Locally and Privately (hushvert) Give agents file-conversion abilities with a two-lane setup: an open-source WebAssembly engine converts images, HEIC, audio, and archives on the user's device, while an MCP tool call handles office documents and PDF-to-markdown. Includes an honest fidelity benchmark against popular extractors.
Web Data Collection for AI Agents (Bright Data) Build agents that collect and process web data at scale using enterprise-grade scraping infrastructure. Learn to integrate proxy networks, handle CAPTCHAs, and extract structured data from complex websites.
Real-Time Web Data Integration for Agents (Tavily) Enable agents to access, search, and extract real-time web data. Build workflows that combine live web information with private knowledge for research, monitoring, and up-to-date recommendations.

๐Ÿ” RAG & Knowledge Management

Tutorial Description View
Production-Ready RAG Agents with Contextual AI (Contextual AI) Build enterprise-grade RAG systems in 15 minutes using Contextual AI's managed platform. Learn document processing, intelligent indexing, agent deployment, and automated evaluation with LMUnit testing framework for financial document analysis.

๐Ÿง  Memory

Tutorial Description View
Agent Memory: Dual-Memory & Semantic Search (Redis) Implement dual-memory (short-term and long-term), semantic search, and persistent state for agents that remember user preferences and learn from conversations.
Self-Improving Memory with Mem0: Hybrid Vector & Graph Storage Build intelligent agents with self-improving memory that automatically extracts insights, resolves conflicts, and evolves with each interaction. Learn hybrid memory architecture combining vector search for semantic recall and graph databases for relationship mapping.
AI Memory with Cognee Build intelligent AI memory systems that learn from Python's creator and improve your development workflow. Transform scattered development data into unified knowledge graphs with contextual insights.

๐Ÿš€ Deployment

Tutorial Description View
AWS Bedrock AgentCore: Managed Agent Deployment Deploy and manage AI agents on AWS Bedrock AgentCore Runtime. Learn to transform local agents into production-ready managed services with automatic infrastructure, request tracking, and standardized communication patterns.
Containerizing Agents with Docker Containerize agents for portability and scalability. Learn foundational patterns for running agents in containers across environments.
On-Prem LLM Deployment with Ollama Run and interact with large language models locally. Replace cloud APIs with on-prem models for privacy, cost control, and low-latency agent workflows.

๐Ÿ‘ฅ Multi-agent Coordination

Tutorial Description View
Multi-Agent Communication with A2A Protocol Simulate collaborative agent workflows and message exchange using open communication protocols for interoperability.

๐Ÿš€ GPU Deployment

Tutorial Description View
Scalable GPU Deployment for AI Agents (Runpod) Deploy AI agents on scalable GPU infrastructure. Learn to set up cost-effective, high-performance environments for demanding agent workloads.

๐Ÿ”’ Security

Tutorial Description View
Comprehensive Agent Security (LlamaFirewall) Apply comprehensive input, output, and tool security guardrails for agents. Covers prompt injection, behavior alignment, and tool access control.
Hands-On Agent Security Evaluation (Apex) Hands-on prompt injection attacks, defenses, and automated security testing for AI agents.

๐Ÿ‘ฅ Multi-agent Coordination

Tutorial Description View
Multi-Agent Communication with A2A Protocol Simulate collaborative agent workflows and message exchange using open communication protocols for interoperability.

๐Ÿงฉ Agent Frameworks

Tutorial Description View
Tool & API Integration via Model Context Protocol (MCP) Integrate agents with external tools and APIs using a standardized protocol. Example: Seamless tool and API integration for advanced agent workflows.
Stateful Agent Workflows with LangGraph Design complex, stateful agent workflows using a directed graph architecture. Example: Multi-step text analysis pipeline with classification, entity extraction, and summarization.
Deploying Agents as APIs with FastAPI Create and deploy agents as performant APIs, supporting both synchronous and streaming endpoints.
Building AI Agents in Kotlin with Koog Build your first AI agent in Kotlin using JetBrains' Koog framework. Step-by-step from hello world to tool calling and structured output in under 30 minutes.

๐Ÿ› ๏ธ Model Customization

Tutorial Description View
Fine-Tuning AI Agents for Domain Expertise & Efficiency Learn how to fine-tune language models for specialized agent behavior, domain expertise, and efficient, cost-effective responses. Covers data preparation, training, evaluation, and integration into agent workflows.

๐Ÿ” Tracing & Debugging

Tutorial Description View
Agent Tracing & Debugging with LangSmith Add comprehensive observability to AI systems. Capture detailed traces, decision points, and timing data to debug, monitor, and systematically improve agent performance.

๐Ÿ“Š Evaluation

Tutorial Description View
Automated Agent Evaluation & Behavioral Analysis (IntellAgent) Automate agent evaluation with behavioral analysis, performance metrics, and actionable insights for improving agent quality.

๐Ÿ–ฅ๏ธ UI & Frontend

Tutorial Description View
Building a Chatbot UI with Streamlit Build a beginner-friendly chatbot web app with a chat interface, file upload, and session state for interactive agent demos.

๐Ÿš€ Getting Started

Transform your AI agent ideas into production-ready systems using our battle-tested patterns and implementations.

๐Ÿ“– Browse Online

Explore tutorials directly on GitHub to understand production-grade implementations, architectural decisions, and integration patterns. Each tutorial includes comprehensive documentation and code that you can study and adapt to your specific requirements without any local setup.

๐Ÿ› ๏ธ Clone and Build

Download the repository to run tutorials locally, experiment with configurations, customize implementations, and integrate proven patterns directly into your agent development workflow.

Quick Setup

1. Get the Code

bash
git clone https://github.com/NirDiamant/agents-towards-production.git
cd agents-towards-production

2. Install Dependencies
Navigate to your target tutorial and set up the environment:

bash
# Example: Multi-tool agent orchestration
cd tutorials/agentic-applications-by-xpander.ai
pip install -r meeting-recorder-agent/requirements.txt

3. Deploy and Test
Launch tutorials through their preferred interface:

bash
# Run interactive notebooks for experimentation
jupyter notebook tutorial.ipynb

# Execute production scripts for integration testing
python app.py

This list contains Amazon affiliate links. As an Amazon Associate I earn from qualifying purchases. Every book below is one I've read and genuinely recommend to engineers working in this space. The companion book to this repo is featured separately at the top of this README.


๐Ÿ“š More from the same author

Prompt Engineering: Master the Art of AI Interaction - the prompting foundation, 22 hands-on techniques.

Run a course, newsletter, or dev community? You can earn 25% recommending RAG Made Simple to your audience.

๐Ÿค Contributing

We welcome contributions of tools, infrastructure, and frameworks that support agent development. This includes monitoring, deployment platforms, security tools, databases, APIs, and other horizontal services that enable production agent systems.

Please see our Contributing Guidelines for more details.


โš ๏ธ Disclaimer

Educational use only. Authors disclaim all responsibility for use, misuse, or consequences. We do not endorse, verify, or guarantee third-party companies, tools, or services referenced herein. Not liable for damages, losses, security breaches, or fraudulent activities by referenced parties.

Your responsibility: Conduct due diligence, verify legitimacy, test in isolation, ensure legal compliance. Security tools require ethical use with proper authorization.

By using this repository, you agree to this disclaimer.


๐Ÿ“œ License

This project is licensed under a custom non-commercial license - see the LICENSE file for details.