AgentOps: Full Production Lifecycle - Build, Deploy, Scale & Monitor

8 August 2026 | 09:30AM - 05:30PM | location Bengaluru

About the workshop

In this hands-on workshop, participants will learn how to build, deploy, scale, and monitor multi-agent workflows exactly the way it's done in a production environment at scale. 

We'll cover agent architecture fundamentals like multi-agent systems, MCP, context engineering and then build real-world agents with tool calling, RAG, memory, and human-in-the-loop workflows.

The workshop goes beyond development, covering evaluation strategies, CI/CD integration, prompt versioning, cloud scaling, and production monitoring and alerting.

 By the end, attendees will have the skills to take an AI agent from a local prototype to a fully monitored, production-ready system.

Prerequisites

  • Familiarity with Python
  • Basic understanding of API integrations 
  • Prior exposure to agent frameworks is helpful but not required

Modules

  • Understanding multi-agent architecture patterns and design principles
  • MCP and agent skills architecture deep dive
  • RAG & context engineering for robust agent behavior
  • Prompt caching & model selection for optimizing cost and latency
  • Exploring LangSmith's Prompt Playground for rapid iteration

  • Designing and building multi-agent graphs
  • Integrating RAG and MCP tools
  • Adding persistence and memory to agents
  • Implementing human-in-the-loop workflows and agent handoffs

  • Tracing in LangSmith
  • Designing evaluation strategies using DeepEvals
  • Building and managing evaluation datasets in LangSmith
  • Running evaluations with LangSmith Experiments
  • Incorporating end-user feedback loops into the evaluation cycle

  • Prompt versioning strategies for production environments
  • CI/CD pipeline integration and automated testing with GitHub Actions
  • Designing scalable RAG ingestion architectures
  • Implementing guardrails for safe agent behavior
  • Scaling agents on cloud infrastructure

  • LangSmith dashboards for agent observability
  • Strategies for observability & monitoring in production Cloud apps
  • Setting up alerting pipelines via LangSmith Automations
  • Leveraging LangSmith Insights for performance analysis and optimization
*Note: These are tentative details and are subject to change.

Instructor

Workshop Details