Enterprise Agent Systems: From Foundations to Deployment

About the Workshop

This full-day, hands-on workshop is for those who want to go beyond basic chat applications and learn how to build, extend, orchestrate, and deploy enterprise-ready AI agents on Azure. Participants will work with Azure AI Foundry, Foundry Agent Service, Foundry IQ, and the Microsoft Agent Framework to create agents, integrate built-in and external tools such as File Search, Code Interpreter, Bing Grounding, custom functions, and MCP servers, and design multi-agent workflows using visual orchestration, code-first patterns, connected agents, and A2A. Across four hands-on labs, learners will build working agents, connect tools and knowledge sources, explore when to use Foundry Agent Service versus Microsoft Agent Framework, and apply production best practices for monitoring, security, deployment, governance, scaling, and cost management. By the end, they will have a practical understanding of how to choose the right Azure-based agent architecture and build real-world agent systems confidently.

Prerequisites

  • Azure subscription - Create a free account if needed

  • Python 3.10+ installed

  • VS Code with the Python extension

  • Azure CLI installed and signed in (az login)

  • Azure Developer CLI (azd) installed

  • Docker Desktop installed (for hosted agent lab)

  • Node.js 18+ installed (for MCP server lab)

Workshop Modules

  • What are AI Agents?

    • From chatbots to autonomous agents — the evolution
    • Key characteristics: reasoning, tool use, memory, planning
    • Agent design patterns: ReAct, tool-augmented generation, multi-agent
  • The Azure AI Agent Platform

    • Azure AI Foundry — portal, projects, and resource model

    • Model catalog — GPT-4o, Llama, DeepSeek, Cohere, and more

    • Two pillars for building agents: Foundry Agent Service & Microsoft Agent Framework

  • Key Protocols & Standards

    • MCP (Model Context Protocol) — open standard for tool integration
    • A2A (Agent-to-Agent) — standardized inter-agent communication
    • How MCP and A2A fit into the Azure AI ecosystem

  • Set up the development environment
  • Create an Azure AI Foundry project
  • Build and run a prompt agent using the Python SDK
  • Interact with the agent through threads and conversations

Lecture: The Agent Tool Ecosystem

  • Built-in Tools Overview : Code Interpreter, File Search, Bing Grounding, Azure Functions, OpenAPI, MCP Servers, and Memory
  • Model Context Protocol (MCP) — Deep Dive
    • What is MCP? Open standard for tool integration with LLMs
    • MCP in Foundry Agent Service: connect remote MCP servers as tools
    • MCP tool catalog: Azure DevOps, GitHub, and custom servers
    • Authentication, approval workflows, and security best practices
    • Exposing your own services as MCP servers via Azure Functions
  • Foundry IQ — Enterprise Knowledge Layer

    • What is Foundry IQ? Managed knowledge layer for enterprise data

    • Knowledge bases and knowledge sources (Azure, SharePoint, OneLake, Web)

    • Agentic retrieval engine — multi-query, iterative search with reasoning

    • Connecting Foundry IQ knowledge bases to agents

    • Foundry IQ vs. File Search vs. Azure AI Search — when to use which

  • Function Calling — Define custom functions the agent can invoke

  • Tool selection best practices — When to use which tool

Lab Steps

  1. Code Interpreter & File Search

    • Attach Code Interpreter to your agent for data analysis
    • Upload documents and query them with File Search
  2. Connect an MCP Server

    • Connect the GitHub MCP server to your agent
    • Configure server_labelserver_url, and authentication headers
    • Ask the agent to query GitHub repositories
    • Review MCP tool call approval and auditing
  3. Foundry IQ Knowledge Base

    • Create a Foundry IQ knowledge base in the portal
    • Connect knowledge sources (sample documents)
    • Attach the knowledge base to your agent
    • Test agentic retrieval with citation-backed answers
  4. Bing Grounding + Custom Functions

    • Create an agent with Bing Grounding for real-time web search
    • Define and attach a custom function

  • What is Microsoft Agent Framework?
  • Agent Framework Architecture: Agents, Workflows, Model Clients, Session, Context Providers, Middleware
  • Tools & MCP in Agent Framework
  • A2A Protocol in Agent Framework
  • Hosting Options: A2A Protocol, OpenAI-Compatible Endpoints, Azure Functions (Durable), AG-UI Protocol
  • Agent Framework vs. Foundry Agent Service — Choosing the Right Approach

  • Build an agent using the Microsoft Agent Framework SDK
  • Integrate MCP tools (local and remote)
  • Connect to a remote A2A agent
  • Compare the Agent Framework experience with Foundry Agent Service

  • Why Multi-Agent?

    • Single agent limitations
    • Specialization, delegation, and collaboration patterns
    • When to use multi-agent vs. a single agent with many tools
  • Foundry Workflows — Visual Multi-Agent Orchestration

    • What are workflows? Declarative, UI-based agent orchestration

    • Workflow patterns: Sequential, Group Chat and Human in the Loop

    • Creating workflows in the Foundry portal

    • Workflow YAML editing in VS Code

    • Workflow versioning, change logs, and visual monitoring

  • Agent Framework Workflows — Code-First Orchestration

    • Graph-based workflow architecture

    • Key features: type safety, conditional routing, parallel processing, checkpointing

    • Orchestration patterns: sequential, concurrent, hand-off, magentic

    • Human-in-the-loop with request/response patterns

    • Comparing Foundry Workflows vs. Agent Framework Workflow

    • Connected Agents in Foundry

    • Architecture: main agent + connected agents
    • How connected agents communicate and aggregate responses
    • The ConnectedAgentTool API
  • A2A Protocol for Cross-System Agent Communication

    • A2A protocol specification: agent cards, message-based communication, tasks

    • A2A in Foundry Agent Service — connecting external agent endpoints

    • A2A in Agent Framework — A2AAgent for cross-framework interop

    • A2A vs. Connected Agents — choosing the right approach

  • Hosted Agents

    • Containerized agents with Agent Framework or LangGraph
    • Docker + Azure Developer CLI (azd) deployment
    • When to choose hosted agents vs. prompt agents

  • Build a Foundry Workflow with multiple agents (visual orchestration)
  • Build a code-first workflow with Microsoft Agent Framework
  • Connect agents across systems using the A2A protocol

  • Observability & Monitoring

    • End-to-end tracing with Application Insights
    • Monitoring agent decisions, tool calls, and token usage
    • Agent Framework telemetry and middleware-based logging
    • Setting up alerts for failures and performance degradation
  • Security & Identity

    • Microsoft Entra authentication and RBAC
    • Content filters and safety guardrails
    • MCP security best practices: allow-lists, approval workflows, auditing
    • A2A authentication with AuthInterceptor
    • Virtual network isolation and data protection
    • Managed credentials and On-Behalf-Of (OBO) authentication
  • Deployment & Scaling

    • Agent versioning and stable endpoints
    • Hosted agents: Docker + azd deployment to Foundry
    • Agent Framework hosting: Azure Functions (Durable), Container Apps
    • Publishing to Microsoft Teams and Microsoft 365 Copilot
    • Entra Agent Registry for enterprise discovery
  • Foundry IQ in Production

    • Connecting multiple knowledge sources at scale

    • Permission-aware retrieval and data governance

    • Foundry IQ vs. Fabric IQ vs. Work IQ — choosing the right IQ layer

  • Cost Management

    • Understanding token consumption and tool call costs
    • MCP tool call billing and Bing transaction costs
    • Optimizing agent instructions for efficiency
    • Monitoring usage with Azure Cost Management
  • Choosing Your Architecture

  • What's Next?

Instructor

Workshop Details