Orchestration guide

Multi-agent orchestration for enterprise integration

How to coordinate several AI agents, deterministic workflows and people across ERP, finance and partner systems, with the patterns, governance and failure handling that keep a multi-agent process safe in production.

Definition. Multi-agent orchestration is the coordination of several AI agents, each responsible for a defined domain, together with deterministic workflows and human approvers, to complete a business process. One component (an orchestrator agent or a workflow engine) owns the overall goal, delegates tasks, tracks their state and decides what happens when a step fails.

Most enterprise processes already cross team and system boundaries: procure-to-pay touches purchasing, receiving, accounts payable and suppliers; hire-to-retire touches HR, IT, payroll and facilities. When AI agents join these processes, the question is not whether one agent can do everything, but how to split the work so that each agent stays narrow, accountable and governable, while the process as a whole still finishes reliably.

When you need more than one agent

Start with one agent and a small set of tools. A single agent is easier to test, secure and explain. Move to multiple agents when at least one of these is true:

If none of these apply, more agents only add latency, cost and failure points.

Five orchestration patterns

PatternHow it worksGood forWatch out for
Supervisor (orchestrator and workers)An orchestrator agent plans, delegates tasks to specialist agents, and combines their results.Exception handling and investigations where the next step depends on findingsThe orchestrator becomes a single powerful point; keep its own tools minimal
Sequential hand-offEach agent finishes its step and hands the case to the next, like a pipeline.Well-understood flows such as intake → validation → postingErrors propagate downstream; validate at each hand-off
Parallel fan-out and fan-inIndependent tasks go to several agents at once; results are aggregated.Credit, stock and compliance checks for one orderPartial failures and timeouts; define what "enough results" means
Event-driven choreographyAgents subscribe to business events and react, with no central coordinator.Loosely coupled domains already connected by an event brokerHard to see the end-to-end state; needs strong tracing
Workflow-led (agent in the loop)A deterministic workflow or integration flow owns the process and calls agents only for judgement steps.Regulated, high-volume or audited processesLess flexible, but the most predictable; often the best default

In practice, enterprises mix these. A common and safe combination is a workflow-led backbone for the steps that must always happen in order, with a supervisor agent handling exceptions that need investigation.

Reference architecture

Multi-agent orchestration reference architectureA trigger starts an orchestrator agent, which delegates A2A tasks to procurement, finance and partner agents. Their MCP tool calls pass through a gateway that consults a policy engine and a human approval inbox before reaching integration flows and systems of record. A trace and audit rail spans all layers. Triggeruser, schedule or business event Orchestrator agentplans · delegates · tracks task state A2A tasks Procurement agentPO, goods receipt Finance agentpayment requests Partner agentsupplier's own platform MCP tool calls MCP & API gatewayidentity · per-tool authorization · limits · redaction Policy engineallow · deny · approve Human approvalAP manager inbox Integration flows & event brokermappings · retries · compensation Systems of recordERP · accounts payable · supplier master · supplier portal Trace and audit: one correlation ID across every agent, tool call, approval and system
The orchestrator never calls systems of record directly. Specialist agents reach them only through the gateway, and the partner agent works on its own platform, reached over A2A.

Three design choices matter most. First, the orchestrator has almost no tools of its own: it plans and delegates, but posting, paying and updating are done by domain agents with narrow permissions. Second, agent-to-agent delegation and tool access are separate channels: A2A for handing tasks between agents, MCP through the gateway for touching systems. Third, policy is evaluated outside the agents, so a manipulated agent cannot talk its way past a rule.

Worked example: a supplier invoice exception

An incoming supplier invoice fails the three-way match against its purchase order and goods receipt. The quantity invoiced is higher than the quantity received, and the total is 48,000.

#WhoWhat happensControl
1Integration flowPublishes an InvoiceMatchFailed event with the invoice, PO and trace ID.Event schema validation
2Orchestrator agentCreates a case and delegates "explain the mismatch" to the procurement agent as an A2A task.Delegation depth limit 2; case budget
3Procurement agentCalls get_purchase_order and get_goods_receipts (read-only). Finds a second delivery not yet posted.Read-only tools; user context of the AP clerk
4Orchestrator agentAsks the supplier's agent over A2A to confirm the delivery. The task moves to input-required until the supplier responds.Signed Agent Card; partner allow-list; response treated as data
5Procurement agentProposes posting the missing goods receipt. Policy requires a warehouse user to confirm.Approval for inventory postings
6Finance agentAfter the match succeeds, calls create_payment_request for 48,000 with an idempotency key.Policy: amount over 10,000 needs approval
7AP managerSees the request, the evidence gathered and the trace, and approves. A different person from the requester.Separation of duties
8Integration flowPosts the payment proposal in ERP and closes the case. The audit log shows every step under one trace ID.Tamper-evident audit

Notice what never happens: the orchestrator does not post anything; the supplier agent's reply cannot trigger a payment on its own; and the finance agent cannot approve its own request. If the supplier had asked to change bank details, the request would leave this process entirely and go to the supplier master-data process, which has its own verification.

Governing a multi-agent process

Delegation chains: permissions only shrink

Every hop from one agent to another should carry the original user's identity and a token whose scope is equal to or narrower than the caller's. OAuth 2.0 Token Exchange (RFC 8693) is the usual mechanism: the gateway exchanges the incoming token for one scoped to the target agent or tool. A worker agent must never gain permissions its delegator lacked.

Agent registry and Agent Cards

Keep a registry of every agent: its owner, purpose, risk tier, allowed tools, allowed delegates and current version. For A2A, publish and verify signed Agent Cards so agents only delegate to peers you have approved, and so a spoofed agent cannot impersonate a trusted one.

Budgets, limits and stop conditions

Human approval and separation of duties

Decide in policy which actions need approval, who may approve, and that the approver differs from the requester. Show approvers the evidence and the trace, not just the agent's summary, because agents can present confident but wrong conclusions. Keep approval requests rare and meaningful; if people approve dozens of low-risk actions a day, they stop reading them.

Shared state and memory

Store case state in a system you control (a workflow engine or case table), not only in agent memory. Treat anything written by another agent or an external party as untrusted input, and do not let one case's context leak into another's.

Reliability and failure handling

Multi-agent processes fail in the same ways distributed integrations do, plus a few new ways. Most classic integration patterns apply directly:

Multi-agent security risks

The OWASP Top 10 for Agentic Applications describes several risks that grow when agents work together:

RiskHow it shows up between agentsControl
ASI01 Agent goal hijackInstructions hidden in a document or partner reply spread from one agent to the nextTreat inter-agent messages as data; policy outside agents; approvals for high-impact steps
ASI03 Identity and privilege abuseA worker agent acts with the orchestrator's broader rightsToken exchange with narrowing scopes on every hop
ASI07 Insecure inter-agent communicationA spoofed agent sends A2A messages a trusted agent acts onSigned Agent Cards, mutual authentication, partner allow-lists
ASI08 Cascading failuresOne agent's retry loop backs up a shared integration flowBudgets, quotas, circuit breakers, depth limits
ASI09 Human-agent trust exploitationAn approver trusts a fluent summary built on fabricated evidenceShow source evidence and trace; keep approvals meaningful
ASI10 Rogue agentsAn agent keeps acting outside its mandateRegistry, per-agent kill switch at the gateway, anomaly alerts

See the OWASP Agentic Top 10 mapped to integration controls for the full list.

Implementation checklist

FAQ

What is multi-agent orchestration?

It is coordinating several AI agents, each responsible for one domain, together with workflows and human approvers, so they complete a business process. One component owns the overall goal, delegates tasks, tracks their state and handles failures.

Should the orchestrator be an AI agent or a workflow engine?

Use a deterministic workflow or integration flow when the steps are known and must always happen in order, and use an orchestrator agent when the next step depends on what earlier steps find. Many enterprises combine them: a workflow backbone with an agent handling exceptions.

How do MCP and A2A fit into multi-agent orchestration?

A2A is used when one agent delegates a task to another agent, including agents on partner platforms. MCP is used when an agent calls a tool or reads data, ideally through a gateway that applies identity and policy. They are complementary.

How do you stop agents from escalating privileges through delegation?

Carry the original user's identity on every hop and exchange tokens so each agent receives a scope equal to or narrower than its caller's. Enforce policy outside the agents, at the gateway and in the downstream APIs.

Sources and further reading

Related guides

Rameshkumar Varanganti

Enterprise Integration Lead and Architect with 20+ years in SAP integration (BTP Integration Suite, CPI, PI/PO, API Management, Event Mesh). Writes about agentic integration, MCP, A2A and AI governance.

← Back to knowledge library