2026-11-12
Copilot Studio Multi-Agent Orchestration - Simply Explained

Show notes
Most AI agents fail for one boring reason, and it isn't the model. Microsoft's own guidance says a single agent starts to slip somewhere past thirty or forty things it can do. In this episode of Simply Explained you will learn:
- Why One Busy AI Agent Eventually Breaks Down
- What Multi-Agent Orchestration Really Means
- How the Parent Agent Hands Work to a Specialist
- Child Agents and Connected Agents, Two Ways to Split the Job
- A Real Example, Reviewing an Expense Report
- When You Should Not Split Your Agent
- The Mistakes That Break Multi-Agent Systems
- Where This Fits in Microsoft 365 and Azure
- The Takeaway, and One Question for You
Simply Explained by M365.FM breaks down Microsoft 365, Azure and modern IT topics in clear, jargon-free language. Hosted by Mirko Peters. Become a supporter of this podcast: https://www.spreaker.com/podcast/m365-fm-microsoft-365-azure-cloud-power-platform-ai--6704921/support. This episode includes AI-generated content.
Host: Mirko Peters
Guests
Transcript
Read the full transcript
Welcome to the M365 FM podcast, where we explore the people, ideas and technologies shaping the future of work. Why one busy AI agent eventually breaks down. Most AI agents fail for one boring reason, and it isn't the model. Microsoft's own guidance says. A single agent starts to slip somewhere past thirty or forty things it can do, so the fix isn't a smarter brain. It's a smaller job description split across a small team of specialists. One parent agent decides who handles what, and you can build the whole thing in Copilot Studio without writing a line of code. Welcome to the M365 FM podcast, where we explore the people, ideas and technologies shaping the future of work. By the end, you'll know how the handoff works, what a real one looks like, and the honest limits. Nobody mentions what multi-agent orchestration really means. Start with something you already know. An AI agent is a helper you talk to, and it can answer questions and take actions on your behalf. You build one in Copilot Studio by describing what it should do, giving it documents to read, and connecting it to the systems it needs. That part is genuinely simple, which is exactly why it gets out of hand. The trouble arrives slowly. Imagine one agent answering questions about holiday policy, and then someone asks it to handle laptop problems, and then finance wants it to check invoices to every request sounds small on its own, and each one feels harmless when it lands. Stacked together, they turn one helpful assistant into a generalist that half knows six different jobs. Multi-Agent orchestration is the answer to that drift. Instead of one agent doing everything, you build a small team, a main agent sits at the front door and behind it are specialists who each do one narrow job well. When you ask a question, the main agent works out which specialists should handle it, passes the work over, and then writes you a single reply that pulls the answers together. The main agent has a formal name, Microsoft calls it the parent agent, and sometimes the orchestrator, which is just a word for the one that coordinates the rest. The specialists are the other agents the parent can call, so the plane version sounds almost underwhelming. Multi-Agent orchestration means one agent manages the conversation while several narrower agents do the actual work. You keep the friendly single front door and you move the hard specific jobs behind it. The whole thing then hangs on one small piece of writing, and we'll come to that in a minute, because it decides whether the team works or falls apart. You might think the answer to a struggling agent is a bigger model, but the fix is really a smaller job description. Microsoft's guidance gives the clearest reason to bother. A single agent can hold a surprising amount before it struggles, but the point where it starts choosing the wrong action arrives once that list gets long, and the smarter model doesn't fix a confusing job description. There's a second reason the team shape helps, and it has nothing to do with intelligence. When one agent carries every job, every single change you make carries risk because editing the invoice rules can quietly break the laptop answers for you, split the work and the blast radius shrinks. Since a change to one specialist stays inside that specialist. That's the quiet benefit. Here's the part users actually notice, and it's the reassuring bit. Nothing changes about how they interact with the system because they still talk to one agent. All the routing happens behind the scenes and the person asking the question never sees the team, only the tidy answer that comes back how the parent agent hands work to a specialist. Here's what actually happens. When you type a question, you send one message, the parent agent reads it and it works out what you're really asking for. Then it looks at the specialists available and picks the one whose description fits best. It hands over the task, waits for an answer, and folds that answer into one reply. The part that surprises people is how the parent chooses. It doesn't match your exact words against the script the way older chatbots did. Instead, it reads a short description of what each specialist does and makes a judgment call. So if one specialist is described as the one that checks duplicate expenses and another as the one that checks accounting codes, the parent can tell them apart and send each task to the right place. Picture a message that mixes two problems you write that you can't log in, and in the same breath you ask how many holiday days you have left. The parent splits that request in two. The IT specialist gets the login problem, the HR specialist gets the holiday question and you receive one combined answer instead of two separate conversations. This behaviour has a name and it's worth remembering. It's called generative orchestration and it's the default for new agents in Copilot Studio. In this mode, the agent can use a mix of topics, tools, knowledge sources, and other agents in the same turn. There's an older mode too, called Classic Orchestration, where the agent picks a single topic by matching the phrases you used, and in that mode, other agents don't come into play at all. That difference explains a lot of confusing behavior. If someone tells you their agents never hand off to each other, the setting is usually the reason, and it's a quick thing to check. The choosing happens by description, and that's the detail to hold on to. When two specialists have descriptions that sound alike, the parent can't reliably tell them apart, and routing turns into a guess. The fix sounds almost too easy. Write descriptions that say exactly what each specialist does and what it doesn't do, so the parent has something clear to reason with. One more thing happens on the way out. After the specialists report back, the parent writes the final message and it can shape that message based on everything it gathered. That's why the answer feels like one person talking. Even when three different agents did the digging. There's a catch worth naming here. The parent decides and the parent can decide wrong. A specialist with a fuzzy description or two specialists that overlap will pull the routing, of course, and the system will look broken when it's really just badly labeled child agents and connected agents. Two ways to split the job when you decide to split the work. Copilot studio gives you two kinds of specialist and they behave very differently. Getting this choice right matters more than almost anything else. In the build, a child agent lives inside the parent agent. It shares the parent's tools, its knowledge, and its sign in, and it doesn't get published on its own. You'd use a child agent when you simply want to break a large job into smaller pieces inside one agent, and it works like a helper who sits at the same desk, uses the same files, and answers only to you. A connected agent is a separate agent that stands on its own. It has its own tools, its own knowledge, its own owner, and its own sign in. And it can even be set to use a different model underneath. The parent calls it, much like it would call a single action. A good way to hold the difference is to think of a separate department. You phone when you need their expertise, knowing they handle their own business. The rule of thumb comes down to ownership and reuse if the specialist exists only to tidy up one parent agent, keep it as a child, if another team owns it, or several different agents need to call it, make it a connected agent. Connected agents are also the door to the wider Microsoft world. They can reach other copilot studio agents, and Microsoft is adding connections to agents built in foundry to fabric data agents and to agents built with the Microsoft three hundred sixty five agents SDK. With several of those still in preview, they can also connect to any agent that speaks an open standard called the Agent to Agent Protocol, which reached general availability in April twenty twenty six. That last part is the interesting one, because it means an agent built somewhere else can join your team. The honest cost shows up in two places. Every hand off adds a little delay because a connected agent runs its own planning on top of the parents planning and those layers. Stack splitting also widens the testing and management surface. Since you now look after several moving parts instead of one child, agents keep things tighter while connected agents by you reuse at the price of more moving pieces. There's a middle path worth mentioning because it's how most teams start. you can mix the two inside one solution. A parent can hold a couple of child agents for its own housekeeping, and still call one or two connected agents that other teams own. So you get the tidy internals and the shared specialists in the same build. One limitation catches people out. You can't take an agent that already has connected agents of its own, and also use it as a connected agent for a second parent. It has to stay in one role, so plan the shape of your team before you wire it together. A real example reviewing an expense report. A small example makes all of this concrete. Picture an agent that reviews expense reports built by the community as a teaching case, and follow what happens when an employee drops a spreadsheet into a chat window. The parent agent runs the show. It reads the spreadsheet and turns the rows into something the specialist can work with. Then it hands parts of the job to two child agents, each with a narrow task. The first child agent looks for duplicate expenses. If the same taxi ride appears twice, it reports that the second child agent checks whether each line used the right accounting code. So a restaurant bill coded as hotel and lodging gets flagged with the correct code beside it. There's also a connected agent in this setup, and it's the one that proves the point. It answers questions about the travel policy from a separate policy document. That agent can be used on its own by anyone or called by the parent. When an employee asks whether a particular expense is even allowed, the employee sees one message duplicates wrong codes, and policy answers arrive together in one place. Instead of three separate conversations, the employee has to stitch together by hand. That's the payoff, and it's the reason the extra complexity earns its keep. The employee fixes the flagged items and resubmits, and a review that used to take a slow back and forth over email takes about a minute. One design choice holds the whole thing together, and it's worth repeating. Each specialist has its own knowledge source, and the sources don't overlap. The duplicate checker doesn't read the policy manual, and the policy agent doesn't read the spreadsheet rules. When two specialists search the same documents, one finds the answer first and the second either repeats it or quietly adds nothing. Now compare that to the version with one giant agent. A single agent could do all three jobs in theory, but it would carry the duplicate logic, the accounting codes and the policy document at once past a certain size. That load is exactly what makes the wrong answer come out, which is where this whole topic started. The example also shows why the specialists stay narrow. One checker handles duplicate expenses and reports the result. The other runs a different comparison and reports its own finding. Neither one needs to understand the other's job, and keeping them apart is what makes each of them easy to test and easy to fix on its own, when you should not split your agent. Now for the part that saves you weeks of work. Microsoft's own advice is blunt start with one agent and split it only when you clearly see a reason to. Multi-Agent orchestration is powerful, but it isn't always necessary, and the documentation says to think carefully before adopting it. A clear reason usually shows up as one of three things. The strongest is size. Because an agent with more than thirty or forty things it can do starts to lose the plot, and that's when splitting helps. Ownership comes next. Since HR, IT, and finance all needing to edit the same agent means they'll trip over each other and separate agents with separate owners. Fix that knowledge that pulls in two directions is the last one, where a set of documents keeps surfacing answers meant for a different audience. The counterweight matters just as much because some problems look like they need more agents when they really don't. An outdated document usually needs an update, not a new agent. Tangled instructions need a rewrite. A one off task that someone once handled might belong in a simple automation rather than a brand new agent. The clearest case is the one about knowledge. If you only have one document to search, keep one agent splitting into two specialists who read the same pages adds nothing because the second specialist can't find anything. The first one missed. Multi-Agent work pays off only when the sources are genuinely different, and Microsoft says this plainly in its guidance. So the order of operations stays simple. Try the cheapest fix first, tidy the knowledge, rewrite the instructions, or move one overloaded action out to a flow. Reach for a second agent only when those have failed and a real boundary still remains. There's a slower reason to hold back, and it's a quiet one. More agents means more moving parts, more delay, and more to keep an eye on. Which is why a beginner who splits too early usually spends the first month debugging the wiring instead of improving the answers. One habit helps here more than any rule. Before you build a second agent, write down the single job it will own and the single owner who answers for it. If you can't fill in both blanks, you probably don't need that agent yet. And the blank is telling you what to fix instead. None of this is a reason to avoid the pattern forever. It's a reason to reach for it at the right moment, when the boundary is real and the cheaper fixes have already been tried. The mistakes that break multi-agent systems. If you do split, the same failures show up again and again. Most of them are visible straight from the chat window. Once you know what to look for and each one has a fix, you can apply the same day. The most common one is letting every specialist talk to the user. You ask one question and three agents each send you a partial answer. Which is worse than one messy answer would have been right. A rule into the parent. Instead, only the parent speaks to the user, and every specialist is told plainly that it's a sub agent whose job is to return findings and stay quiet. A close second is handing two specialists the same knowledge source. We covered. Why that fails, and it's worth checking for because duplicated sources are common and stay invisible until an answer comes back thin. The tell is a specialist that keeps agreeing with another one instead of adding anything. Then there's the lazy description, which quietly wrecks routing because the parent chooses by reading descriptions. A vague label like this agent can help with questions turns a decision into a coin toss. Say what each specialist handles and what it should leave alone, and the parent gets far more reliable. Permissions are the one people forget. A connected agent might be able to do things the parent can't, so a handoff can slip past the limit that was meant to protect you. Microsoft's guidance is to treat a call to a connected agent like any other powerful action, and to put a check or a confirmation in front of it when the action is sensitive. The last one is testing only the easy path. Microsoft suggests testing with questions that fit none of your specialists to see whether the system says it doesn't know or invents an answer. That single test catches more problems than a week of happy path clicking ever will. Notice what these have in common. Not one of them is a problem with the model, and every one of them is a problem with instructions, labels, or boundaries. That's good news because those are the things you can fix in an afternoon without retraining anything. There's also a quieter failure that costs teams time. If nobody writes down who owns which connection, two teams end up editing the same wiring and a change one team makes breaks the other team's flow record the owner. When you add the agent not three months later when something quietly breaks and nobody can say who changed it and why. Where this fits in Microsoft three hundred sixty five and Azure. Zoom out for a moment. Where the agents live is what makes this matter. Copilot studio is Microsoft's low code place for building agents, and those agents can surface inside Microsoft three hundred sixty five copilot and teams right where people already work. Connected agents are the bridge to the rest of the stack. A parent agent can call a fabric data agent to reach governed business data, or an agent running in Microsoft Foundry or an agent. Another team built with the Microsoft three hundred sixty five agents SDK. Some of those connections are still in preview, so check the current status before you build on them. Any agent that speaks the Agent to Agent protocol can join in as well. There's a related idea that gets tangled up with this one, so keep them apart. The Model Context Protocol is a standard for plugging tools and data into an agent. It's about connecting to systems, not to other agents. You'll hear the two mentioned in the same breath, and they solve different problems. The limits that matter most sit in two places money and control. Usage is measured in units called copilot. Credits pooled across your whole organization. And more agents and more handoffs mean more of them. On the control side, from July twenty twenty six, Copilot Studio gives every new agent its own Microsoft Entra identity, which is how an administrator can see who owns an agent and what it's allowed to do. That's the point where a multi-agent setup stops being a maker's hobby and becomes something it needs to govern. For a beginner, the practical takeaway is that you rarely work alone on this building a single agent is something you can do by yourself. But the moment agents start calling each other an administrator, a data owner, or an IT team usually joins the picture because identity, cost and access all come into play at once. That's also why the patent shows up in Microsoft's bigger push around agents, Microsoft has been adding ways to inventory agents, give them their own identities and watch what they do. Because a team of agents is a team, you have to manage the takeaway. And one question for you, here's the short version. One agent is a single worker and multi agent. Orchestration gives that worker a small team. The parent agent routes the work and combines the answers. Child agents stay inside the parent and connected agents stand alone and can be reused. Splitting is worth it only when the knowledge or the owners are genuinely different, and the cheapest fix always comes first. The bigger idea is that you stop asking one assistant to be good at everything, and start asking a few assistants to each be good at one thing. That's a smaller, more honest job description, and it's easier to test, easier to fix, and easier to trust. None of it needs code, and none of it needs a bigger model. That's the whole shift. Now I want to hear from you. If you could hand one repetitive job to a specialist agent this week, which job would you pick and why? That one. If this made the topic feel less intimidating, subscribe to M365 FM to master the tools and the mindset shaping the future of work.