AI agents

An agentic mesh is five pieces of plumbing, not a product

Direct wiring between two agents is fine. The same wiring between nine is the reason the word exists.

Open Dimension AI7 min read

What is an agentic mesh?

An agentic mesh is an architecture where many AI agents, tools and data sources interoperate through shared infrastructure rather than point-to-point wiring: one registry, one identity model, one policy layer, one audit trail. It is a pattern, not a product, and most teams need it only after their third or fourth agent.

The short version

  • An agentic mesh is shared infrastructure for many agents: discovery, identity, policy, transport and audit, held in one place instead of inside each agent.
  • The cost a mesh removes is not compute. It is the duplicated credentials, bespoke wiring and missing audit trail that accumulate once you have more than two agents.
  • A service mesh moves requests between deterministic services. An agentic mesh moves work between components that can be confidently wrong, so recording and evaluation are part of the layer, not an add-on.
  • Below about three agents, a mesh costs more than the coupling it removes.
  • The first thing to build is not the mesh. It is a per-agent credential and a traced record of every tool call.

What is an agentic mesh?

It is the shared layer underneath several agents, holding the things that would otherwise be duplicated inside each one: how agents and tools are discovered, who an agent is when it acts, what it is permitted to do, how work travels between components, and what gets recorded afterwards. Five concerns, moved out of the agents and into one place. That is the whole idea.

The name is borrowed from service mesh and data mesh, and it carries the same argument. Once you have more than a couple of components, the difficult part stops being any individual component and becomes the relationships between them. Nine agents wired directly to each other is not nine problems, it is up to seventy two directed edges, each with its own credentials, its own retry behaviour and its own idea of what counts as a failure.

Nobody sells you a mesh. You can buy parts: a gateway, a tracing backend, a registry, a policy engine, a queue. The parts that matter most are decisions rather than software, such as which agent may act on behalf of which user, and what an agent is allowed to remember. Those do not arrive in a package, because they are specific to your organisation.

What problem does an agentic mesh actually solve?

It solves the questions you cannot answer after something goes wrong. Three agents in production, each with its own API key, its own retry loop and its own log format. Finance asks why last week cost four times the week before. Support asks which component told a customer their policy covered something it did not. Both questions need one ordered record across three systems, and nobody built it, because when there was one agent the answer was obvious.

The second problem is permission creep across edges. The moment agent A can call agent B, anyone who can reach A has, in effect, the permissions of B. With two agents that is one relationship somebody thought about. With six it is thirty, and whoever is deciding them is usually doing it in prompt text, where a decision is only a suggestion. A mesh exists so that the answer lives somewhere a model cannot talk its way past.

The third problem is duplicated effort nobody notices. Two teams build the same reconciliation agent. A third team calls the older one. The tool descriptions drift apart. None of this shows up as an outage, which is why it runs for months.

What are the five parts of an agentic mesh?

Discovery, identity, policy, transport and observability. Discovery is the register of what exists and what it is for. Identity is who is acting, the human or the agent, and on whose behalf. Policy is which caller may invoke which tool for which user. Transport is how work moves and what happens when a hop fails. Observability is the ordered record of what happened, including what it cost.

Most teams already have weak versions of all five, scattered across a codebase. A README is a registry. A shared service account is an identity model, just a poor one. The question is never whether you have these things. It is whether they live in one place you can change, or in nine places you have to find first.

Where each part shows up when it is missing

PartThe question it answersWhat its absence looks like
DiscoveryWhat agents and tools exist, and what are they for?Two teams build the same agent, and a third calls the deprecated one.
IdentityWho is acting, the user or the agent, and for whom?Every call reaches the database as one service account, so the audit log says nothing useful.
PolicyWhich caller may invoke which tool, on whose behalf?The rules live in prompt text, where they can be argued with.
TransportHow does work travel, and what happens when a hop fails?Each agent invents its own retry, and one slow tool becomes a thundering herd.
ObservabilityWhat happened, in what order, and what did it cost?Three sets of logs, no shared trace id, no way to reconstruct a bad answer.

How is an agentic mesh different from a service mesh?

The difference is how the components fail. A service mesh moves requests between deterministic services whose errors are loud: a timeout, a 500, a refused connection. An agentic mesh moves work between components that fail quietly, returning a confident and wrong answer with a 200 attached. Infrastructure built for loud failures will report that everything is healthy while the output is nonsense.

That changes what the layer has to carry. Status codes and latency are not enough, so inputs and outputs have to be recorded, which immediately raises a retention question the service mesh never asked. Contracts are semantic as well as structural: 'returns a refund decision' is a promise about meaning, and no type checker verifies it, so the only real contract is an evaluation set that runs when either side changes.

Retries change too. Retrying an idempotent read costs a little latency. Retrying an agent that already sent the email, issued the credit or filed the ticket costs something you cannot take back. In a system of agents, idempotency belongs at the tool boundary, keyed by an action id the tool recognises as a repeat, because the layer above will retry and the model will not remember that it already succeeded.

When is an agentic mesh the wrong thing to build?

When you have fewer than about three agents running, which is most teams. With two agents, the mesh is a function call and one log table. Building a registry, a policy engine and a transport layer before that means choosing the shape of your infrastructure before you know the shape of the work, and the specifics only appear in production: which tool gets hammered, which handoff produces the bad answers, which boundary someone actually tries to cross.

Guessed infrastructure gets routed around. A platform team ships the mesh, a product team needs one thing it does not do, and within a month there are two paths for everything and the audit trail covers the quieter one.

Available budget makes this easy to get wrong in the expensive direction. Deloitte's 2025 survey of 548 decision-makers at director level or above, at organisations with at least US$500 million in annual revenue, reported digital budgets rising while investment strategies may need recalibration. Money being available is not the same as a mesh being the next thing to build.

What does the published evidence say about multi-agent adoption?

It says large enterprises expect to do more of it, and very little about what is running today. Salesforce and MuleSoft's Connectivity Benchmark projects multi-agent adoption to surge 67% by 2027, and argues that a unified architecture is key to success. The study is 1,050 IT leaders at manager level or above, at organisations with at least 1,000 employees across nine countries, surveyed in October and November 2025. It is a careful record of expectation, which is a different quantity from deployment, and the architecture argument also describes what its publisher sells. That does not make it wrong. It means the figure belongs in a paragraph about intent, not in a business case.

KPMG's Q3 2026 AI Pulse, covering 314 US-based C-suite and business leaders at organisations with annual revenue of $1 billion or more, reports confidence growing in governance, accountability and workforce adoption. Again the population is very large companies. The US Census Bureau's Business Trends and Outlook Survey, which asks about AI use across any business function, found the biggest users are firms with at least 20 employees. If you are smaller than that, the published picture is not describing you.

What nobody is measuring is architecture. The 2026 Stack Overflow Developer Survey drew 30,903 valid responses from 169 countries, with 17,464 answering its question on AI tool usage, and like every developer survey it records which tools people use, not whether anyone runs a registry and a policy layer in front of them. There is no published number that tells you whether to build a mesh. The evidence for that is your own call graph and your own incident reports.

What breaks first when agents start calling other agents?

Cost and loops, usually in the same incident. Agent A asks B for clarification, B asks A, and the pair burn tokens politely for as long as you let them. The fix is not a better prompt. It is a hop budget and a spend ceiling enforced outside the model, by whatever routes the call, because a model cannot be relied on to count its own hops.

Then shared memory. One agent writes a conclusion into a store another reads as established fact, and 'the system remembers' quietly becomes 'the system repeats'. Memory needs a writer, a scope and an expiry, decided per agent rather than per system.

Then tool descriptions. The description is the interface, so when the tool changes and the text does not, calls fail in a way that reads like model error and gets debugged as one. Treat descriptions as code: versioned and tested alongside the tool.

Then silent degradation. A sub-agent returns nothing useful, the caller summarises anyway, and the answer arrives fluent and empty. Every handoff needs a way to say 'I have nothing', and every caller needs to treat that as a result rather than as prose to paraphrase.

How do you move towards a mesh without building one?

One concern at a time, starting with whichever one cost you money or credibility most recently. Each of the five parts can begin as something small and unglamorous that takes an afternoon, and the small version tells you whether the real version is worth building.

After a quarter of that, the parts that need real infrastructure are the ones you keep working around by hand. That list is usually shorter than five, and which items are on it depends on your own system, which is the reason to find out rather than assume.

Where to start

  1. Give every request a trace id that survives handoffs, and write one log line per tool call. A single table is enough to begin with.
  2. Give each agent its own credential instead of the shared service account, so the audit log names something more specific than the application.
  3. Put tools behind one gateway, so the permission check happens in a place a later feature cannot forget.
  4. Write the registry as a file in the repository: agents, owners, tools, and who may call whom. A list somebody maintains beats a service nobody queries.
  5. Make every tool that changes the world idempotent, keyed by an action id, so a retry at any layer above is safe.
  6. Report cost and failure per edge rather than per system, because the edge to fix first is the one that is actually expensive.

Questions people ask

Is an agentic mesh something we can buy?

Parts of it. Gateways, tracing backends, registries, policy engines and queues are all products, and several platforms bundle a few of them together. The parts you cannot buy are the decisions: which agent may act for which user, what each one may remember, and who approves a new tool. Those are specific to your organisation, and a vendor offering to decide them for you is selling defaults.

How many agents do we need before a mesh makes sense?

Three is a reasonable trigger, and the better signal is behavioural. If you have had an incident where nobody could reconstruct the order of events, or a cost spike nobody could attribute to a component, you have outgrown point-to-point wiring. With two agents, a shared trace id and one log table do almost everything a mesh would do, for about a day of work.

Is MCP an agentic mesh?

No. MCP standardises how a model reaches a tool, which covers part of discovery and part of transport, and it removes a lot of bespoke adapter code. It does not give you identity across agents, policy about which agent may call which tool on whose behalf, or one audit trail. A standard connector is a prerequisite for a mesh, not a substitute for one.

Who should own the mesh internally?

Whoever owns the audit trail, usually platform engineering, with the policy rules written by the people accountable for the data. The failure mode is a platform team that owns all five parts and a product team whose use case needs a sixth. Keep the layer central, keep each agent with the team that built it, and publish the interface between the two.

How do we keep multi-agent costs predictable?

Cap hops and spend outside the model, meter per edge, and cache the deterministic parts. A hop budget enforced by the router is the only thing that reliably stops two agents talking to each other all afternoon. Metering per edge shows which handoff is expensive, which is rarely the one people assume. Smaller models for routing and classification are usually fine if you measure handoff quality.

Related on this site

Sources

  1. Large Firms With at Least 20 Employees Biggest AI Users, Business Trends and Outlook Survey (BTOS), a biweekly nationally representative survey of U.S. businesses; data collected December 14, 2025 to May 3, 2026, with AI use asked across any business function · U.S. Census Bureau, data from 2026
  2. Multi-Agent Adoption to Surge 67% by 2027 as Enterprises Race Toward Agentic Transformation - Unified Architecture Key to Success, Double-anonymous online survey of 1,050 IT leaders (manager level or above in IT) at organisations with at least 1,000 employees across the US, UK, France, Germany, Netherlands, Australia, Singapore, Hong Kong and Japan, conducted October-November 2025 for the 11th annual Connectivity Benchmark Report · Salesforce / MuleSoft (fieldwork by Vanson Bourne), data from 2025
  3. Multi-Agent Adoption to Surge 67% by 2027 as Enterprises Race Toward Agentic Transformation - Unified Architecture Key to Success, Double-anonymous online survey of 1,050 IT leaders (manager level or above in IT) at organisations with at least 1,000 employees across nine countries, conducted October-November 2025 · Salesforce / MuleSoft (fieldwork by Vanson Bourne), data from 2025
  4. AI's Value Story Sharpens as Organizations Gain Confidence in Governance, Accountability and Workforce Adoption (KPMG Quarterly AI Pulse Survey, Q3 2026), Survey of 314 U.S.-based C-suite and business leaders at organisations with annual revenue of $1 billion or more, responses collected July 24 to August 25, 2026, as part of KPMG's Global AI Pulse research · KPMG US, data from 2026
  5. 2026 Stack Overflow Developer Survey: AI (data), Annual developer survey: 30,903 valid responses from 169 countries, fielded June 23 to August 5, 2026; this AI tool usage question was answered by 17,464 respondents · Stack Overflow, data from 2026
  6. Digital budgets are rising, but investment strategies may need a recalibration, Survey of 548 business and technology decision-makers at director level or above, at public and private organisations with at least US$500 million annual revenue across five industries, fielded May-June 2025 · Deloitte (2025 Tech Value Survey, Deloitte Center for Integrated Research), data from 2025

Want someone to look at your workflow?

Thirty minutes, and we will tell you whether there is anything here worth building. Roughly half of these end with us saying not yet.

Book a 30 minute call