AI agents

Most of an agent OS is a scheduler, a permission boundary and a log

The useful question is not which agent OS to adopt, it is which of its parts your failures are already asking you to own.

Open Dimension AI7 min read

What is an AI agent OS?

An AI agent OS is the runtime layer between your agents and everything they touch: model calls, tool access, memory, scheduling, state and logs. It solves the problems a real operating system solves, under a different name. Most teams need three or four of its parts, not a whole platform.

The short version

  • An agent OS is a name for the runtime concerns every agent system acquires once it runs unattended: scheduling, isolation, permissions, durable state and logs.
  • Nothing in the idea is new. The problems are the ones operating systems have had for decades, applied to a process with a non-deterministic middle.
  • Build the step-level log first. Until you have one, every other runtime decision is guesswork.
  • One agent, one trigger and a handful of tools does not need a platform, and putting one underneath it removes no work.
  • Buying an agent OS moves your retry policy and step boundaries into someone else's runtime, which is a fair trade only if you can name the parts you were going to write.

What is an AI agent OS, and why is it called an OS?

It is the layer underneath your agents that decides four things: when a run starts, what it is allowed to touch, where its state lives, and what happens when a step fails. The operating system word is borrowed, and the borrowing is fair. Those are the jobs a kernel does for ordinary processes, and an agent is an ordinary process with a non-deterministic middle.

The term is used for at least three different kinds of product, which is why arguments about it go nowhere. Some vendors mean a hosted platform where you assemble agents in a interface and they handle the running. Some open source projects mean a library you import that gives you a scheduler, a tool registry and a state store. A third group means an environment an agent drives, a desktop or a browser with an API in front of it. Before comparing two of these, check that they are the same kind of thing.

The useful version of the question is narrower than the category. You are not choosing an operating system. You are deciding which runtime concerns you own and which you let something else own. That decision gets made one part at a time, and it is usually forced by a specific failure rather than by an architecture diagram.

What problems does the OS framing actually name?

Six, and they map almost one to one onto what a kernel does: scheduling, isolation, mediated access to resources, memory, durable state, and accounting. The value of the framing is not that it is a clever metaphor. It is that each of those words comes with decades of documented failure modes you can go and read instead of rediscovering.

The mapping is worth being precise about, because the agent version of each problem is harder in one specific way. A retried system call returns the same thing. A retried model call does not. Anywhere a classic operating system can assume repeatability, an agent runtime has to either write down what happened or accept that it will never be able to reconstruct it.

Operating system jobs and their agent equivalents

Operating system jobAgent equivalentWhat breaks when nobody owns it
SchedulingWhich run starts, when, and how many at onceTwo runs process the same queue item, and both act on it
Process isolationKeeping one agent's credentials, memory and failures away from another'sOne bad tool call takes down unrelated work, or reads data it should not
Mediated resource accessA single tool layer every call has to pass throughTools get called with arguments nobody validated, against systems nobody allowlisted
Memory managementWhat the agent remembers, for how long, and who may read itContext grows until it costs more than the task, or retains data that should have expired
Durable state and recoveryResumable position for a run that is halfway doneA timeout at step seven means starting at step one, or repeating step four
Logging and accountingA record of every step, tool call, token and decisionYou cannot answer why it did that, which is the first question anyone asks

Which part should you build first?

The log, and it is not a close call. Until you have a step-level record of what the agent did, which tools it called, with what arguments, and what came back, every other runtime decision is guesswork. Teams that skip it end up debugging by rerunning the agent and hoping it misbehaves the same way, which for a non-deterministic process is not a plan.

Second is the tool boundary: one place in the code that every tool call passes through. That choke point is where you validate arguments, allowlist targets, resolve the acting user's permissions and refuse. Scattered tool functions each doing their own checks is the arrangement that produces the incident, because the eleventh tool, added in a hurry on a Friday, is the one that forgot.

Third is durable state, which is the part most teams underestimate. An agent run is a long-lived process that fails in the middle, and the middle is where the side effects are. If step seven times out, you need to know whether step four already sent the email. That means recording each step's outcome before moving on, and giving every side-effecting call an idempotency key so that resuming does not do it twice.

Scheduling comes last, because a cron entry and a single lock take you a long way. The reason to replace them is concurrency you cannot reason about: two runs touching the same record, a backlog that needs fair ordering, retries that need backoff rather than immediate repetition. Until one of those is actually happening, a scheduler is something to maintain rather than something that helps.

What a run log should contain to be worth having

  • A run identifier and what triggered it, including which user or system asked
  • The exact text sent to the model, not a template with the variables left unfilled
  • The model and version used, because behaviour changes underneath you
  • Every tool call with its arguments and its result, including the failures
  • Step outcomes with timestamps, so a stall is distinguishable from a crash
  • Token counts and cost per run, attributed to something a human recognises
  • Whether a person reviewed the output, and what they changed

When is a cron job and a script enough?

More often than the category's marketing implies. One agent, one trigger, a short list of tools, a person who reads the output: that shape does not need a platform, and putting one underneath it adds a dependency without removing any work. Plenty of genuinely useful automation lives here permanently and never needs to leave.

What moves you off it is almost never the number of agents. It is shared writes, resumability and per-user permissions, roughly in that order. Those are the three where a script's informal handling stops being an inconvenience and becomes a correctness problem.

Signals you have outgrown a script and a cron entry

  • Two runs can write to the same record and you are relying on timing to keep them apart
  • A run that fails halfway costs more to redo than it would cost to resume
  • Someone outside the team needs to see why a decision was made, without you reading logs to them
  • The tool list has passed the point where one person remembers what each one can reach
  • The same agent needs different permissions depending on who invoked it
  • Cost per run has become a number someone asks about every month

What does an agent OS not fix?

The quality of the work. It is plumbing, and plumbing is necessary, but it does not decide whether the output is right. Retrieval will still return the wrong document. A badly specified tool will still be called badly. An ambiguous task will still produce output nobody can check.

This matters because of where the time actually goes. The parts a platform takes over are the parts a competent engineer can write in a couple of weeks. The parts it leaves with you are the ones that take months: deciding what the agent is for, defining tool contracts precisely enough that a model can use them, and building evaluations that tell you whether a change made things better or just different. 'we handle the orchestration' is a promise about the cheap half of the problem.

Most agent projects that quietly fail do not fail on orchestration. They fail because nobody defined what a finished, correct run looks like, so nobody could tell that it was not being reached. If you have no way of separating a good run from a bad one, no runtime layer will supply it, and the tidiest dashboard in the category will show a green tick next to work that was wrong.

Should you buy an agent OS or assemble the parts?

Buy if you can name the parts you were otherwise going to write and the product's versions are genuinely better than yours would be. Assemble if you cannot name them yet, because the shape of what you need is still being decided by failures you have not had.

The real cost of buying is not the licence and it is not data export. It is control flow. Once the retry policy, the step boundaries and the concurrency rules live in someone else's runtime, changing them is a support ticket rather than a commit. For a lot of workloads that is a fine trade and it buys back real time. For anything where the step boundaries are the business logic, it is not.

Questions worth asking, ordered by how expensive the wrong answer is: how do I resume a run that failed at step seven, what happens to in-flight runs when you change a default, can I see the exact text sent to the model, can I export the full run history, and can I run this in my own environment. Vague answers to the first two are the ones that cost later.

We are not going to rank the products here. We have not run the same workload across all of them under conditions we would defend, and a comparison table assembled from documentation is a worse input to your decision than an hour spent reading one of your own failing runs.

Questions people ask

Is an AI agent OS the same thing as an agent framework?

No, though many products sell both. A framework gives you the loop, the tool-calling abstraction and the prompt plumbing inside your own process. An OS-style product also takes over when runs happen, where state lives, who may call what, and what gets recorded. The question to ask any vendor is which of scheduling, state, permissions and logging it actually owns.

Do we need an agent OS to run more than one agent?

No. Two agents, a queue and a lock is not a platform problem. What pushes a system toward a real runtime layer is shared writes to the same records, runs that must be resumable after a mid-step failure, and different permissions for different users of the same agent. Agent count on its own is a poor trigger for buying anything.

Can we build our own agent OS?

You already are, one piece at a time. The step log, the tool boundary and durable resumable state are a few weeks of ordinary engineering, and you end up with exactly the semantics your workload needs. The honest case for buying is not that building is hard, it is that you would rather spend those weeks on the agent's actual task.

What does an agent OS cost to run?

The licence is usually the smaller half. Token spend per run, retries after failures, and the engineer time to operate and debug the thing dominate the total, and all three are driven by how often runs go wrong rather than how often they go right. Price the failure path. We will not quote a figure we cannot source.

Which part fails first in practice?

State, almost always. Scheduling problems are visible and annoying. State problems are quiet: a run dies at step seven, someone retries it, and step four happens a second time. By the time anyone notices, the duplicate has been sent, charged or filed. Idempotency keys on every side-effecting call are the cheapest insurance in the whole design.

Related on this site

Sources

  1. NEW SBE Council Tech Use Survey: The Digital State of Small Business, Online survey of 517 small business employers (2-99 employees) conducted by TechnoMetrica for SBE Council, February 17-23, 2026; credibility interval +/-4.4 percentage points · Small Business & Entrepreneurship Council (fielded by TechnoMetrica), data from 2026
  2. Use of artificial intelligence in enterprises, EU survey on 'ICT usage and e-commerce in enterprises', conducted by national statistical authorities in the first months of 2025; 157 000 of the 1.53 million EU enterprises with 10 or more employees and self-employed persons were surveyed. Small = 10-49 employees and self-employed persons · Eurostat, data from 2025
  3. The Microstructure of AI Diffusion: Evidence from Firms, Business Functions, and Worker Tasks, Nationally representative firm survey — the 2026 AI supplement to the U.S. Census Bureau's Business Trends and Outlook Survey (BTOS); results reported both firm-weighted and employment-weighted · U.S. Census Bureau (Center for Economic Studies) — 2026 AI supplement to the Business Trends and Outlook Survey, data from 2026 (Nov 2025-Jan 2026 reference period)
  4. 2025 Stack Overflow Developer Survey — AI, Online developer survey fielded 29 May - 23 June 2025; 49,009 responses used from 177 countries, with 28,930 responses (59%) to the AI agents attitude question · Stack Overflow, data from 2025
  5. Software Developers, Quality Assurance Analysts, and Testers : Occupational Outlook Handbook, Occupational Employment and Wage Statistics — semiannual mail/electronic survey of US non-farm establishments reporting employment and wages by occupation; figure is the May 2025 median annual wage for SOC 15-1252 Software Developers · U.S. Bureau of Labor Statistics, data from 2025 (May 2025)

Want someone to look at your workflow?

Thirty minutes, and we will tell you whether there is anything here worth building. Roughly half of these end with us saying not yet.

Book a 30 minute call