KokoAI Loops · 01 / 06
    Full analysis

    Cheaper Tokens, Bigger Bills

    Token prices are falling. Agent inference costs are rising. The difference is who runs the loop.

    Published Aug 18, 2026·Full-length analysis·A KokoAI point of view

    The essay made an argument in plain language. This is the same argument with the mechanism named, the terminology fixed to the stack it comes from, and the evidence set out.

    The loop, mechanically

    An agent loop is a cycle with an explicit exit. The model is shown the goal and the work so far; it decides a single next action; that action runs; its result is fed back; the cycle repeats. The engineering art is entirely in making it stop on purpose.

    In the Claude API the turn boundary is carried by a stop reason, and reading it correctly is what separates a working loop from a broken one:

    Stop reasonWhat the loop must do
    tool_useThe model is asking to call a tool. Execute it, return the result, continue.
    end_turnThe model considers the reply finished. The loop may exit.
    max_tokensThe output ceiling was reached. The reply is truncated — do not treat it as complete.
    stop_sequenceA configured sequence was emitted.

    The classic defect is treating a tool_use stop as a final answer: the tool call is silently dropped and a half-finished reply ships. The second classic defect is terminating on prose — ending the loop because the text contains "let me know if you need anything else." A loop that ends because the model sounds finished is a loop that will one day not end at all, or will end early on a close that is not closed.

    The operational definition worth adopting, because it names every part that matters:

    An agent is a model-directed execution loop that selects and sequences actions, uses tools to affect or inspect an environment, observes results, and adapts within bounded authority and explicit completion or escalation conditions.

    And the line to keep for meetings: workflows decide the path; agents decide part of the path; tools do the work; policies decide what is allowed.

    Is it even an agent? The control path test

    "Agent" has been applied to almost everything, which makes the word useless for procurement. The discriminator that survives contact with a vendor is the control path — at runtime, what decides the next step: coded logic, or the model?

    RungShapeControl pathAgent?
    1Deterministic automationFully predefinedNo
    2Single model callOne request, one responseNo
    3Retrieval assistant / RAGPredefined retrieve-and-answerNo
    4LLM workflowPredefined chain, router or parallel pathNo
    5Bounded single agentModel selects some steps and tools, inside limitsYes
    6Multi-agent systemSeveral goal-directed agents coordinateYes

    Two things follow. First, the governing principle is minimum sufficient agency — the correct answer is the lowest rung that does the job, and rungs 1 to 4 are not consolation prizes. Second, most of what is sold as agentic sits at rung 3 or 4, where the control path is coded. That is not a criticism of those products; it is a statement about what you are budgeting for, because the cost behavior of a fixed path and an open loop are not the same shape at all.

    The reconciliation in the essay is rung 5. Nothing predetermined that the third item would fail to tie, and nothing predetermined that the response would be an accrual proposal rather than a match.

    The economics, in detail

    The claim is that unit price and total spend are moving in opposite directions, and that the loop is the reason.

    The mechanism. Recurring cost per unit of work is roughly the number of turns, times the tokens per turn, times the price per token, plus the non-model cost each turn drags along — retrieval, tool round trips, reviewer time on anything escalated. Prompting fixes the first factor at one. A loop makes it a variable the model itself sets at runtime. A 95% fall in the third factor is swamped by a change of one order of magnitude in the first, and loops routinely take ten or more turns on real work.

    The evidence, dated 2026-08-18.

    FindingSource
    Token costs fall ~95% by 2030 while agentic inference costs rise ~5× over two years — Gartner's "inference paradox"CIO
    Only 35% of C-suite leaders say AI consistently delivers outcomes, earns regulator confidence and allows control (HFS Research + TCS, 100+ executives)CIO Dive
    Only 11% of technology CxOs report being prepared for agent deployment at scale; two-thirds are accountable for AI systems they do not fully controlIBM
    Anthropic annualized revenue reached $65B at the end of July, from $9B eight months earlierTechCrunch

    That last row is the one people misread. A vendor's revenue is not evidence about your unit costs. It is evidence that aggregate enterprise consumption is rising steeply while unit prices fall — which is the paradox stated from the seller's side of the invoice.

    Our own analysis of the corpus reaches the same place from two independent evidence sets, both at high confidence: total AI spend rises even as inference costs fall, because adoption scales faster than efficiency gains; and AI bills are tripling while per-token costs decline. A third, at medium confidence, notes that unnecessary token consumption in agentic workflows converges with infrastructure cost inflation to contradict the common narrative that agentic AI delivers near-term margin improvement.

    The right unit is cost per accepted outcome — not cost per token, not cost per call, not cost per seat. A loop that takes twenty turns and produces a reconciliation a controller signs is cheaper than one that takes four and produces something reworked by hand. Token accounting flatters the second.

    Why observability is a finance control

    The reason "an unobservable loop is an unbudgetable one" is not rhetorical.

    Every quantity above is per-run: turns taken, tokens per turn, tools called, escalations raised, outcomes accepted. None is knowable from an invoice, because the invoice aggregates across every loop you run. If a trace does not record them per run, the only available cost signal is a single monthly number with no decomposition — which is precisely the state the field reports, that enterprises cannot compute a return because they lack a complete cost picture.

    A trace sufficient to budget from carries, at minimum: the run identifier, the skill loaded, each tool call with its outcome, the turn count, the stop reason, tokens in and out, any escalation, and whether the result was accepted downstream. That is not an exotic ask. It is the agent equivalent of a general ledger entry, and it is the difference between an AI line item and an AI cost model.

    The six parts, in the stack's own words

    ComponentWhat it isWhere the term comes from
    The loopModel-directed cycle with an explicit stop condition, driven by stop reasonsAgentic architecture
    ToolsDescribed, bounded interfaces to systems and data; MCP is the open standard for exposing themTool design; MCP is the agent-to-tool layer
    SkillsPackaged procedure in its own file — a name and a "when to use me" description over a body loaded on matchProgressive disclosure
    GovernancePolicy, permission, approval and prohibition, enforced outside the modelBounded authority
    Memory and stateDurable run state keyed to a run id, so an interrupted run resumesResumability
    Observability and evalsTraces of what happened, and tests of whether it was rightEvaluation and reliability

    One boundary is worth keeping straight because it is routinely blurred in vendor material: MCP is the agent-to-tool layer. Agent-to-agent coordination is a different layer with different protocols. Conflating them makes it impossible to reason about which risks and which costs sit where.

    What this series will not claim

    Our own reading of the evidence is that AI productivity is currently accruing to a small vanguard of builders and early adopters rather than to the median enterprise employee, which makes broad workforce productivity figures misleading for at least the next twelve months. Nothing here should be read as a claim that a finance function can stand up a portfolio of loops in a quarter.

    The claim is narrower and, we think, more useful: the loop is the unit that can be designed, controlled, observed and priced — and the organizations embedding control into their loops now are, on the evidence, already ahead of the ones waiting for a governance framework to mature.


    ⚠️ Every figure in this analysis is a 2026-08-18 reading, and the Gartner projections run to 2030. When one moves, this page records the change and the date on which it changed.

    The framing of this series is inspired by dadloop, an agent harness built and published by Swami Chandrasekaran, Partner and Global Head of AI & Data Labs at KPMG (LinkedIn · github.com/swamichandra/dadloop). The six-part anatomy, the traced run and the named-skill catalog are his teaching devices; the finance domain, the loop library and every figure here are ours.