Agent Operations

Agents are easy to launch and hard to run. We run them.

Bounded action authority, human escalation, quality and cost per agent, incident response and a tested reversal path, run inside your tenancy in Saudi Arabia, the layer that decides whether a pilot ever becomes production.

Our point of view

What we are seeing in the market

Observations from the engagements and tenders we work on across Saudi Arabia and the wider Gulf.

The market moved from building agents to operating them

Buyers now expect a provider to design, deploy and operate autonomous systems against an outcome. The differentiator has shifted from the demo to the run-state: uptime, escalation, cost and evidence.

Agents fail differently from software

There is rarely an exception in a log. An agent takes a plausible wrong path, calls the wrong tool or answers confidently from stale context, failures visible only if every step is traced and sampled.

Cost is now an operating metric

Unbounded retries, oversized context and chatty tool calls turn a successful pilot into a finance conversation. Cost per resolved task belongs on the same dashboard as quality.

The work

What this practice delivers

Bounded action authority, human escalation, quality and cost per agent, incident response and a tested reversal path, run inside your tenancy in Saudi Arabia, the layer that decides whether a pilot ever becomes production.

Tracing and observability

Every run captured end to end, prompt, retrieved context, tool calls, decisions and output, searchable, sampled and reviewable by a human without engineering help.

Human-in-the-loop and escalation

Confidence thresholds, approval steps on consequential actions and a clean handover to a person, with the full context that person needs to finish the task.

Agent KPIs and quality monitoring

Containment, task success, escalation rate, latency and grounding measured per agent and per journey, with drift alerts when behaviour moves.

Cost governance and incident response

Token and tool budgets per agent, cost per resolved task, kill switches, rollback to a known-good version and a documented on-call path.

How the work is structured

Running agents like production systems, not experiments

One operating layer across every agent, with cost and quality on the same dashboard

Run

Agents in productionTool and system calls

Observe

Full-run tracingSampling and review

Control

Escalation thresholdsBudgets and kill switches

Measure

Containment and successCost per resolved task

Improve

Failures into the test setRetrieval and prompt fixes
Selected work

Work we have delivered

Client identities are withheld. The situations, the build and the change afterwards are as they happened.

Escalation design

A regional telecom

The situation
A support agent resolved routine requests well but handed complex cases to staff with no context, so customers repeated themselves.
What we built
Confidence-based escalation with a structured handover summary, plus sampling of every escalated run for weekly review.
What changed
Escalations stopped feeling like a failure of the agent and became a designed part of the journey.

Cost governance

An Australian services group

The situation
Agent spend tripled in a quarter with no matching increase in resolved work, and nobody could attribute it.
What we built
Per-agent token and tool budgets, retry caps, context trimming and a cost-per-resolved-task metric on the operations dashboard.
What changed
Spend became explainable line by line, and the expensive paths were the first things fixed.

Where we are strongest

We are strongest once the pilot is over and someone has to answer for the agent every morning.

Traces a non-engineer can read

Operations and risk teams review agent runs themselves, which is what turns oversight from a promise into a routine.

Cost and quality on one screen

Every quality decision has a price attached, so improvements are argued with both numbers present.

Rollback is a designed path

Every agent has a known-good version and a switch, because the fastest incident response is going back.

Improvement is closed-loop

Production failures become test cases the same week, so the operating layer feeds the assurance layer.

Straight answers

Questions we are asked most

Do you only operate agents you built?

No. We instrument and operate agents built by your team or another vendor, on the platform they already run on.

Can our own team run this after handover?

That is the intent. The dashboards, runbooks and review rituals are built to be operated by your staff, with us on call for as long as you want.

Where does this sit against assurance?

Assurance decides whether a release may ship. Agent operations decides whether it keeps behaving once it has. They share the same test set.

Clients

Organisations we work with

Across banking, healthcare, government, retail, energy and telecom.

Carrefour
STC
Fortum
Marriott International
United Utilities
Mobily
PepsiCo
H&M
Ericsson
Nordisk Film
Posten Bring AS
Norgesgruppen
Central Bank — Gulf Region
Public Investment Fund
Integrys Energy Group
Getinge
Entra
Australia Post
Roche
Ministry of Health
Swedbank
SpareBank 1
Telia Company AB
Danfoss
Kahoot!
Nesma Partners
Gentian Diagnostics
Lufthansa
Sokos Hotels
BHP Group
Emdad Al Khebrat (إمداد الخبرات)
ICA Gruppen
Qt Group
Vodafone
Ministry of Interior
Skatteverket — Swedish Tax Agency
Labster
Türk Telekom
State Bank of Pakistan
Arla Foods
SchoolSoft
Deloitte
Statkraft
DHL
Saudi Cement
Sinch
Zalora
Claned Group
Hurtigruten AS
Ameeri Dewan
MT Højgaard
SEB
Salling Group
Kela — Finnish Social Insurance Institution
YIT
TDC Net (Nuuday)
Bayer
NAV — Norwegian Labour & Welfare Administration
Visma
Novo Nordisk
Ministry of Hajj and Umrah
NEOM
SimCorp (Deutsche Börse)
Najm Insurance Services
Ooredoo
Audi
Novartis
LEGO Group
Skanska
Vero — Finnish Tax Administration
Jeudan
Nykredit
Tivoli A/S
Planmeca
Mölnlycke
Jacobs Engineering
Kesko
Konecranes Plc
NetCompany Group
Albert
Försäkringskassan — Swedish Social Insurance Agency
Kojamo
DSV A/S
Equinor
Volvo Group
Ørsted
VR-Yhtymä Oyj — Finnish State Railways
Sanoma Pro
Viaplay Group AB
Orion Pharma
Standard Chartered Bank
Vattenfall
Nordea Bank
Arp-Hansen Hotel Group
Kongsberg
Itslearning
DNB Bank
S Group
Nokia
E.ON
SkiStar AB
Schibsted Media Group
Danske Bank
Coca-Cola
Photocure
Credito Emiliano (Credem)
AT&T
Veidekke
Tietoevry
Walmart
Alinea Education
OP Financial Group
KONE
People — people-ksa.com
Deutsche Telekom
Elisa Oyj
Imam Abdulrahman Bin Faisal University
Castellum
Elm Company (إلم)
Warner Bros. Discovery
Unilever
SKF
Neste Corporation
Saudi Water Partnership Company (SWPC)
Scania
Finnair Plc
Intercity Istanbul Park
Coloplast
DirecTV
Ministry of Municipal & Rural Affairs
National Oil Company
Wärtsilä
Orkla
Andel
Yara International
Scandic Hotels Group
Sanoma Group
Telenor ASA
A.P. Møller-Mærsk
Shell
FAQ

Frequently asked questions

What is agent observability in practice?

Capturing each run's prompt, retrieved context, tool calls, decisions, cost and output, then sampling those runs for human review and alerting when the pattern changes.

Which KPIs matter for an AI agent?

Task success, containment, escalation rate, grounded-answer rate, latency and cost per resolved task, read together, never one alone.

Can agents run inside Saudi Arabia?

Yes. The operating layer is deployed where your data must stay, including in-country hosting and private model endpoints.

Cookie & Privacy Notice

We use cookies to improve your experience and analyse site traffic, in line with our Privacy Policy and the Personal Data Protection Law (PDPL). You can keep essential cookies only.