|
First
Least privilege and isolation
|
Bounds damage from any single mistake. Credentials are scoped to the
job, not the person. The agent never sees a tool it may not use.
Snapshot and restore sit behind anything that writes.
|
Distinct credentials per workflow and a read-only default. Days of work,
not quarters, and the cheapest control on this list.
|
It bounds how bad a mistake is, not how likely. An agent operating
entirely inside its sandbox can still do the wrong thing with everything
you gave it.
|
|
Second
Authorization at the action layer
|
A defensible decision for each action: this actor, this action, this
resource, allow or deny. AWS Cedar, Open Policy Agent, and the agent
gateways all answer this same question. Cedar goes furthest by
machine-checking properties of its own evaluator.
|
Explicit rules and an enforcement point every call must pass through.
The rules take the time.
|
Per-action enforcement does not guarantee the result of a sequence of
actions. See The practice.
|
|
Third
Guardrails and constrained output
|
Input and output filters, classifiers, model judges, and constrained
decoding. Constrained decoding gives a hard guarantee about output
form. Filters are best-effort guesses about meaning.
|
Little. Mostly configuration on tools you are already paying for, which
is why it is often the first thing bought.
|
A syntactically perfect tool call that moves the wrong money passes every
content filter. It is useful and cheap, but it is a filter rather than
a boundary.
|
|
Fourth
The audit trail
|
Six months later, even to a hostile reviewer, you can answer why the
system did what it did. Capture the action, the inputs it saw, the
decision and its reason, and a signed receipt per decision.
|
Deciding what to record before deployment. Retrofitting an audit
trail after an incident is the expensive version of this work.
|
Monitoring detects. It does not prevent. A record that cannot
reconstruct a decision is logs, not an audit trail.
|
|
Fifth
Evaluation, before and after
|
Early warning on failures you have already seen. Thirty real cases with
known answers, run on every change. Every incident becomes a permanent
test.
|
An afternoon to start, then discipline. A limited monitored rollout
before you widen.
|
Necessary but insufficient. The failures that matter are the ones the
suite was not built to catch, a lesson the frontier labs have published
on their own systems.
|