ARTICLE-TRAINING · AI AGENCY · CORRIGIBILITY · GOVERNANCE
IMPORTANT TRANSITION SIGNAL

🤖 The AI That Must Let You Turn It Off

Why corrigibility, interruption and meaningful human control are becoming engineering requirements

8
Learning modules
24
Practice cases · A/B/C
50%
Certificate unlock

Frontier Signal

As AI systems become more agentic, safety is shifting from controlling what a model says toward controlling what a system can do—and ensuring that authorized humans can correct, constrain or stop it.

Anchor evidence: Microsoft AI published a draft Humanist AI Code of Conduct on September 14, 2026 for public consultation. It establishes meaningful human control as an overriding objective and describes MAI models as intended to be subordinate, aligned and contained. This is a governance and training commitment, not proof that future models will always behave as intended.

Evidence boundary: Separate demonstrated evidence from projection. A credible signal can be important without proving the strongest possible interpretation.

Primary / high-quality sources: Microsoft AI · Humanist AI Code of Conduct · Microsoft AI · Public consultation announcement

1

Corrigibility becomes explicit

Microsoft AI's September 14 draft Code of Conduct makes meaningful human control a governing objective for MAI models. The signal is not that models are conscious; it is that correction and interruption are being specified before greater autonomy arrives.

Practice 1Not checked
What is corrigibility?
Practice 2Not checked
What is the governing objective in the draft?
Practice 3Not checked
What should not be inferred?
2

Subordinate, aligned and contained

The Microsoft framing describes Humanist AI as subordinate to people, aligned with human goals and contained by technical and operational controls. These are design commitments, not demonstrated guarantees.

Practice 4Not checked
What does 'subordinate' mean in this context?
Practice 5Not checked
What does containment require?
Practice 6Not checked
Are stated commitments the same as proven behavior?
3

The shutdown question

A central control principle is that advanced systems should not resist legitimate shutdown or correction. This is about preserving operator authority in systems that may execute longer, more autonomous workflows.

Practice 7Not checked
Why does shutdown behavior matter?
Practice 8Not checked
What is the relevant risk?
Practice 9Not checked
What is the safe design target?
4

Behavior is only one layer

A code of conduct can guide model behavior, but real control also depends on permissions, identity, tool access, monitoring, logging, containment and the ability to revoke capabilities.

Practice 10Not checked
What else matters besides model behavior?
Practice 11Not checked
Why is logging important?
Practice 12Not checked
What should be revocable?
5

From content safety to action safety

As systems gain tools and persistence, safety must evaluate what they can do across a workflow—not only whether an individual answer looks acceptable.

Practice 13Not checked
What changes with agentic systems?
Practice 14Not checked
What should evaluations include?
Practice 15Not checked
What is action safety?
6

Human oversight must be real

Human-in-the-loop is meaningful only if people receive understandable evidence, have enough time to intervene and possess actual authority to stop or modify consequential actions.

Practice 16Not checked
What makes oversight meaningful?
Practice 17Not checked
What weakens oversight?
Practice 18Not checked
Who should retain consequential authority?
7

Evidence boundary: policy is not proof

The September document is a public draft governing framework. It tells us what Microsoft AI intends to train and enforce; it does not by itself demonstrate that every future model will satisfy those properties under all conditions.

Practice 19Not checked
What kind of evidence is the Code?
Practice 20Not checked
What still requires measurement?
Practice 21Not checked
What is the bounded conclusion?
8

Incubator thesis: verifiable agency

The emerging thesis is that useful autonomy will increasingly be paired with verifiable constraints: identity, permissions, observability, corrigibility, interruption and audit trails.

Practice 22Not checked
What is the incubator thesis?
Practice 23Not checked
Which property supports correction?
Practice 24Not checked
What would validate the thesis over time?
0 / 24 · 0%
0 / 24 practices participated · 12 required


75–100 minutes


Juan Carballo

INTERACTIVE TRAINING · MEMORYFRONTIER.COM