Skip to main content

Hard to Vary

The first health AI built on good explanations.[^3]

Most healthcare AI systems optimize for prediction accuracy. We optimize for explanation quality. The difference: predictions can be right for wrong reasons and silently fail when conditions change. Explanations that are hard to vary — where every component is load-bearing — remain correctable and auditable even when wrong.[^1]

The standard is Karl Popper's. The criterion is David Deutsch's refinement. The architecture below operationalizes both. See the mechanisms

Figure 1.1 — Good explanations — easy to vary vs hard to vary

Both explanations account for the seasons. Only one of them constrains. The whole architecture turns on which kind of explanation a clinical AI system is allowed to make.[^1]

"The quest for good explanations is, I believe, the basic regulating principle not only of science, but of the Enlightenment generally."

David Deutsch — The Beginning of Infinity

Engineering facts

What the architecture commits to.

  • 9 (Mechanisms) — Distinct epistemic mechanisms — ArgMed debate, hard-to-vary scoring, falsification criteria, IDK protocol, safety routing, clinician feedback loop, composable domains, rules-as-data, accuracy ascertainment.

  • 4 (Verdicts) — Discrete supervision outputs — APPROVE, ROUTE, HARD_STOP, REQUEST_MORE_INFO. Bounded outputs make every verdict testable; ambiguity is engineered out by construction.

  • 0.0–1.0 (HTV score) — Hard-to-vary range — Four-dimensional algorithm — interdependence, specificity, non-ad-hocness, falsifiability — scored per claim. Low-HTV explanations route to a clinician.[^2]

The cycle

Conjecture, refutation, error correction.

Popper's contribution to the philosophy of science was the insight that a theory's value lies not in how often it is confirmed but in how readily it could be falsified. We apply this standard to clinical AI as a five-stage operational loop.

  1. Observe — Clinical observation enters as structured evidence — typed, hashed, provenance-tagged. No free-text intermediation between source and reasoning.

  2. Conjecture — The reasoning agent (Deutsch) proposes specific, falsifiable explanations — not probability distributions over possibilities. Each conjecture must specify what would prove it wrong.

  3. Critique — Multiple agents attack the conjecture adversarially. The hard-to-vary score is computed across interdependence, specificity, non-ad-hocness, and falsifiability.

  4. Survive — Surviving conjectures pass to the supervision agent (Popper), structurally independent of the reasoner. Same input, same verdict — deterministic.

  5. Verdict — APPROVE, ROUTE, HARD_STOP, REQUEST_MORE_INFO. Each verdict carries its evidence hash, its falsification criteria, and the override path back into step 02.

Mechanisms

Nine mechanisms compose the architecture.

The thesis

Persephone explains nothing. Earth's 23.5-degree axial tilt explains everything — and the difference is the architecture.

Both stories account for the seasons. The first one is easy to vary: substitute any gods, any emotions, any relations — the explanation still "works." The second one is hard to vary: change the tilt angle and the predictions break, change the orbital plane and the hemispheres flip, change the seasons and the geometry no longer accounts for them.

Most healthcare AI today is Persephone. It produces answers that sound plausible because the underlying causal story can be rewritten without affecting the recommendation. We chose the harder constraint: every architectural commitment in this section is what it takes to ship Earth's-tilt-grade explanations.

Figure 3.1 — Hard-to-vary scoring, four dimensions

Figure 4.1 — Conjecture-refutation, operationalized

Every clinical observation enters as a candidate conjecture; the rule pack is the body of refutations the conjecture must survive. The verdict that lands is what survived. The override arc carries new evidence back into step 02 — error correction is the architecture, not a feature.

Why this matters

Three audiences, the same epistemic commitment.

See the conjecture-refutation loop in your domain.

We will trace any clinical claim from the source observation to the surviving conjecture to the supervision verdict, and answer the epistemological question against the codebase, not the brochure.

Request a demo

Footnotes

  1. Deutsch, D. The Beginning of Infinity: Explanations That Transform the World. Allen Lane, 2011. The hard-to-vary criterion is introduced in Chapter 1, "The Reach of Explanations"; the seasons example is on pp. 1–3. Chapter 7, "Artificial Creativity," is the AI-safety reading we draw on directly.

  2. Popper, K. R. The Logic of Scientific Discovery. Hutchinson, 1959. The falsifiability criterion is developed in §I and §IV; the asymmetry between confirmation and refutation is the load-bearing argument of the book and is what the supervision agent in step 04 enforces.

  3. "Good explanation" used here in David Deutsch's sense — hard to vary while still accounting for the phenomenon. Operationalized in our supervision protocol as the 4-dimensional rubric scored 0.0–1.0 (interdependence, specificity, non-ad-hocness, falsifiability). To our knowledge, no other deployed clinical AI system encodes this criterion as runtime supervision; if you find one, please write to anton@regain.ai.