Educational companion dossier · Fact, interpretation, lived experience, clinical education, fiction, and mechanics are labeled separately. Scope & safety
PsychologicalWar.orgHistory before hype.
REAL-WORLD INTERPRETIVE

SIMULATION LITERACY

Ensembles, Counterfactuals, and Control Cases

Why responsible simulation compares branches, baselines, seeds, and model structures instead of publishing a single privileged run.

Read the working brief Choose a learning path
LEVEL 1

ORIENTATION

Why this matters

REAL-WORLD INTERPRETIVE

One-sentence brief

One dramatic run can be an accident of assumptions or randomness. Paired controls and ensembles show whether a claimed effect survives reasonable alternatives.

REAL-WORLD INTERPRETIVE

Three key points

  1. A control case establishes what happens without the tested change.
  2. Paired randomness isolates policy differences from population differences.
  3. Counterfactual branches must never be confused with the observed record.
LEVEL 2

WORKING BRIEF

Evidence, context, and limits

REAL-WORLD INTERPRETIVE

Baseline and control

A baseline is the comparison condition. It should be plausible, documented, and run with the same data and evaluation rules as the intervention case.

  • Define the baseline before examining preferred results.
  • Avoid a deliberately weak straw baseline.
  • Preserve version identity.
REAL-WORLD INTERPRETIVE

Paired comparison

Using the same seed or matched synthetic cohort across policy variants reduces noise and makes differences more attributable to the policy contract.

  • Pair inputs and randomness.
  • Report both aggregate and worst-cohort differences.
  • Do not reuse paired results as evidence about real people.
REAL-WORLD INTERPRETIVE

Ensemble

An ensemble combines multiple parameter sets, seeds, datasets, or model structures. The spread of outcomes can communicate uncertainty better than one central line.

  • Explain whether members are independent.
  • Show distribution, not only average.
  • Do not let many near-duplicates simulate consensus.
REAL-WORLD INTERPRETIVE

Counterfactual branch

A counterfactual branch asks what would happen under a different event or policy. It is not observed history and may become less reliable as it moves farther from the branch point.

  • Label divergence time and assumptions.
  • Keep branch data separate.
  • Do not use counterfactual harm as proof of actual intent.
REAL-WORLD INTERPRETIVE

Preserve failed runs

Failed baselines and adverse scenarios are important evidence. Removing them after a correction prevents regression testing and creates an unrealistically clean history.

  • Record failure criteria.
  • Explain the correction.
  • Retest the prior failure after changes.
REAL-WORLD INTERPRETIVE

Interpretation discipline

Agreement across runs strengthens a conclusion only when the ensemble spans credible uncertainty. Disagreement is informative and should guide collection, review, or narrower claims.

  • Investigate structural disagreement.
  • Use uncertainty to prioritize evidence.
  • Avoid majority-vote truth.
LEVEL 3

COMPLETE DOSSIER

Limitations, game links, and review context

DISPUTED / MULTIPLE ACCOUNTS

Known limitations and gaps

  • This is a non-operational educational transformation: it does not build or implement a game, executable simulator, forecasting service, emergency tool, or decision system.
  • This page is an educational transformation of supplied research leads; it does not authenticate every citation, equation, product claim, or institutional attribution in those files.
  • A scenario, model run, or map is not an observation, forecast, legal finding, public-health instruction, emergency warning, or proof of future behavior.
  • No source code, nuclear-effects formula, casualty calculation, target-selection method, cyber-intrusion procedure, exploit chain, or instruction for bypassing safeguards is published.
  • Geography, nationality, ethnicity, religion, language, migration, disability, health, poverty, or political identity are not inherent danger, compliance, intelligence, competence, or worth variables.
  • Specialist scientific, public-health, accessibility, legal, regional, ethics, security, and lived-experience review remains pending; the page stays open to correction.
LEVEL 4

RESEARCH EDITION

Sources, methods, and stable links

REAL-WORLD INTERPRETIVE

Linked reports

  • Building Epidemiological ModelsProtected research reference; no public report route in this release.
  • IARPA SimEarth Game Architecture part 2Protected research reference; no public report route in this release.
  • Planetary Simulation Game ArchitectureProtected research reference; no public report route in this release.
REAL-WORLD VERIFIED

Method and corrections

This page follows the public method for provenance, confidence, source independence, alternative accounts, limitations, review state, and visible correction.

Read the methodView corrections
NEXT

CONTINUE

Related learning

Simulation LiteracyAccessibility, Performance, and Low-Bandwidth ReviewA standard for making complex maps and simulations inspectable without high-end hardware, constant broadband, motion-heavy 3D, color-only encoding, or inaccessible controls.Simulation LiteracyAgent-Based, Compartmental, Cellular, and Network ModelsA comparative guide to four common model families and the kinds of heterogeneity, interaction, and uncertainty each preserves.Simulation LiteracyCalibration, Validation, and SensitivityHow to tune a model, test it against evidence, and reveal which assumptions drive its conclusions.Simulation LiteracyCompetitive AI Spread as a Fictional ScenarioA non-operational way to use a helpful-versus-harmful AI scenario to examine network assumptions, patching, uncertainty, governance, and recovery.
Page complete Ensembles, Counterfactuals, and Control Cases Page label: REAL-WORLD INTERPRETIVE