Educational companion dossier · Fact, interpretation, lived experience, clinical education, fiction, and mechanics are labeled separately. Scope & safety
REAL-WORLD INTERPRETIVE

AI KILL CHAINS & DECISION SYSTEMS

Attacks Against AI Systems: Lifecycle Defense

A non-operational defensive model of Recon, Poison, Hijack, Persist, Impact, and the Iterate/Pivot loop in agentic systems.

REAL-WORLD INTERPRETIVE

ANALYTICAL & SAFETY BOUNDARIES

Keep related capabilities, evidence, and authority states separate.

  • attacks against AI systems
  • AI as a conventional cyber enabler
  • AI-enabled military targeting

Analytical boundary: AI kill chain is used here as a family of analytical models. Attacks against AI systems, AI as a conventional cyber enabler, and AI-enabled military targeting are related but distinct subjects. Capability is not deployment; deployment is not autonomy; classification confidence is not positive identification; recommendation is not authorization; a simulation is not operational evidence.

Simulation safety boundary: Use synthetic identities, reserved domains, fictional infrastructure, nonfunctional artifacts, abstract effects, and constrained defensive actions. Do not accept executable scripts, malware, credentials, arbitrary external URLs, real targets, command execution, or contact with third-party systems.

Source basis: Owner-supplied exact source packet with bounded official-primary-source currentness; external claims remain subject to stated source and review limits.

LEVEL 1

ORIENTATION

Why this matters

REAL-WORLD INTERPRETIVE

One-sentence brief

AI systems combine probabilistic models with ordinary software, data pipelines, identity, retrieval, memory, and tools. Harm can arise without conventional malware, yet conventional cybersecurity remains essential.

REAL-WORLD INTERPRETIVE

Three key points

  1. Treat every content source entering model context as untrusted data.
  2. Keep deterministic authorization outside the model.
  3. Control tools, credentials, egress, memory writes, and rollback rather than relying only on prompt refusal.
LEVEL 2

WORKING BRIEF

Evidence, context, and limits

REAL-WORLD INTERPRETIVE

Recon

The adversary seeks to understand inputs, guardrails, retrieval, tools, components, errors, and behavior. Defensive priorities are minimized information disclosure, access controls, rate controls, and telemetry for unusual probing.

  • Observability can help defenders and attackers; expose only what users need.
GAME MECHANIC
Fictional exercise

The synthetic scenario displays probe frequency and disclosure without real endpoints.

REAL-WORLD INTERPRETIVE

Poison

Untrusted instructions, corrupted records, adversarial inputs, tainted training data, or compromised dependencies enter the system. Defenses include provenance, authorization, validation, isolation, data lineage, and bounded transformation before ingestion.

  • A stored document can become an instruction only because the application treats it that way.
GAME MECHANIC
Fictional exercise

Learners can quarantine a synthetic source, inspect provenance, or allow it and observe downstream uncertainty.

REAL-WORLD INTERPRETIVE

Hijack

The model or agent follows an unauthorized goal, emits unsafe tool parameters, leaks contextual data, or deviates from the original task. Tool calls require independent policy checks, least privilege, scoped credentials, and confirmation for consequential actions.

  • Model output is a proposal, not authority.
GAME MECHANIC
Fictional exercise

The server validates every proposed action against scenario rules before state changes.

REAL-WORLD INTERPRETIVE

Persist, Impact, and Iterate/Pivot

A temporary compromise becomes persistent when poisoned content enters memory, retrieval indexes, shared state, or planning loops. Impact occurs when the system changes external state. Agentic feedback can repeat, spread, or pivot the compromise. Defenses include write authorization, lineage, egress control, anomaly detection, human approval, rapid rollback, and rebuilding corrupted memory or indexes.

  • Persistence is not effectiveness.
  • A valid signature on a poisoned artifact does not make its content true or safe.
GAME MECHANIC
Fictional exercise

Replay shows which control interrupted the pathway and which state must be repaired afterward.

LEVEL 3

COMPLETE DOSSIER

Limitations, game links, and review context

DISPUTED / MULTIPLE ACCOUNTS

Known limitations and gaps

  • The phrase AI kill chain has multiple meanings and no single universal definition.
  • Public descriptions of military and security systems are incomplete, uneven, and often mix doctrine, demonstrations, manufacturer claims, and deployment evidence.
  • These pages explain capability, uncertainty, defense, governance, and simulation boundaries; they do not provide operational attack or targeting instructions.
GAME MECHANIC

RogueIntelligence.org connections

No game connection is required to use this educational page.

REAL-WORLD INTERPRETIVE

Decision matrix

Lifecycle interruption opportunities
Stage What changes Defensive interruption
Recon Attacker knowledge Limit disclosure and detect probing
Poison Input or supply integrity Validate, isolate, and record lineage
Hijack Goal or tool path Independent authorization and least privilege
Persist Memory or shared state Controlled writes, deletion, rebuild, rollback
Impact External state Human approval, egress and action controls
Iterate/Pivot Feedback and lateral spread Continuous plan validation and containment
EVIDENCE

SOURCE QUALITY · UNCERTAINTY · NEUTRALITY

How to interpret AI kill-chain claims

OWNER-SUPPLIED RESEARCH INPUT — NOT SPECIALIST DISPOSITION

Evidence classes

Official Doctrine Or Policy

Primary institutional doctrine or policy; supports what the issuing body states, not deployment or compliance.

Official Technical Documentation

Primary technical specification or documentation; supports interface/status claims, not truth or field effectiveness.

Manufacturer Claim

First-party capability statement requiring independent corroboration.

Publicly Documented Deployment

Attributable public evidence of deployment scope; does not automatically establish autonomy, effectiveness, or legality.

Demonstration Or Exercise

Observed demo or exercise under bounded conditions; not field deployment.

Controlled Experiment

Structured test with stated conditions; external validity remains limited.

Peer Reviewed Research

Scholarly evidence with method and scope limitations.

Media Report

Journalistic account requiring attribution and corroboration assessment.

Owner Supplied Research Synthesis

Preserved source packet; claims remain unverified unless separately supported.

Editorial Inference

Repository-authored inference explicitly marked and linked to supporting evidence.

Hypothetical Simulation

Synthetic scenario for education; not operational evidence.

Unknown Not Retrieved

Evidence absent from the bounded search; absence is not proof of nonexistence.

REAL-WORLD INTERPRETIVE

Three meanings that must not be conflated

MeaningSubjectAnalysis model
AI_AS_TARGETAttacks against models, data, retrieval, context, tools, infrastructure, and users.Lifecycle defense: provenance, isolation, least privilege, retrieval authorization, tool-specific credentials, deterministic policy outside the model, egress controls, telemetry, rollback, and human approval.
AI_AS_CYBER_ENABLERAI accelerates conventional reconnaissance, social engineering, vulnerability analysis, or campaign execution.Defensive analysis must remain non-operational and must not provide executable payloads, credentials, real targets, or attack procedures.
AI_ENABLED_MILITARY_KILL_CHAINAI assists sensing, fusion, classification, prioritization, assignment, guidance, engagement support, or assessment.Use a function-context-control model; distinguish recommendation from authorization, navigation autonomy from target-selection autonomy, and classifier score from positive identification.
Uncertainty and control boundaries
  • Capability is not deployment.
  • Deployment is not autonomous use of force.
  • Autonomy in navigation is not autonomy in target selection.
  • A classifier score is not positive identification.
  • Recommendation is not authorization.
  • Human presence is not automatically meaningful human control.
  • Faster processing is not necessarily better judgment.
  • A manufacturer statement is not independent operational evidence.
  • A demonstration is not deployment.
  • Doctrine is not fielded capability.
  • A simulation is not operational evidence.
  • A test signature is not truth or endorsement.
  • A public allegation is not attribution.
  • An observed effect is not proof of the claimed cause.

Instructional boundary: Educational, defensive, governance-focused, synthetic, and non-operational. No executable payloads, credentials, malware, arbitrary target URLs, real target selection, or weapon-employment procedures.

LEVEL 4

RESEARCH EDITION

Sources, methods, and stable links

REAL-WORLD INTERPRETIVE

Linked reports

REAL-WORLD VERIFIED

Method and corrections

This page follows the public method for provenance, confidence, source independence, alternative accounts, limitations, review state, and visible correction.

NEXT

CONTINUE

Related learning

Page complete Attacks Against AI Systems: Lifecycle Defense Page label: REAL-WORLD INTERPRETIVE