REAL-WORLD INTERPRETIVE
Start with a bounded task
A valid protocol states what a participant must locate, compare, explain, decide, or recover. Vague goals such as make it engaging cannot establish whether the interface preserved evidence, context, or access.
REAL-WORLD INTERPRETIVE
Plan representative coverage without ranking people
Recruitment should reflect the actual audience, language, expertise, device, bandwidth, disability, and assistive-technology contexts relevant to the task. Coverage identifies who must be included; it does not score a population or define a universal user.
REAL-WORLD INTERPRETIVE
Use a meaningful comparison condition
A prototype should be compared with a simpler baseline, prior version, static equivalent, or alternative presentation. Without a comparator, a fast task may still conceal preventable errors or unequal access.
REAL-WORLD INTERPRETIVE
Measure outcomes and recovery
Task success, comprehension, source tracing, error rate, correction, context recovery, and ability to stop or reverse an action provide stronger evidence than dwell time, clicks, virality, or subjective enthusiasm alone.
REAL-WORLD INTERPRETIVE
Minimize participant data
Collect only data necessary for the declared evaluation purpose. Separate consent, contact information, recordings, accessibility accommodations, raw observations, and published summaries. Do not reuse the material for profiling, secondary training, targeting, or unrelated analytics.
REAL-WORLD INTERPRETIVE
Specify correction and re-test triggers
Every material defect needs an owner, reproducible condition, affected route or revision, remedy, and re-test rule. A changed interface, source, language, device, access path, or authority boundary can reopen the protocol.