Why change / workflow-level reliability

The steps can pass.
The task can still fail.

Retries, late responses, and changing inputs can alter the final artifact. A single passing run may leave that transition untested.

PO-204 / Controlled timeout example

Same order.
Different artifact.

The baseline suppresses the late duplicate. The candidate’s two response paths each produce a draft.

Observed: 2 drafts. Exactly-one-draft criterion fails.

DEMO — SYNTHETIC DATA Simulation only
Order lookupPO-204
Stock checkTimeout injected
PO draftRetry + late response
↳Two paths reach draft creation.Candidate lacks a shared deduplication guard.
Purchase orderA

PO-204-A

Order reference
PO-204
Vendor
Fictional Harbor Parts
Origin
Retry response
Expected draft
Purchase orderB

PO-204-B

Order reference
PO-204
Vendor
Fictional Harbor Parts
Origin
Late original response
Duplicate artifact

Find the mechanism

The timing changed.
The criterion didn’t.

01

Retry

The timeout triggers a second request.

02

Late response

The original response arrives after the retry.

03

Duplicate artifact

Both paths reach drafting without a shared guard.

A smaller test. A clearer decision.

Start with the workflow
you can’t afford to guess.

Agree on one task criterion, an approved fixture, and a named engineering owner.

Request a replay study