Keep the source attached
Retain fixture IDs, redaction notes, and source references alongside the scenario.
FlakeMap Trust Desk / Proposed module 01
Turn an approved, redacted workflow fixture into a scenario with a named input, an expected artifact, and a human-readable criterion.
{
"order": "PO-204",
"tool": "stock.lookup",
"source": "redacted",
"expected_drafts": 1
}DEMO — SYNTHETIC DATA
The question this module answers
Retain fixture IDs, redaction notes, and source references alongside the scenario.
Write the task-level criterion before running variants: exactly one purchase-order draft, with the original order reference.
Separate allowed stub responses from excluded production calls. Trace access must be approved.
Follow the proposed workflow
Approved, redacted trace JSON
Proposed process / synthetic exampleModule boundaries
This module is available to explore in the synthetic demo. A first pilot would test one scoped module with approved fixtures.
It selects deterministic stub fixtures and changes local mock states. It does not call models, write to tools, import customer traces, or modify CI.
Compare with the existing eval gate and confirm a meaningful missed regression independently. A named engineering owner must commit a gate or fund a trial before expansion.
A smaller test. A clearer decision.
Agree on one task criterion, an approved fixture, and a named engineering owner.
Request a replay study