C. The Proof Dossier: What You Build

The dossier is one cumulative record, not a pile of unrelated chapter exercises. It preserves the original brief, the evidence gathered against it, and the decision that follows. A folder of documents or a paper notebook is sufficient.

Start before building

Copy the proof brief from the Introduction. Give it a date and version. Select one main use for your capstone; the other chapter artefacts are supporting exercises, not a requirement to combine every model into one system.

Use these sections throughout:

Section Contents
1. Brief Intended and forbidden use, affected people, baseline, acceptance thresholds, stop rule
2. Sources and boundaries Data provenance, permissions, versions, transformations, missing resources, permitted destinations
3. Design Candidate workflow, alternatives rejected, model and prompt versions, human checkpoints
4. Evaluation Test plan, separation from development data, inputs and outputs, counts, failures, baseline comparison
5. Review Conversation logs where used, independent checks, corrections, unresolved objections
6. Decision and handover Go/revise/stop memo, limitations, owner, fallback, pilot conditions, next review

Label each piece of evidence observed, illustrative, or not tested. Record whether an outcome came from your own run, a cited external study, or a constructed case in this book. A conversation log shows how you reasoned; it is not a substitute for test results or independent verification.

What each chapter contributes

Chapter numbers below follow reading order, not source filenames.

Chapter Contribution to the dossier Evidence to retain
1. What changed? Initial use and capability hypothesis Proposed task, unsupported claims, questions to test
2. For whom? Stakeholder and subgroup map Who is represented, who is missing, error costs
3. Can you tell? Four-lens audit Quoted claims, missing provenance, review owner
4. What’s in the data? Data analysis, or a critique of the worked case Dataset version, transformations, patterns versus causal claims
5. Whose data is it? Data-boundary sheet Direct and potential identifiers, group counts, unresolved approvals
6. What are you giving up? Deployment comparison Data destinations, costs, constraints, rejected alternative
7. Are you asking well? Retrieval design and injection-boundary check Source support, exact test inputs/outputs, tool permissions
8. What is it saying? Language-analysis disagreement set Cases where scoring and human reading differ
9. Does it actually work? Evaluation report Counts by class and condition, failed thresholds, baseline
10. How does it decide? Model comparison Shared tests, explanation limits, reasons for selecting neither if needed
11. Can it do the whole job? Action and checkpoint map Permissions, failure propagation, stop and escalation design
12. What comes next? Capstone decision memo Benefits, transition costs, exclusions, decision and next evidence

The paper route produces analysis and design records. Build-along work adds executable artefacts and measured runs where the required resources are available. Do not mark a build completed because you read its example.

Capstone acceptance checklist

Ask a peer to review the dossier, or perform a separate self-review before submitting it. A criterion is met only when the reviewer can point to the relevant evidence.

  • Scope: the intended use, affected users, and forbidden use are explicit.
  • Precommitment: the original threshold and test plan survive alongside any explained revisions.
  • Traceability: sources, versions, inputs, outputs, and calculations can be followed.
  • Honest evaluation: baseline, denominators, failures, and relevant groups or conditions are shown; missing tests are labelled.
  • Decision quality: the recommendation follows the evidence, including a revise or stop decision where warranted.
  • Human responsibility: checkpoint, accountable role, fallback, and stop condition are named.
  • Limits: illustrative numbers, untested assumptions, and generalisation limits are not presented as measured facts.
  • Next gate: the memo states what evidence is needed before the next stage in Appendix D.

A dossier meets the exercise standard when all eight are present and no critical unknown is concealed. This is a learning rubric, not certification of safety or legal compliance. Keep the reviewer’s objections and your responses with the final memo.