Provenance and uncertainty in multi-source synthesis
What this covers
- Preserve claim-source mappings through summarization
- Annotate conflicts instead of resolving them arbitrarily
- Require dates so temporal differences are not read as contradictions
- Carry a page or section locator with each claim, not only a document name
- Explain why an instruction to cite cannot restore attribution that was not carried
- Keep publication date and measurement period as separate metadata
process plate / 5.6
Keep every claim attached to its evidence
Follow the evidence threads. A claim remains checkable only while source, locator, and reference period travel with it into synthesis.
process reading / source + locator + period
Preserve one complete evidence thread.
The 34% shuttle figure remains attached to Source A, page 12, and measurement period 2026-Q1.
Read the complete diagram as text
- Carry source, page or section locator, publication date, and measurement period with each claim.
- Before calling two figures a conflict, compare their metric, population or scope, and reference period.
- For comparable disagreement, preserve both figures and their evidence threads without averaging.
- For different reference periods, present the figures as separate time-bound facts.
- Do not substitute a bibliography or model reasoning transcript for claim-level provenance.
Key terms
- Provenance
- A record of where a claim or piece of data came from.
Keep each claim connected to its source
If a summary removes the claim-to-source mapping, the claims can no longer be traced to their evidence. A later agent can't restore a source reference that was not preserved.
A box of old family photographs with nothing written on the back is not damaged; every picture is sharp. What is missing was never in the image — who, and when. Nobody can look harder at a photo and recover it.
Require subagents to output structured claim-source mappings that include source URLs, document names, and page or section locations. The synthesis agent should preserve these mappings while combining the findings.
A record of how the subagent reasoned isn't one of those. Provenance points outward, at evidence a reader can open; a reasoning chain points inward, at the path the model took to the claim. Those chains are what upstream agents should be trimming out, not forwarding as citations.
Conflicting figures are information
When two credible sources give different statistics, selecting one arbitrarily throws away the most interesting fact in the material.
Annotate the conflict with attribution: this source reports X, that one reports Y. The reader can then judge, which is exactly what they can't do if the synthesis silently picked a side.
Two near-misses sit either side of this. Averaging the figures produces a number no source reports and nothing can be attributed to. Noting that the sources disagree without giving both figures discloses the conflict and withholds the data a reader needs to weigh it.
Dates prevent false contradictions
Two figures that disagree may not conflict at all — they may describe different points in time.
Require the measurement or reference period for each figure. Keep publication date and collection date as separate metadata because a report published in Q4 may describe Q2. Market share measured in Q1 and Q3 are two facts, not a disagreement, and the reference periods are what make that visible.
Here is one claim-source mapping using fields defined by the application:
{
"claim": "Vendor A held 34% of the market.",
"source": "https://example.com/market-report-2026.pdf",
"locator": "page 12, table 3",
"published": "2026-11-04",
"measurement_period": "2026-Q1"
}published records when the report was released. measurement_period records when the reported data was measured. A second source reporting 41% for 2026-Q3 doesn't contradict a figure measured in 2026-Q1. The locator field tells a reader where to verify the claim in the source.
Methodology explains many divergent statistics and isn't a default explanation. Attaching it to a difference the reference periods already account for tells the reader something the sources never said. State the cause you have evidence for, and otherwise state the figures and their periods.
claim-source mappingsconflict annotationtemporal metadata
Field note — common misconceptions
- MythThat attribution can be reconstructed after summarizing
- ActuallyAttribution survives only as structure: carry claim-source mappings with page or section locators.
- MythThat a synthesis should present one number when sources disagree
- ActuallyAnnotate the conflict with attribution so the reader can judge which figure to trust.
- MythThat two different figures indicate one source is wrong
- ActuallyRequire each figure's reference period; Q1 and Q3 market share are two facts, not a dispute.
Guided review
Review this lesson as a study deck
Review the lesson's main ideas in five guided slides, then test yourself with three flashcards.
Open Task 5.6 study deckCross-domain reasoning
Connect this idea
Delegation depends on context
A delegated task succeeds only when its scope is clear and the receiving agent gets the instructions, facts, saved state, and sources it needs.
- 1.2 · Orchestrate multi-agent systems with coordinator-subagent patterns
- 1.3 · Configure subagent invocation, context passing, and spawning
- 1.6 · Design task decomposition strategies for complex workflows
- 5.1 · Manage conversation context to preserve critical information
- 5.4 · Manage context effectively in large codebase exploration
Structured data still needs checks and sources
A schema controls format, validation checks meaning, batch IDs keep requests and results matched, and provenance records the evidence behind each result.
Applied practice
Practice this lesson in a lab
Use a related lab to create a decision, implementation or diagram, evidence record, and review.
- Lab 2 · Coordinator and specialist agents
Coordinate three bounded specialists without losing provenance or hiding a coverage gap.
- Lab 10 · Reliability, provenance, and escalation evaluation
Evaluate autonomy, escalation, failure propagation, and claim-level provenance across a synthetic scenario suite.