Skip to content

Lesson 3.2 · Learning path 03

Researching with AI in a verifiable way

How do you turn AI-assisted research into a file that someone else can audit?

You take away brief evidence file and a list of prioritised gaps.

≈ 35 min · Intermediate

Do the practiceExerciseRead the lesson

Research starts before the prompt

A good question is not enough. We must define the universe of sources, the cut-off date, the period observed, the geography, the languages, the relevant events and the sufficient evidence. If these are not specified, an AI may cover only the most accessible pages and produce a coherent story that hides the blind spots.

Use two explicit modes, which also apply to the prompt factory:

Mode A: evidence provided. A set of fragments or documents with identifiers is supplied. The assistant works on what is available, points out contradictions and adds no external facts without authorisation.

Mode B: assisted research. The assistant is asked to research, but the prompt instructs it to first check whether any search tools are available. If none exist, the valid output is a search and verification plan, not a list of feigned sources. If they do exist, the URL, issuer, date, relevant fragment, access date, limitations and verification status are documented.

What the evidence file must contain

Do not confuse three objects: a source (site, repository or publication), a document (a specific item with author and date) and a claim (what we say on the basis of the document). Several news items repeating a press release may be three links but a single primary source of origin.

We propose a record with: ID, intelligence question, claim, locatable quotation or verifiable fragment, origin, publication date, access date, type of source, coverage, independent corroboration, reasoned confidence level and gaps. Confidence is a reasoned assessment, not a percentage calculated by the model.

Research protocol in six moves

  1. Define. What we want to decide and which period and area affect the question.
  2. Plan. Which types of sources should contain proof and which are missing.
  3. Consult. Record what was actually seen, not what is presumably available.
  4. Cross-check. Look for contrary evidence and detect dependence between sources.
  5. Analyse. Separate facts, inferences, hypotheses and unknowns.
  6. Deliver. Present conclusions with reference to their identifiers and a list of pending checks.

Interactive · Put in order

Put the research protocol in order

Put the six moves in the right order.

Activity: put the six moves of the research protocol in order.

Diagram · protocol

Research protocol in six moves

Go through the six steps in order. Each one leaves a trail for the next.

Research protocol in six moves: this activity needs JavaScript.

Company A case · simulation

Fictional case

Company A case · The blog that looks like news

S02 announces that a technology «will replace all batteries in 2027». Its emphatic tone proves nothing. Reliable research does not necessarily discard it: it records S02 as a low-reliability claim, finds out whether it cites original studies and cross-checks against primary documents or technical results. If it finds no support, it keeps it as a monitorable rumour, not as a demonstrated trend.

By contrast, S03 (a fictional patent application) justifies the claim «a published application exists» but not «the patent has been granted» or «the solution works on the plant floor». The claims have different scope even though they come from the same record.

Educational simulation: fictional information and organisations.

Do it yourself

Do it yourself · Audit of five claims (20 min)

Give the AI S01, S02, S03, S04 and one additional signal from the corpus. Ask for a table with: verbatim claim, evidence cited by ID, fact/inference/hypothesis, plausible alternative and next check. Then manually detect at least two claims that exceed the evidence. If you use real search, keep links and dates; if not, work exclusively with the fictional records.

Deliverable: brief evidence file and a list of prioritised gaps.

R07 · AI and rigor

AI output audit

Check every claim before reusing it.

See the template →
R06 · Evidence

Log of signals and evidence

Distinguish observation, source and interpretation.

See the template →

Your work

It is saved only in this browser; nothing is sent to Innguma. You can download it when you finish. Do not enter confidential information.

Claims table
Verbatim claimEvidence (ID)TypePlausible alternativeNext check

Check it · closed answer

Audit four generated claims

A claim is only supported if the evidence provided supports exactly what it says.

  1. «A published application proves a monopoly».

    See the answer

    Answer: Unsupported. An application is not a grant; there is no proof of exclusivity.

  2. «A demonstrator proves commercialisation».

    See the answer

    Answer: Unsupported. A test does not document sales or adoption.

  3. «Adoption doubled».

    See the answer

    Answer: Unsupported. Comparable series and a definition of adoption are missing.

  4. «There is initial technical activity».

    See the answer

    Answer: Supported with limits. S01, S03 and S04 describe activity, not commercial success.

Adversarial test: if S03 is removed, every reference to that evidence must disappear.

And now, your own answer

This part needs professional judgement: there is no automatic marking. Complete your work in the practice, rate it with the lesson's rubric and compare it with the indicative solution.

What your answer should include

  • Each claim points to an ID and a passage.
  • You detect at least two claims that exceed the evidence.
  • If you remove S03, every reference to that evidence disappears.
  • You do not cite sources that have not been supplied.
Self-assessment rubric (0–2 per criterion)

This rubric does not set the grade of the certified exam.

Indicative solution

Only «there is initial technical activity» is supported, and with limits, by S01, S03 and S04: the documents describe activity, not commercial success. Adversarial test: when S03 is removed, every reference to that evidence must disappear.

Illustrative solution for a fictional case: reasoned alternatives are valid.

Common mistakes

Asking for «reliable sources» without defining relevance; taking a link you have not opened as verified; mixing facts from the corpus with external data without labelling; treating the number of headlines as the number of corroborations; not saving the moment of access; forgetting jurisdiction in regulation.

Rule to take away: no link replaces the explicit relationship claim → evidence → limit of that evidence.

Optional extensionLab · Auditing an AI response

Situation: the convincing answer we cannot publish

The management of Company A, an industrial manufacturer, asks: «Are there enough indications to invest in industrial thermal storage in the next financial year?». A person consults their AI assistant. The assistant returns:

«Industrial thermal storage is already widely deployed in Europe. Three competitors launched commercial solutions in 2026, production costs have fallen by 40% and regulation will require its adoption. Recommendation: immediate investment».

Warning: the paragraph above is a simulated response, not a real statement about technology, companies or regulation. It must not be indexed or shared outside the context of this case.

The problem is that a fluent response mixes five kinds of claims: adoption, competitors, costs, legal obligation and recommendation. None comes with a verifiable primary document or defines a date, jurisdiction or scope.

Interactive · Tag the text

Break down the convincing answer

Before looking at the table, label each fragment of the simulated answer by the type of statement.

Activity: label each statement in the simulated AI answer.

The first task is not to ask again, but to break it down

ID Example claim Type Minimum evidence needed Status Editorial decision
A01 «Widely deployed» Vague quantitative assessment Definition of deployment, population and measurable share Not demonstrated Rewrite as a hypothesis or delete
A02 «Three competitors have launched» Testable fact Launch announcements, specifications and date per company Not demonstrated Request the primary source for each launch
A03 «Costs have fallen 40%» Numerical claim Time base, unit, methodology and source Not demonstrated Withdraw the figure until verified
A04 «Regulation will require» Legal claim Published rule, article, scope, deadlines and validity Not demonstrated Consult the official source and a specialist
A05 «Invest immediately» Recommendation Options, risks, reversible investments and decision criteria Premature Replace with a conditional decision

Rule: the fact that the AI can provide a link does not in itself prove that the link supports the claim. Check the page, date, scope and whether the quotation matches the text.

Technique: verifiable chain of evidence

For each claim, keep the following fields:

  1. Identifier: A01…; avoids losing the link with the report.
  2. Exact claim: copy only the proposition that needs proof.
  3. Locatable source: URL or document and section; if none exists, «no evidence».
  4. Nature of the source: official register, company document, research, secondary news, commentary.
  5. Publication date and access date: distinguish historical facts from current validity.
  6. Degree of support: direct, partial, contradictory or absent. Do not replace it with an invented percentage.
  7. Consequence for the decision: what we would do differently depending on whether it is confirmed or ruled out.
  8. Reviewer and review date.

What a responsible correction looks like

Instead of «we must invest immediately», the didactic briefing should say:

«The signals in the file suggest an emerging interest in industrial thermal storage, but the available evidence is not enough to establish commercial adoption, cost reduction or regulatory obligation. We recommend a limited technical assessment, two interviews with potential users and monitoring of official publications before approving an irreversible investment».

Important: this text is also a simulated recommendation, conditional on fictional evidence. It illustrates an argumentative structure; it does not represent a market conclusion.

If a link is missing, the claim is left as “no evidence”. The degree of support is not replaced by a percentage.

Professional prompt for you to take away

Act as a claim auditor in a competitive intelligence process.
GOAL: review a draft intended for [recipient] to support the decision [decision].
MATERIAL: [paste text and available references].

DO NOT research or cite sources that you have not actually consulted.
If you lack browsing or access to a source, say so expressly.

1. Extract atomic claims and number them.
2. Classify each one: fact, estimate, interpretation, hypothesis, recommendation.
3. For each claim, link the evidence provided or mark «not verified».
4. Point out omissions of period, scope, unit, method and primary source.
5. Distinguish disagreement between sources from absence of evidence.
6. Write a defensible version, keeping relevant uncertainties.
7. Propose specific checks and a human owner for each.
8. Do not turn correlations into causality or repeated mentions into independent sources.

RETURN:
A) claim-evidence matrix; B) pending critical points;
C) revised text; D) conditional decision options;
E) verification plan with owner and date.
Optional extensionExtension · Step-by-step audit exercise

Classify the five fictional claims (A01–A05) with one of these four actions: «I would accept with a primary source», «Needs review», «Hypothesis, not fact», «I would not publish». Justify one of them in two sentences and choose one check. What counts is not getting the label right, but recognising what evidence is missing and which decision would change.

Indicative solution: A01 and A03 require a definition and a quantitative base; A02, a primary check per actor; A04, review against an official source; A05 does not follow directly from A01–A04. If the data are insufficient, a conditional recommendation may be better than no action at all.

Interactive · Decide

Step-by-step audit: what would you do with each statement?

Five cards, four possible actions. What matters is recognising what evidence is missing.

Activity: decide what you would do with each statement A01–A05.

When not to delegate to AI

Do not let an assistant decide regulatory compliance on its own, replace legal advice, automatically send high-impact conclusions or feed confidential information into unauthorised systems. Data processing depends on the provider, the configuration and the contractual terms; it cannot be deduced from the use of MCP or from a prompt.

Assessment rubric (0–2 points per criterion)

Criterion 0 1 2
Atomicity Groups several facts Separates some Separates all key claims
Verification Accepts citations without reading Checks links Checks support, date, scope and primacy
Uncertainty Fictitious certainty Warns in general terms Makes gaps and implications explicit
Decision Recommends unconditionally Recommends with generic caution Defines thresholds and reversible options
Reuse Generic prompt Some instructions Repeatable protocol with fields and validation

A total of 8–10 indicates that the exercise is well solved; this is our own teaching rubric, not a normative instrument.

Optional extensionExtension · The minimum file that lets you reproduce a conclusion

Verification does not consist of accumulating URLs. It consists of reconstructing the sequence specific claim → located document → relevant fragment → scope → cross-check or gap. A corporate publication may serve to establish that a company announced a pilot, but not necessarily that the pilot was completed successfully. Evidential value is specific to the claim. Also record the date of the document and, where it matters, that of the event: they are not interchangeable.

A useful file contains: claim_id, evidence_id, document, issuer, document_date, access_date, passage, claim_supported, limit, independence, review_owner. In a fictional corpus, a didactic ID replaces the real URL; never pretend to have cross-checked an external source.

Company A case · Four claims, four review decisions

Working claim What does the fictional corpus allow? Editorial correction
«Supplier B filed a patent application» S03 represents a simulated application «According to S03, an application is reported»; not a grant
«The technology already sells at scale» S01–S04 document no sales No support in this corpus
«There are two independent sources» A note and its reproduction may depend on the same origin Record the chain of provenance before counting corroborations
«There are no regulatory changes» A period with no alerts does not prove absence Check coverage, cadence and the relevant official source

Workshop · The persuasive answer that fails the audit

Give these sentences to an assistant, together with S01–S04 explicitly identified as simulations: «The patent proves protected advantage», «the demonstrator confirms industrial feasibility», «its market doubled» and «it is advisable to invest before next quarter». Ask it to point out the exact passage for each, classify as supported / partially supported / unsupported, propose a faithful wording and say which real document would be needed. Then manually assess the four rows with R07. A row is only acceptable if it goes back to an ID and states precisely what we cannot conclude.

Adversarial test: remove S03 without telling the assistant and repeat the task. It must recognise the loss of evidence, not reproduce an absent quotation. Deliverable: R07 AI output audit + R06 Log of signals and evidence;

References and limits

  • NIST. Artificial Intelligence Risk Management Framework (AI RMF 1.0), NIST AI 100-1 (2023). DocumentAI risk management as a voluntary framework. The Academy's claim audit is our own work, not a NIST procedure.Reference verified on 2026-10-18.
  • NIST. Artificial Intelligence Risk Management Framework: Generative Artificial Intelligence Profile, NIST AI 600-1 (2024). DocumentRisks specific to generative AI, including confabulation.Reference verified on 2026-10-18.
  • Company A is a fictional case: its data, companies and figures do not describe real markets or organisations.
  • The AI guidelines are the Academy's own work. They are not a NIST procedure and do not replace a risk assessment by your organisation.

Intelligence Lab · L05

Evidence auditor

Ready to apply it? Open the Evidence auditor in the Lab and review each claim: fact, inference, error or lack of evidence. Output: claim audit. Works in the browser, no server, no account and no connected AI. The result may need reviewing and adapting to your case.

Intelligence Lab · L09

Intelligence prompt factory

Ready to apply it? Open the Prompt factory in the Lab and generate a reusable prompt for your next intelligence product. Output: reusable prompt. Works in the browser, no server, no account and no connected AI. The result may need reviewing and adapting to your case.