In partnership with
This event is in partnership with Technology Ireland Digital Skillnet and therefore attendees are required to submit additional information on booking for general statistical purposes. See the privacy statement here.
Trust but Verify: Validating AI-generated Analysis, Hallucinated Numbers, Hidden Assumptions, and Building an Audit Trail
AI tools can produce polished analysis in seconds, but polished isn’t the same as correct. This masterclass moves beyond the principles of critical thinking to give you a practical, repeatable process for checking AI-generated outputs before they make their way into a report or a slide, or influence a decision.
This masterclass will guide you through efficient ways to trace figures back to their source, spot hallucinated numbers and unsupported claims, surface the assumptions an AI tool has made, and record your checks so others can see exactly how a result was verified. Along the way, you’ll build a practical verification checklist you can use straight away, so you can work with AI confidently without taking its outputs on trust.
Learning Outcomes
By the end of the session, you’ll walk away with a practical verification checklist you can use straight away, so you can work with AI confidently without taking its outputs on trust. Participants will be able to:
- Check the Numbers:
- Apply quick reconciliation techniques - such as recalculating totals, sense-checking magnitudes and tracing figures to source data, to catch hallucinated or miscalculated numbers.
- Prompt the AI tool to show its working and cite its sources, then confirm those sources are reputable and reliable, and actually say what is claimed.
- Uncover Hidden Assumptions:
- Identify the definitions, filters and assumptions an AI tool has applied without telling you, and test how much the conclusions change when you challenge them.
- Build an Audit Trail:
- Record prompts, sources, versions and verification steps so your AI-assisted analysis is transparent, reproducible and easy to defend.
Target Audience
This masterclass is designed for analysts, report writers and anyone who uses AI tools to produce or review analysis, figures or recommendations.
It is also relevant to those who attended our critical thinking webinar and want practical next steps.
