The Hidden Risks of Using AI for Exam Revision

Many students are turning to AI for help with revision, but it’s not always obvious where these tools support learning and where they create risks. Read on to understand the common pitfalls, why they matter for technical CII exams, and how to use AI in a way that genuinely strengthens your exam preparation.

This article is correct as at 9 December 2025.

Artificial Intelligence tools are becoming a popular go-to for students preparing for professional exams. The appeal is obvious: instant answers, personalised explanations, and even the ability to generate practice questions on demand. But while AI can be a useful aid, relying on it too heavily (especially for technical exams) can be risky.

Black Box vs Glass Box Thinking

One of the key dangers lies in the way AI models work.

A glass box approach is one where the process is transparent: you can see exactly where the information came from, how it was calculated, and why a particular answer was reached. This is what you get when you use official study texts, worked examples, or a tutor’s guidance.

By contrast, AI often works as a black box: it produces an answer without showing its full reasoning or citing authoritative sources. For technical topics like tax rates and tax free allowances, financial regulation, or insurance, this can be a major problem. You may be given an answer that sounds perfectly reasonable, but even though you can ask AI to verify the information source you have no easy way to verify if it’s accurate or based on the correct rules for your syllabus year.

The Practice Question Trap

Some students use AI to create mock exam questions. While this can seem like a great way to test knowledge, the questions AI produces are often not representative of the actual exam.

• They may not follow the style, wording, or mark allocation used by the awarding body.
• They may include content outside the syllabus or omit important topics entirely.
• They may simplify complex scenarios or, conversely, overcomplicate them beyond what the exam would require.
• They may ask questions relevant to a previous tax year therefore including the wrong rates and allowances, or answer with information relevant to different geographical regions outside of the UK.

Practising with these flawed questions can give a false sense of readiness or leave key knowledge gaps unnoticed.

Unreliable or Out-of-Date Information

Professional exam syllabuses are updated regularly by highly knowledgeable technical experts, especially where tax or regulation is involved. AI tools are not always trained on the most current rules, and unless they are specifically connected to up-to-date databases, they may provide outdated figures, limits, or processes. Worse still, AI sometimes blends fact with plausible-sounding fiction, a phenomenon often called “hallucination” in AI research.

For example, this week I asked Chat GPT what the maximum amount for a mandatory disabled facilities grant is in Northern Ireland, and it told me that it was £35,000. For the 24/25 year, this is correct, but for the current 25/26 tax year the answer is £25,000. The amount has been updated for the September 2025 CII exam syllabus, but the source Chat GPT chose for the answer is outdated. A candidate wouldn’t know this unless they already knew the answer.

The Candidate’s Knowledge Gap

The most serious problem is that a candidate who has not yet passed the exam does not yet have the depth of knowledge to challenge the AI’s output. If you don’t already know the technical detail, it’s difficult to spot when an explanation is incomplete, when a rule has been applied incorrectly, or when the answer doesn’t align with the syllabus. In other words, you don’t know what you don’t know.

A Balanced Approach

AI can still be a useful supplement for revision. For example, helping to explain a concept in different words or summarising a topic you’ve already studied from official sources. But it should never replace:

• your core learning materials such as the CII study text
• official past papers or professional mock exam papers such as Brand Financial Training’s
• guidance from qualified trainers or exam providers

When it comes to professional exams, accuracy matters more than speed. Use AI with caution, always cross-check against trusted sources, and remember that the most reliable route to passing is built on verified, syllabus-specific study materials.

Grab the resources you need!

Studying for your CII exam? Give yourself the best chance of success with plenty of practice. Explore Brand Financial Training’s Mock Exam Papers and download a free taster today!