How to Read an AI Research Report Without Being Fooled by It
A small link sits after nearly every claim, and there are forty of them across twelve pages. They crowd the comparison table and trail after the recommendation.
Each link looks like a receipt. But a link only proves a page exists, not that the page says what the sentence beside it claims.
You asked a big question, made a coffee, and came back to all this. The report reads like a week's work from a junior analyst.
The AI read the pages, but it didn't necessarily understand them. Forty links make a report feel checked long before anyone has checked it.
When a decision costs money or time, research mode is the most useful tool AI has. Research mode is a setting where AI spends several minutes reading lots of web pages and writes you a report. Claude and ChatGPT both have research mode.
So use research mode, but read the report like someone who knows AI still makes things up.
Save research mode for decisions that cost something
Ask a normal question and the answer comes in seconds, drawn from what AI already knows plus a quick look online. Research mode takes several minutes and reads dozens of pages.
So use research mode where being wrong would cost you. That might be a purchase over a couple of hundred pounds, a trip, or a company you're about to sign with. It might be a health question you want to take to a doctor instead of a search bar.
You usually only get a set number of research runs each month.
If one good source can answer the question, just search, because "What's the capital gains allowance this year" doesn't need a report.
Neither does a question of taste. You'll get a table about a holiday when what you needed was a friend who's been.
Put your decision into the question
"Research electric cars" gets you a Wikipedia article with neater formatting. A good question has five parts. The first three are the decision you're making, your situation, and what you'll do with the answer. The other two are which sources you trust and how recent those sources need to be.
I'm deciding whether to [decision], given [your situation, for example budget, limits, who it's for]. I'll use this to [what happens next]. Compare the realistic options on [the three or four things that matter to you]. Prefer [independent tests, official sites, reviews from the last 12 months] over shop pages and sponsored content. Give me a comparison table and one recommendation with reasons. Give me the strongest case against that recommendation. For every option, tell me the thing people complain about most. Mark anything you couldn't check.
Most tools show a plan or ask you a question or two first, so answer them.
Spend thirty seconds saying things like "ignore anything over £400" or "I don't care about the app". That turns a report about the topic into a report about your decision. Keep the line asking for the strongest case against, because that line stops the report praising its own conclusion.
Click three links before you read the verdict
Three claims hold the whole report up, so find them first.
Usually they are the price, the feature that matters most to you, and the main complaint. Click the link beside each one and ask these questions.
- Does the page say that? Sometimes the number's there. Sometimes the number belongs to a different model or an older price, or AI has rounded it into something neater than the source.
- Who wrote the page? It could be a shop, a brand, a forum, a lab that tested the product, or a news site that rewrote the press release. The report quotes them all in the same confident tone.
- When was it written? A glowing review from 2023 tells you nothing if the product has had two new versions since, because the one on sale now may be different.
If all three hold, read on with reasonable trust. If one fails, treat the rest of the report as a tidy starting point and check anything you'd act on.
If two fail, ask AI to redo the research and leave out the bad sources. That happens more than you'd like.
Read around the recommendation
The recommendation is the least interesting part. Think of the recommendation as an average of whatever was easy to find online.
Read the case against first. Every real option has a real downside, so a weak case against means the research didn't go deep.
Then read what's marked as not checked, because that's your to-do list. That list usually holds the thing that matters, for example whether the warranty covers the problem, or whether that clinic is still open.
Remember what AI couldn't read
Research mode reads what's public and easy to find online. But the best source on a local builder is the neighbour who used them, and the neighbour isn't online.
Research mode can't log in to websites either. Anything behind a paywall or an account is invisible to AI, and AI won't always tell you so.
Whatever there's lots of online gets the most weight. A product with loud fans gets a kinder report than a quiet one that works.
If you have a medical or legal question, take the report to the professional, because they have the last word.
Add what AI doesn't know about you
AI doesn't know you hate noise, or that you tried the cheaper one in 2019 and it broke. You know, and the choice is yours, so add that in before you pick.
AI doesn't know your mum lives round the corner from option B.