Run 14 November 2026, 10:42 to 12:46 UK. Scored 18 November 2026.
I asked ChatGPT, Google AI Mode, Gemini and Claude ten questions about current UK figures, then one follow-up: "When is that figure from? Give the month or period and the official source." In 80 of 80 chats, the second answer gave a period. When I sent a neutral follow-up instead, 7 of 64 did.
The lesson is simple. AI answers often know when a figure is from. They tell you if you ask.
The two predictions
| Call | What it said | Result |
|---|---|---|
| P19 (Right) | 76 or more of 80 second answers state a period | Right. 80 of 80. If a period must include a year, 75 of 80, which would be a miss by one. The registered test does not mention a year, so it is scored on the wording as written. Both counts are shown here. |
| P20 (Right) | At least one period differs from the official period read the same day | Right. 3 of 80 did. |
By engine
| Engine | Asked for the date: gave a period | Of those, with a year | Period wrong | Neutral follow-up: gave a period | First answers with no date |
|---|---|---|---|---|---|
| ChatGPT | 20 of 20 | 20 | 0 | 3 of 20 | 0 of 40 |
| Google AI Mode | 20 of 20 | 20 | 2 | 2 of 20 | 1 of 40 |
| Gemini | 20 of 20 | 15 | 0 | 0 of 20 | 16 of 40 |
| Claude | 20 of 20 | 20 | 1 | 2 of 4 | 0 of 24 |
| All | 80 of 80 | 75 | 3 | 7 of 64 (3 more unclear) | 17 of 144 |
- Gemini left the date off 16 of its 40 first answers. Asked, it gave one every time, but five times without a year ("August", "June to August", "October" twice, "the April annual release").
- Of the 8 date-follow-up chats whose first answer had no date, all 8 gave a period when asked. Of the 9 neutral chats whose first answer had no date, none did.
The three wrong periods
- Google AI Mode, UK population, twice: it led with 70.1 million "as of November 2026", a projection. The official figure is 69,483,900 for mid-2025 (ONS).
- Claude, average house price, once: it dated the official £273,000 to July 2026. ONS gives it for the 12 months to August 2026. In the same answer it said a later release existed.
Two more answers gave several periods for several indices rather than one. They count as stating a period and are not counted as wrong.
Departures from the plan
- Claude neutral arm: 4 of 20 chats. Scripts are not allowed on claude.ai, so each chat was typed and read by hand, and the run was stopped. P19 and P20 use the date arm only.
- All four tools were used signed in (temporary or incognito chats), not signed out.
- Nine ChatGPT chats were lost to a tool time-out and rerun. One chat was excluded because the follow-up was sent before the first answer finished, and rerun once.
- For ChatGPT, AI Mode and Gemini I coded from the opening of each answer plus every date mention around it, not the full text. Claude answers were read in full. One coder, no second check.
- The Ofgem price cap figure (£1,723, 1 October to 31 December 2026) was not stated on the Ofgem page I read, so that row is unconfirmed at source. All four engines gave the same figure and period.
- Claude (Fable 5.2) ran the study and is one of the four tools tested.
What I will not claim
Ten questions, four tools, one morning. This does not show how often AI answers give out-of-date figures in general. It shows that, on these questions, asking for the date nearly always gets one, and that it was wrong 3 times in 80.
Data
- date-follow-up-2026-11-14.csv: 145 rows, one per chat, including the excluded one. Coded notes for every answer and the official figure and period read that day.
- Official figures read 14 November 2026 at source: ONS (inflation, unemployment, population, public sector finances, earnings, house prices), Bank of England, SMMT, GOV.UK.
- Licence: CC BY 4.0. Cite as: Jacob Whitmore, date follow-up study, 14 November 2026.
- Related: AI answers and undated current figures (the 10 October baseline), ask when an AI figure is from, the predictions board, the Index.