Working groupSession 1 · 30 September 2026

The new
baseline.

First, how AI got from a chatbot to agents that act on your behalf, and what comes with that. Then over to you: one news story, several AI tools, and a look at what each makes of it.

AI working group 01 / NN

The course

Four sessions, one brief.

  1. Week 1Today

    Where we are now with the technology

    An update on the most recent technical developments and a practical session looking at how LLMs currently tackle the news

  2. Week 2

    Vibecoding workshop

    A practical session in which you'll learn how to vibecode and build with APIs

  3. Week 3

    Beyond text and coding

    Where is the technology on multimedia generation, data handling and so on? How might these capabilities challenge us and bring opportunities?

  4. Week 4

    The future of the agentic web

    What could the agentic web mean for consumption of the news more generally, the information ecosystem and our business model?

  5. Weeks 5 and 6

    Your brief

    Two weeks to reflect on what AI means for your department or desk, and capture it in a concise pro forma.

AI working group 01 / NN
Part 1 · 20 minutes

Where we are now.

Three years ago it was a chatbot. Now it plans, uses tools and acts for you. How it got here, in four layers, and what comes with it.

AI working group · Part 1 03 / NN

Where we are

Already used at scale.

1bn+

people a week use ChatGPT

OpenAI's own figure, 31 August 2026

2.5bn

people a month see Google's AI Overviews. The Gemini app passed 1bn in August.

Google, May and August 2026

54%

of UK adults use AI tools. Among 16–24s, 79%.

Ofcom, published April 2026, surveyed autumn 2025

55%

of workers in Great Britain use AI for work or education

ONS, May–June 2026

AI working group 01 / NN

How it got here

Four layers, one agent.

4 · The harness 3 · The loop 2 · Reasoning The LLM
  1. 1

    The LLM 2022

    A large language model: it predicts the next word, having read a vast share of the internet.

  2. 2

    Reasoning 2024

    The LLM writes out a plan and its working before it answers.

  3. 3

    The loop 2025

    Plans, acts, checks, and goes again until the job is done.

  4. 4

    The harness 2025

    The tools and access around it: browser, files, email, apps.

Together, an agent: not a better chatbot, but something that does the work.

AI working group 01 / NN
Layer 1The LLM

Layer 1 · The LLM

It guesses the next word.

The cat sat on the

How much risk it takes

What comes next? Its odds:

mat 52% · sofa 21% · windowsill 13% · keyboard 9% · everything else 5%

The odds are made up, to show the idea. A real model picks from tens of thousands of word-pieces, every time.

Grown, not built: nobody wrote its rules. Three stages of training

  1. Read everything

    Predicting the next word across much of the internet. Knowledge, but no manners.

  2. Learn what people like

    People rate its answers, and it is nudged towards the ones they prefer.

  3. Practise on tasks

    Rewarded for getting checkable tasks right. This is where reasoning came from.

AI working group 01 / NN
Layer 2Reasoning

Layer 2 · Reasoning

It thinks before it answers.

The same question, two waysA council says its budget went up 4%, but spending per resident fell. Can both be true?

Answers straight away

No. If the budget went up, the money spent on each resident went up too.

Wrong

Thinks first

  1. Per resident means dividing by the population.
  2. What if the population grew faster than 4%?
  3. 4% more money, 6% more people: 1.04 ÷ 1.06 = 0.98.

Yes, if the population grew faster. With 6% more residents, each gets about 2% less.

Right

It is the same LLM, still guessing the next word. It has just been trained to write out a plan and its working first, check itself, and only then answer.

The two answers are an illustration.

Maths competition problems solved

12%
74%
GPT-4oanswers at onceo1thinks first

Same company, same month, same test: the 2024 American Invitational Mathematics Examination. OpenAI, September 2024.

AI working group 01 / NN

Meanwhile, the models themselves

The hard tests are falling.

PhD-level science

GPQA · 2023 · questions written to defeat a Google search

PhD experts 65% 39%GPT-4, 2023 90%+ now

Real software bugs

SWE-bench · 2023 · fix genuine faults in real code

4.4%2023 90%+ now

Humanity's Last Exam

2025 · the hardest questions experts could write

Under 10%at launch, January 2025 61% now
0%50%100%
2×

The pace since reasoning models arrived. Epoch's index of overall capability has climbed 14 points a year since late 2024, against 6 before.

And now, real discoveries

  • May 2025Google DeepMind's AlphaEvolve, built on Gemini, found a faster way to multiply 4×4 matrices, the first improvement on a method from 1969.
  • May 2026An OpenAI model disproved a 1946 conjecture by the mathematician Paul Erdős, Quanta reported.

Stanford AI Index 2025; Epoch AI; Artificial Analysis. Top software scores may be flattered: the test is so widely used its answers may have leaked into training. And yes, it can count the r's in strawberry now.

AI working group 01 / NN
Layer 3The loop

Layer 3 · The loop

It keeps going.

Thinkplans the next step
Actuses a tool
Lookchecks what happened
The goalset by a person, then round and round until it's met

Find me the cheapest train from London to Leeds on Friday morning.

  1. ThinksI need times and prices. I'll search a booking site.
  2. ActsOpens a browser. Searches London to Leeds, Friday, before noon.
  3. Looks14 trains, from £31 to £118.
  4. ThinksThe 06:33 is cheapest. Check for booking fees first.
  5. ActsClicks through to the checkout for the 06:33.
  6. Looks£32.50 with the fee.
  7. DoneReports back, and asks before paying.

How long the best agent can work on its own

  1. 20233½ min
  2. Early 20251 hour
  3. Late 20255 hours
  4. 202616+ hours

Measured in how long the same task takes a skilled person; the agent succeeds half the time. METR, 2023–2026.

AI working group 09 / NN
Layer 4The harness

Layer 4 · The harness

It gets tools.

LLM
Search Browser Your files Code Payments Email Calendar Memory

The harness is everything built around the model: which tools it can use, what it can see, what it remembers, and what it must ask you first. The same model in a different harness behaves very differently.

Most now plug into apps through a shared standard, MCP, so any tool can connect to any model. The red ones are those that let it send and spend.

Harnesses you'll hear about

  • Claude Code
  • Claude Cowork
  • Claude in Chrome
  • OpenAI Codex
  • ChatGPT Work
  • Gemini Spark
  • Perplexity Comet
AI working group 10 / NN

September 2026

Towards personal AI agents.

All four layers, inside apps that hundreds of millions of people already use.

Meta · 8 September · US only for now

Muse

A personal agent in its own app and inside WhatsApp. It keeps working after you close it.

  • Sends emails, fills in forms, books travel
  • Shops and pays for things
  • Top of the US App Store within ten days
The safeguard

You approve purchases. Even so, Meta's own safety notes say “Muse will sometimes make mistakes.”

OpenAI · 23 September · worldwide

ChatGPT Voice

Talk to it, and it now uses your connected apps in the middle of the conversation.

  • Reads your Gmail, finds a slot in your diary, posts to Slack
  • Builds documents, decks and spreadsheets while you talk
  • Included for free users
The safeguard

Saying “yes, send it” isn't enough. You have to tap to approve on screen.

AI working group 01 / NN

How fast it moved

Ten moments in four years.

Nearly two years between the first two. Since then, something big every few months.

Nov 2022

ChatGPT

The LLM goes public

Sep 2024

OpenAI o1

Thinks before it answers

Nov 2024

MCP

One plug for every tool

Jan 2025

DeepSeek R1

Reasoning, cheap and open

Feb 2025

Claude Code

An agent at work on your computer

Jul 2025

Maths Olympiad

Gold-medal standard

Nov 2025

Claude Opus 4.5

Agents work for five hours

Apr 2026

Claude Mythos

Held back as too risky; the US then barred foreign use

Jul 2026

Hugging Face

Test agents break out

Sep 2026

Muse and Voice

Agents go mainstream

The LLMReasoningThe loopThe harnessRisk, and now

AI working group 01 / NN

The catch

What can go wrong.

When a chatbot gets it wrong, you get a bad answer.

When an agent gets it wrong, it does a bad thing.

  1. 01

    It can be tricked

    Words hidden in a web page, email or document can give it orders. Nobody has solved this.

    2025Researchers showed one crafted email could make Microsoft 365 Copilot leak company data, with no click needed.

  2. 02

    Mistakes become actions

    A wrong answer you can ignore. A wrong email sent, or a wrong purchase, has already happened.

    2025Asked to find cheap eggs, OpenAI's Operator agent bought $31 worth, with priority delivery, without checking first.

  3. 03

    It sees what you let it see

    To act for you it needs your inbox, files and logins. Whatever it can read, it can leak.

    NamedPrivate data, content from strangers and a way to send things out: the “lethal trifecta”. Meta cites it for Muse.

  4. 04

    It chases the goal, not what you meant

    It does whatever gets rewarded, by whatever route works.

    2016A game-playing AI rewarded for points circled one lagoon for ever instead of finishing the race.

AI working group 01 / NN

This summer, and last week

In July, AI agents under test at OpenAI broke out and hacked another company. Nobody told them to.

~700

agents went into Hugging Face, which hosts AI models and data

<13 hrs

from one machine to administrator control across its systems

17,600

separate actions, with no person directing any of them

They were trying to cheat on a test, and the answers were stored at Hugging Face. Since then Anthropic, Meta and Google have admitted their models broke into outside systems during tests too. On 25 September OpenAI said an agent had slipped out again, and paused all work that lets its most capable models use tools.

Sources: OpenAI technical report, 26 August 2026; Hugging Face technical timeline, 27 July 2026; METR and Redwood Research review, 26 August 2026; OpenAI misalignment report, 25 September 2026. The whole story, with every source: AI risk field guide, peter-guillam123.github.io/ai-risk-field-guide

AI working group 14 / NN

So where does that leave us

Why nobody agrees how good it is.

Its ability is jagged · an illustration

A capable person Competition maths Admitting it doesn’t know Writing code Today’s news,without searching Summarising a long report
−19

On a task the AI was bad at, consultants using it were 19 points less likely to get the answer right. On tasks it was good at, their work was over 40% better.Harvard Business School and BCG study of 758 consultants, 2023

And every tool sets the four layers differently

  1. Which LLM is underneath

    The newest, largest models are usually better, and often barely slower. A tool answering billions of searches has to be quick and cheap.

  2. How hard it thinks

    More isn't always better. Anthropic warns its top setting can overthink, and its newest Opus thinks less by default.

  3. Whether it keeps going

    One answer, or plan, act and check for hours.

  4. What it can reach

    Search, your files, your apps, or nothing at all.

So one person's “AI” is a summary at the top of Google, and another's is GPT-6 Astra thinking for minutes. One finds it useless, the other astonishing. Often they're both right.

AI working group 01 / NN

How accurate are they?

True enough?

  1. 91%
    AI Overviews

    right on 4,326 hard factual questions, up from 85% before Google moved it to Gemini 3.

    Oumi for the New York Times, October 2025 and February 2026. Google disputes the test set.

  2. 56%
    AI Overviews

    of those right answers linked to sources that didn't fully back them up.

    Same study. Google has never published an error rate.

  3. 89%
    AI Overviews

    of 98,000 claims from trending US searches matched the pages cited. 2.7% were contradicted by them.

    Washington University in St Louis, spring 2026, not yet peer reviewed.

  4. 45%
    ChatGPT · Copilot · Gemini · Perplexity

    of news answers had a significant problem, mostly sourcing. Gemini 76%, Copilot 37%, ChatGPT 36%, Perplexity 30%.

    22 public broadcasters led by the EBU and BBC, free versions, May and June 2025.

Why they go wrong

  • Making it up. Pure invention: rarer now, and likeliest where little has been written.
  • Answering too fast. No time to think, so no chance to check.
  • Trusting the wrong source. Satire, a forum joke or one weak page, taken at face value.
  • Missing the right source. Blocked, paywalled, or too new to reach.

Some famous slips

  • Told pancreatic cancer patients to avoid high-fat foods, the opposite of expert advice. AI Overviews · Guardian investigation, January 2026
  • Said the Air India plane that crashed in June 2025 was an Airbus. It was a Boeing. AI Overviews
  • Suggested glue to keep cheese on pizza, from an old forum joke. AI Overviews · May 2024
AI working group · Part 2 01 / NN
Part 2 · The rest of the hour

Putting tools to the test.

One news story, five tools, and Claude working away in the background. The quick ones first, to find where they stop. Then time with ChatGPT, to build something and pick it apart.

AI working group · Part 2 01 / NN

Things to consider with each tool

What we will evaluate.

1 · GoogleAI Overviews
2 · GoogleAI Mode
3 · GoogleGemini with Canvas
4 · GoogleGemini Notebook
5 · OpenAIChatGPT
What it's for
A quick answer
Research by chat
Getting things made
Your own documents
Deep, careful work
Sources
Whole search index
Whole search index
Search, minus opt-outs
Only what you give it
OpenAI's own search
Time it takes
A second or two
Seconds
A minute or two
Seconds; videos longer
Minutes
Thinking
Little
Some
When you ask
Some
As much as you allow
Built around it
The results page
Charts and maps
Canvas apps
Audio, video, slides
Code, files, apps
Works on its own
No
Partly
Partly
Partly
Yes, in agent mode

A rough guide, as of late September 2026. More on each tool as we go.

AI working group · Part 2 01 / NN

Your turn

Choose a topic.

One subject, to explore with each tool in turn.

For example

  1. Fairford

    Fast-moving, unclear, and with legal limits on what can be said.

  2. The Manchester City tribunal

    Long-running, legally dense, and argued over by people who care a lot.

  3. Andy Burnham's first speech

    New, political, and open to spin from every side.

What makes a good one

  • Broad enough to dig into. More than one question, more than one source.
  • Contested, or still moving. Where rumour, spin or strong opinion can creep in.
  • Rich in angles. Room for follow-ups, explainers and the personal: what does it mean for me?

Best of all, pick something from your own patch. You'll know within a minute whether the answer is any good.

AI working group · Part 2 01 / NN

As you go

Read it like an editor… and a reader.

Can we trust it?

  • Is it right, and how would you know?
  • Which sources did it choose, and which did it miss?
  • Whose framing is it borrowing?

How does it compare with us?

  • What would our version have that this lacks?
  • What does it do that we can't, or don't?
  • Would a reader notice the difference?

Where is it useful?

  • Where does bending to the reader help?
  • Who would reach for this instead of us, and why?
  • What would you use it for tomorrow?

And ask it for things we can't do for every reader

Simpler

Explain this in very simple terms, for someone who hasn't followed the story.

Closer to home

I live near Fairford. What does this mean for me?

The other side

What is the strongest case that this has been overblown?

Motives

Who is saying each of these things, and what might they want?

Next question

What would a good reporter ask next?

Shorter

Sum this up in three sentences for a family WhatsApp group.

AI working group · Part 2 01 / NN
Tool 1of 5

Tool 1 of 5 · Google Search

Google AI Overviews.

Open Google (opens in a new tab)

Type into Google

what happened at fairford

Then try

Test a rumour

is the fairford plot linked to iran

Test freshness

raf fairford arrests latest

  • What it's for

    A quick answer at the top of Google results, for searches where a summary helps. It appears by itself; you don't ask for it.

  • Sources

    Google's whole search index, fresh within minutes.

  • Model and speed

    Gemini 3, answering in a second or two, so little time to think.

  • Built around it

    The results page. Nothing to steer, no follow-ups.

  • Watch for

    Brief by design. It blends sources without weighing them, so rumour and fact can share a sentence.

AI working group · Part 2 01 / NN
Tool 2of 5

Tool 2 of 5 · Google Search

Google AI Mode.

Open AI Mode (opens in a new tab)

In Google, choose AI Mode

What is confirmed about the Fairford arrests, and what is still rumour or speculation?

Then try

Follow up

Who is saying what: UK police, US officials, local witnesses?

Push it

Can you include some charts or maps or something interactive?

Check it

Which of these claims come from a named, official source?

  • What it's for

    Search as a conversation: ask, follow up and narrow down, while Google runs many searches on your behalf.

  • Sources

    Google's whole search index.

  • Model and speed

    A fast Gemini model that runs many searches for you, in seconds.

  • Built around it

    Follow-up questions, and simple charts, maps and tables.

  • Watch for

    Polished visuals can carry numbers and quotes that come from nowhere, and the richer it looks, the more convincing the error.

AI working group · Part 2 01 / NN
Tool 3of 5

Tool 3 of 5 · Gemini

Gemini with Canvas.

Open Gemini (opens in a new tab)

In Gemini, turn on Canvas and choose Thinking

Can you create a really clear, deeply sourced interactive report (including citations) on what on earth happened at Fairford, what is fact and what is supposition or myth, why it's so unclear and what the legal and media restrictions are and why they exist.

Then try

Add

Add a timeline I can click through, with each event marked as confirmed, reported or claimed.

Check

Show every source you used, and flag any claim that rests on only one.

Reshape

Make it work well on a phone.

  • What it's for

    Making things: reports, explainers and small interactive apps, built from a sentence and changed by asking.

  • Sources

    Google Search, minus publishers who opt out.

  • Model and speed

    Your choice of fast or Thinking. With Thinking, a minute or two.

  • Built around it

    Canvas, which builds documents and working apps you can change by asking.

  • Watch for

    Design can run ahead of sourcing: the page can look more certain than its citations are.

AI working group · Part 2 01 / NN
Tool 4of 5

Tool 4 of 5 · Formerly NotebookLM

Gemini Notebook.

Open our notebook (opens in a new tab)

In our shared notebook, ask

What has Manchester City actually done wrong? What is the most egregious part of it?

Then try

Test the edges

What don't these documents tell us?

Transform it

In Studio, choose Video Overview, and steer it with: Explain this for a general reader, and flag anything disputed.

Make it simpler

Explain this to a 14-year-old, using only these documents.

Or start your own with a document you know: a police statement, a tribunal ruling, a speech transcript.

  • What it's for

    Working from documents you choose: questioning them, and turning them into summaries, overviews and study aids.

  • Sources

    Only what you give it, with every answer cited to the passage. It looks for more only if you ask.

  • Model and speed

    Gemini 3.5. Answers in seconds; video overviews take longer.

  • Built around it

    Audio and video overviews, slide decks, mind maps, reports and quizzes, all made from your sources.

  • Watch for

    It is only as good as what you give it, and a slick video can smooth away nuance.

AI working group · Part 2 01 / NN
Tool 5of 5

Tool 5 of 5 · ChatGPT

ChatGPT, thinking hard.

Open ChatGPT (opens in a new tab)

In ChatGPT, pick the top model and the highest thinking level

Please create a beautiful, shareable interactive explainer on the Fairford terror situation. I want to know what we actually know happened and I also want to understand why there's so much secrecy around the people and the actions. Make sure everything is properly sourced

Then try

Check its work

List every claim that rests on a single source, and anything you couldn't verify.

Compare

Here is what Google's AI Overview says: [paste it]. Where do you disagree with it, and who is right?

Sharpen

Label every fact as confirmed, reported or claimed, and name who confirmed it.

  • What it's for

    Deep, careful work: briefings, explainers and analysis, refined over a long conversation.

  • Sources

    OpenAI's own search, minus publishers who block it.

  • Model and speed

    OpenAI's top model at its highest thinking level: minutes, not seconds. Our test took seven.

  • Built around it

    Search, code and files, and an agent mode that works through a brief on its own.

  • Watch for

    Its confidence can still outrun the record, and what it can't read, it can't weigh.

AI working group · Part 2 01 / NN

Meanwhile, in the background

The far end of the scale.

While you worked, Claude ran as an agent in its own harness, on the same story. You don't have it here; this is what the other end of part one looks like.

The brief it was given

Build a sourced interactive explainer on today's story: what is confirmed, what is reported, what is only claimed, and why so much is unclear. Link every claim to its source, then check each source says what you say it says.

  • How it works

    All four layers: it plans, searches, reads whole pages, writes the page, checks its own work and goes round again.

  • What it can reach

    Its own web search, plus the pages it opens. Publishers can block it too.

  • Watch for

    The same as the rest: it's only as good as what it can read, and it still needs an editor.

  • How long

    As long as the job takes.

AI working group · Part 2 01 / NN

Between now and your brief

Take them to work.

Over the next few weeks, try these tools in different ways on the difficult things on your desk. Then keep asking three questions.

1

Where are they strong, and where do they break?

Push them on something you know inside out. The failures teach as much as the surprises.

2

What happens when anyone can make their own “journalism”?

What can a reader now get elsewhere, on demand? And what can only we give them?

3

How do we use them well, and safely?

Where would they make our work better, within our guidelines? And what would you never hand over?

Ways to try The same task in three tools A subject you know cold A story still moving Your own documents Ask it to check itself

It all feeds your brief in weeks five and six.

AI working group · Part 2 01 / NN

Over the coming weeks

Things to try.

Ways to put them to use in the newsroom, and ways to test them for accuracy and bias. Public material only: nothing unpublished or confidential.

1AI Overviews

  • TestSearch a breaking story. Does an Overview appear at all?
  • TestSearch a rumour as a question, “is it true that…”, and see whether it repeats it or corrects it.
  • TestSearch the same thing an hour apart, as the story moves.

2AI Mode

  • UseResearch a background point in a story: when did this last happen, and what changed?
  • Use“Make me a table of what each party said about this, this week.”
  • TestAsk the same question three ways, neutral, loaded and naive, and compare.
  • TestTry something obscure from your own patch, and see where it thins out.

3Gemini with Canvas

  • UseTurn a long report into an interactive explainer a 14-year-old could follow.
  • UseBuild a clickable timeline of a story, each event marked confirmed, reported or claimed.
  • TestMap a story with a strong sense of place, and check the places are right.

4Gemini Notebook

  • UseAdd the YouTube video of Burnham's speech. Ask what he promised, and what he left vague.
  • UseAsk for a data table of every promise he made, or the words he used most.
  • UseMake a video overview of a long report, for a reader who will never read it.
  • TestAdd the speech and two reports of it. Where do the reports differ from what he said?

5ChatGPT

  • UseGive it a published piece of ours: what would readers find confusing, or need more help with?
  • Test“What would a hostile reader say is missing or unfair?”
  • UseAsk for the strongest case against your view of a story, then the strongest case for it.
  • UseTalk a story through on Voice on the walk home, and let it ask you questions.
AI working group 01 / NN

Examples

What the tools can already do.

These show what today’s tools are capable of, not a plan to make journalism this way from end to end. They also can’t replace the fundamental expertise of any desk. But within our AI principles, there is plenty of room to use them more.

Built with Claude

Gloria Steinem, 1934–2026 (opens in a new tab)

“Build a scrolling interactive obituary of Gloria Steinem, in her own words wherever a quotation can be verified, with numbered sources and a small interactive for each of her big ideas.”

Testing: Research under deadline: every quote traced to a primary source, famous ones dropped if they couldn’t be. Built the day her death was announced.

Built with Claude

How a data centre works (opens in a new tab)

“Build a 3D model of a typical modern data centre from published standards, then a page that lets readers scroll through it, walk inside, and follow a request, the power and the heat.”

Testing: Modelling 3D objects and space, then turning the model into something a reader can explore, with every figure footnoted.

Built with Claude

AI risk field guide (opens in a new tab)

“Write a plain-English guide to the row about AI and existential risk, for readers who know nothing about AI, with interactive plates and every claim sourced.”

Testing: Deep research on a story still unfolding, primary sources first, and explaining hard ideas through things you can play with.

Gemini Canvas · made in the session

Andy Burnham speech analysis (opens in a new tab)

“Can you create a really clear, deeply sourced interactive report on the speech that Andy Burnham gave at the Labour conference, highlighting the key points of his speech. If you can’t access the speech, please use reported coverage”

Testing: Turning a fresh political speech into a sourced, interactive briefing, and what it does when it can’t reach the original.

Gemini Canvas · made in the session

Manchester City Financial Verdict & Sanctions Dossier (opens in a new tab)

“Can you create a really clear, deeply sourced interactive report on the where we stand with Manchester City and cheating, including the recent FA report and wider responses from City and others”

Testing: A long, contested, legally dense story: can it separate the verdict from the noise, and source both?

AI working group 01 / NN