Atlasof World Models
Start

T-19 Province V · The Frontier The Observatory Tower 5 min 19 of 21 New

Reasoning Models: Deliberation, Recurrence & Test-Time Compute

Spending more thinking at answer time: chains of thought, search over alternatives, and why deliberation is a form of internal simulation.

Reasoning Models: Deliberation, Recurrence & Test-Time Compute: buying accuracy with thinking time Plain words: think, check, answer and the point where thinking longer stops helping. Architect: sampled reasoning chains, a verifier that scores partial steps, search depth and the compute knee of test-time scaling. CIO: cost per decision rises with the budget, some answers change and thinking past the knee is wasted spend. T-19 · THINK, CHECK, ANSWER A Q think check answer how often right stops helping Try a few ways, check each one, keep the one that works. samples verifier depth 3 accuracy compute knee Search over partial thoughts, scored step by step. Gains flatten. paid thinking answers changed accuracy cost wasted past here Route routine questions cheap. Spend thinking on consequential ones.
The inside of an observatory dome, a thin cobalt line branching across the plaster toward a round skylight.

In one sentence Thinking longer before answering is a way of running the world forward in your head and checking it.

Illustration of Sonu, a ten-year-old girl with a dark ponytail in a yellow shirt, holding a small notepad. Sonu, 10

Some questions you answer in a blink. What colour is the sky? You do not need to think.

Other questions need a little walk in your head. Say your friend's party starts at 4:30. You leave home at 3:40.

The drive takes 55 minutes. Will you be on time?

You cannot just blurt an answer. You run the trip forward in your mind. Twenty minutes after 3:40 it is 4:00. Another 35 minutes makes it 4:35.

You will be five minutes late. Notice what you did. You imagined the clock moving, one step at a time. Then you checked the answer before you said it.

Maybe you had a second idea, like leaving at 3:30. You could test that one too.

Some new computer helpers work this way. People call them reasoning models. Instead of answering at once, they write out steps. They try a few routes and check their own work.

Thinking longer costs them something, just like it costs you. Each extra step takes time and electricity. So the clever part is knowing when to think hard.

Nobody needs ten minutes of thinking for the colour of the sky. A tricky party trip deserves a careful walk through.

In a way, these models use a world model of the problem. They imagine what happens at each step before they commit.

Try this at home or at school. Find a maze in a puzzle book. Before you draw any line, trace two possible paths with your finger.

Notice the dead ends you avoided. Then draw the path once, without rubbing anything out.

Illustration of the Senior AI Architect, a person in glasses and a blue shirt holding a pen. Senior AI Architect

Chain-of-thought prompting showed that eliciting intermediate steps improves multi-step reasoning (Wei et al., 2022). A 540B model with eight worked exemplars set a new mark on GSM8K. It beat a fine-tuned GPT-3 that had a verifier.

Self-consistency samples many chains and votes on the final answer (Wang et al., 2022). That alone added 17.9 points on GSM8K.

Tree of Thoughts turned the chain into explicit search (Yao et al., 2023). On the Game of 24, GPT-4 with chain of thought solved 4% of tasks. With search over partial thoughts it solved 74%.

Reasoning-trained models move the skill into the weights. DeepSeek-R1 (DeepSeek-AI, 2025) learned to reason through reinforcement learning on verifiable tasks. Self-reflection and verification emerged without human-labelled reasoning traces.

Performance then scales with test-time compute. You can buy longer chains, more samples with voting or search with a verifier.

Process supervision makes the verifier sharper. One process-supervised model solved 78% of a representative subset of MATH (Lightman et al., 2023). It trained on 800,000 step-level labels.

The allocation matters as much as the amount. Compute-optimal allocation beat best-of-N by over four times in efficiency (Snell et al., 2024). In a FLOPs-matched test, extra thinking beat a model 14 times larger. That held only where the small model already had some success.

The link to world models is structural. Planning by search needs a model to predict each step. It also needs a value to judge each step. In reasoning, the world is the problem state and the model is the network itself.

Recurrent architectures make the same trade explicit. One 3.5B model iterates a recurrent block at test time (Geiping et al., 2025). Its reasoning scores keep rising up to a compute load equal to about 50B parameters.

The failure modes are known. Chains can look careful and still rest on a wrong premise. Verifiers reward what they can check, which may differ from what matters. Long deliberation on easy inputs burns money without changing the answer.

Take a high-bill complaint. Many questions are routine, such as a balance or a due date. A fast model answers those.

A rebill after a meter exchange is different. It may involve estimated reads and a rate change in the same cycle.

There, I would recommend deliberation with a hard verifier. The model proposes hypotheses for the high bill and ranks them. The rating engine recomputes each candidate bill deterministically. Only a candidate that reconciles goes to a human for approval.

Measure accuracy as a function of thinking tokens per task class. Find the knee where the curve flattens. Track the share of answers that deliberation actually changed.

Put a price on each decision. A token count alone says little.

Illustration of My CIO, a grey-haired person in a purple jacket with arms folded. My CIO

Reasoning models let you buy accuracy with time and money, one question at a time. The model thinks longer before it answers. You pay for every step of that thinking.

That turns routing into a business decision. Routine questions deserve a cheap, fast answer. Consequential decisions may deserve expensive deliberation.

Most questions in a contact centre are routine. A rebill or a disconnect decision is not.

The research supports a careful view. Extra thinking can beat a much larger model on some problems. On others it changes nothing and still costs money. One study found smart allocation over four times more efficient than brute repetition.

The risk runs both ways. Under-thinking on a consequential case produces a wrong rebill and a complaint. Over-thinking on routine traffic quietly multiplies the model bill. Neither shows up until someone measures it.

I would recommend three steps:

  • sort your agent's work into task classes by consequence
  • measure accuracy against thinking cost for each class
  • route by that evidence and review it every quarter

Pair deliberation with a hard check wherever one exists. A bill can be recomputed. A switching plan can be checked against the network model. A deliberating model with a verifier is far safer than one without.

The money story is a budget per decision. A rebill that takes a minute of model time and avoids a complaint is cheap. A balance query that takes the same minute is waste.

So ask your team one question. On which of our decisions does extra thinking change the answer?

Quick check

3 questions. Pick one answer each. Get them all right to mark this territory as checked.

1What does self-consistency add to chain of thought?

2When did extra test-time compute beat a model 14 times larger in Snell et al. (2024)?

3What should decide whether a task gets expensive deliberation?

Key terms

Further reading

  1. Chain-of-Thought Prompting Elicits Reasoning in Large Language Models Wei, Wang, Schuurmans, Bosma, Ichter, Xia, Chi, Le, Zhou, 2022 The starting point. Worked steps in the prompt lift multi-step reasoning.
  2. Self-Consistency Improves Chain of Thought Reasoning in Language Models Wang et al., 2022 Sample many chains and vote. Plus 17.9 points on GSM8K.
  3. Tree of Thoughts: Deliberate Problem Solving with Large Language Models Yao et al., 2023 Search over partial thoughts. Game of 24 rises from 4% to 74%.
  4. Let's Verify Step by Step Lightman et al., 2023 Process supervision beats outcome supervision. Releases 800,000 step-level labels.
  5. Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters Snell, Lee, Xu, Kumar, 2024 How to allocate thinking. Over four times the efficiency of best-of-N.
  6. DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning DeepSeek-AI, 2025 Reasoning learned through reinforcement learning on verifiable tasks.
  7. Scaling up Test-Time Compute with Latent Reasoning: A Recurrent Depth Approach Geiping et al., 2025 Recurrence as thinking. A 3.5B model unrolls to a compute load like 50B parameters.
  8. A Path Towards Autonomous Machine Intelligence Yann LeCun, 2022 Planning as deliberate, model-based reasoning.

Search the atlas