Reasoning Models Explained: o3, Claude Sonnet Thinking, Gemini Flash Thinking — How AI Learned to “Think Before Speaking”

In 2025, OpenAI’s o3 series and Anthropic’s Claude Extended Thinking brought “reasoning models” into the public spotlight. “AI can think now?” — this question generated substantial discussion, with quite a few misconceptions along the way. This article starts from technical principles, combined with real application scenarios, to build accurate understanding of reasoning models.

The Essential Difference Between Reasoning Models and Regular LLMs

Regular LLMs generate like “intuition”: receive input → directly output a token sequence. Fast, but prone to errors on complex reasoning tasks.

Reasoning models work like “slow thinking”: receive input → internally generate a (typically hidden) thinking process (Chain of Thought) → generate the final output based on that thinking process. This “extra thinking time” (Test-Time Compute) makes models significantly more accurate on tasks requiring strict reasoning — mathematics, logic, code. Reasoning model technical papers.

Technical Implementation: Reinforcement Learning-Driven Reasoning Training

Training reasoning models isn’t simply adding chain-of-thought prompts — it involves using reinforcement learning (RL) to teach the model “when to think and how long to think.”

OpenAI o-series training: Through massive datasets of math problems, coding problems, and logic puzzles, RL trains the model to make optimal choices between “quickly giving an answer” and “thinking deeply before answering.” When problems are simple, the model learns not to expand the thinking chain; when problems are complex, the model learns to unfold detailed intermediate reasoning steps.

Anthropic’s Extended Thinking: Similar principles, implemented in Claude 3.7 Sonnet, allowing users to set a “thinking token budget” (how much the model can think before answering), trading off cost against reasoning quality.

Real Use Cases: When to Use Reasoning Models

High-value scenarios: Mathematical proofs and computation (especially multi-step calculations, zero error tolerance); complex code logic implementation (architectural decisions requiring careful weighing of multiple options); legal and contract analysis (requiring strict logical inference); strategic decision analysis (considering multiple possibilities and causal chains).

Low-value/unnecessary scenarios: Daily conversation and content generation (reasoning models are 3–10× slower and 5–20× more expensive than regular models); creative writing (reasoning capability provides limited benefit for creative output); simple information extraction (direct answers don’t require a reasoning chain).

Limitations of Reasoning Models

Reasoning models are more accurate, but not error-free. They still have significant shortcomings in: factual knowledge (strong reasoning ≠ more updated knowledge); common-sense errors (over-thinking sometimes produces counter-intuitive “intelligence trap” answers); very long context scenarios (the thinking chain itself consumes large numbers of tokens, compressing available context length).

Recommendations for Regular Users

Daily tasks: Claude Sonnet, GPT-4o (faster, cheaper); Tasks requiring strict reasoning: o3-mini, Claude Sonnet Extended Thinking; Mathematics/science/engineering professional questions: o3 full model (strongest but also most expensive). Don’t use reasoning models just to use new features — the cost and speed penalty is real.

上一篇 AI for Learning Languages: What Works and What Doesn't
下一篇 The Science of Rock Climbing: Strength Training and Movement Mechanics from Bouldering to Sport Climbing