MemotivaPrompt Engineering Patterns: Chain-of-Thought (CoT), Zero-Shot CoT, Reasoning for Complex Tasks

How does self-consistency improve over standard chain-of-thought?

Prompt Engineering Patterns: Chain-of-Thought (CoT), Zero-Shot CoT, Reasoning for Complex Tasks

Audio flashcard · 0:18

Nortren·

How does self-consistency improve over standard chain-of-thought?

0:18

Standard CoT relies on a single reasoning path that may have errors. Self-consistency exploits the fact that multiple correct reasoning paths usually converge to the same answer, while incorrect paths diverge. By sampling 10 to 40 chains and taking the majority answer, accuracy on benchmarks like GSM8K improves by 12 to 18 percent over single-path CoT.
arxiv.org