What is the limitation of chain-of-thought reasoning?

CoT does not always produce correct answers, even when the reasoning looks plausible. Models can confidently produce wrong reasoning, hallucinate intermediate facts, or make arithmetic errors mid-chain. CoT also does not give the model new information; it cannot solve problems that depend on facts the model never learned. For knowledge-intensive tasks, combine CoT with retrieval. ---