What is self-consistency in chain-of-thought?

Self-consistency is a technique where you sample multiple chain-of-thought completions from the model and pick the most common final answer by majority vote. It improves accuracy on tasks where there are many valid reasoning paths to the same answer. The cost is multiple forward passes, but the accuracy gain is often worth it for hard math and reasoning problems.