How does Tree of Thoughts work in practice?

ToT generates multiple candidate next steps at each point, evaluates each candidate using either a heuristic or another LLM call, prunes weak branches, and explores the best ones. The process continues until a final answer is reached or a depth limit is hit. ToT is more expensive than CoT because it makes many LLM calls, but it dramatically improves performance on hard reasoning tasks.