When does few-shot prompting fail?

Few-shot fails when the task requires reasoning beyond pattern matching, when the examples introduce subtle biases that the model copies, when the task is too complex for the model regardless of examples, or when the output format the examples show is inherently ambiguous. For complex reasoning tasks, chain-of-thought prompting usually works better than pure few-shot. ---