What dataset size do you need for fine-tuning?

Dataset size depends on the goal. For style transfer or output formatting, a few hundred high-quality examples can be enough. For domain adaptation, thousands to tens of thousands. For learning new capabilities, hundreds of thousands or more. Quality matters more than quantity: a small clean dataset usually beats a large noisy one.