What is instruction tuning?

Instruction tuning is the process of fine-tuning a pretrained language model on examples of instructions paired with desired outputs. It teaches the model to follow user instructions rather than just continue text. Instruction tuning is what turned raw GPT-3 into the helpful chatbot ChatGPT, and it is the bridge between pretraining and conversational behavior.