Reinforcement Learning Examples Behind Modern LLMs: RLHF, RLAIF, and CodeRL in Practice

Supervised fine-tuning (SFT) trains a model on curated prompt-and-answer examples. It stops short once the model leaves the demo and meets real users. SFT gives the model examples to copy. It does not teach the model to rank competing answers, refuse unsafe requests, or handle prompts with multiple…