RLHF
Reinforcement learning from human feedback, the alignment technique behind ChatGPT.
/ quick answer
RLHF trains a reward model from human preference pairs, then fine-tunes the base LLM with PPO to maximize that reward. Result: models that follow instructions and refuse unsafe requests. Reinforcement learning from human feedback, the alignment technique behind ChatGPT.
What is RLHF?
RLHF trains a reward model from human preference pairs, then fine-tunes the base LLM with PPO to maximize that reward. Result: models that follow instructions and refuse unsafe requests.
What is an example of RLHF?
ChatGPT's instruction-following polish comes from RLHF applied on top of GPT-3.5.
Why does RLHF matter for AI and automation?
Reinforcement learning from human feedback, the alignment technique behind ChatGPT. It connects to the workflows, prompts and tool stacks linked on this page, so you can move from definition to execution without leaving Onexial.