Training language models to follow instructions with human feedback
Long Ouyang, Jeff Wu, Xu Jiang et al.
2022 · arXiv (Cornell University) · 4,283 citations
Making language models bigger does not inherently make them better at following a user's intent. For example, large language models can generate outputs that are untruthful, toxic, or simply not helpful to the user. In other words, these models are not aligned with their users. In this paper, we show an avenue for aligning language models with user intent on a wide range of tasks by fine-tuning with human feedback. Starting with a set of labeler-written prompts and prompts submitted through the OpenAI API, we collect a dataset of labeler demonstrations of the desired model behavior, which we…
Explore this paper's citation graph on Constellation.