After doing these courses, I feel confident creating professional visualizations and dashboards
Shoebur RahmanProcurement Specialist, Giz Bangladesh
Course Description
Combine the efficiency of Generative AI with the understanding of human expertise in this course on Reinforcement Learning from Human Feedback. You’ll learn how to make GenAI models truly reflect human values and preferences while getting hands-on experience with LLMs. You’ll also navigate the complexities of reward models and learn how to build upon LLMs to produce AI that not only learns but also adapts to real-world scenarios.
Prerequisites
Curriculum
Course outline
1
Foundational Concepts
This chapter introduces the basics of Reinforcement Learning with Human Feedback (RLHF), a technique that uses human input to help AI models learn more effectively. Get started with RLHF by understanding how it differs from traditional reinforcement learning and why human feedback can enhance AI performance in various domains.
- Introduction to RLHF50 XP
- Text generation with RLHF100 XP
- Classifying generated text for RLHF100 XP
- RL vs. RLHF50 XP
- Exploring pre-trained LLMs50 XP
- Tokenize a text dataset100 XP
- Fine-tuning for review classification100 XP
- Preparing data for RLHF50 XP
- Preparing the preference dataset100 XP
- Extracting prompts50 XP
2
Gathering Human Feedback
Discover how to set up systems for gathering human feedback in this Chapter. Learn best practices for collecting high-quality data, from pairwise comparisons to uncertainty sampling, and explore strategies for enhancing your data collection.
3
Tuning Models with Human Feedback
In this Chapter, you'll get into the core of Reinforcement Learning from Human Feedback training. This includes exploring fine-tuning with PPO, techniques to train efficiently, and handling potential divergences from your metrics' objectives.
4
Model Evaluation
Explore key techniques for assessing and improving model performance in this last Chapter of Reinforcement Learning from Human Feedback (RLHF): from fine-tuning metrics to incorporating diverse feedback sources, you'll be provided with a comprehensive toolkit to refine your models effectively.
Reinforcement Learning from Human Feedback (RLHF)
Course
Complete
