Skip to main content

Course

Extreme Gradient Boosting with XGBoost

Intermediate

4.2+

Updated 03/2025

Learn the fundamentals of gradient boosting and build state-of-the-art machine learning models using XGBoost to solve classification and regression problems.

Start Course for Free

Included withPremium or Teams

PythonMachine Learning4 hours16 videos49 Exercises3,750 XP54,191Statement of Accomplishment

Create Your Free Account

or

By continuing, you accept our Terms of Use, our Privacy Policy and that your data is stored in the USA.

Training 2 or more people?

Try DataCamp for Business

Loved by learners at thousands of companies

Course Description

Do you know the basics of supervised learning and want to use state-of-the-art models on real-world datasets? Gradient boosting is currently one of the most popular techniques for efficient modeling of tabular datasets of all sizes. XGboost is a very fast, scalable implementation of gradient boosting, with models using XGBoost regularly winning online data science competitions and being used at scale across different industries. In this course, you'll learn how to use this powerful library alongside pandas and scikit-learn to build and tune supervised learning models. You'll work with real-world datasets to solve classification and regression problems.

Prerequisites

Supervised Learning with scikit-learn

1

Classification with XGBoost

Welcome to the course!

Which of these is a classification problem?

Which of these is a binary classification problem?

Introducing XGBoost

XGBoost: Fit/Predict

What is a decision tree?

Decision trees

What is Boosting?

Measuring accuracy

Measuring AUC

When should I use XGBoost?

Using XGBoost

2

Regression with XGBoost

Regression review

Which of these is a regression problem?

Objective (loss) functions and base learners

Decision trees as base learners

Linear base learners

Evaluating model quality

Regularization and base learners in XGBoost

Using regularization in XGBoost

Visualizing individual XGBoost trees

Visualizing feature importances: What features are most important in my dataset

3

Fine-tuning your XGBoost model

Why tune your model?

When is tuning your model a bad idea?

Tuning the number of boosting rounds

Automated boosting round selection using early_stopping

Overview of XGBoost's hyperparameters

Tuning max_depth

Tuning colsample_bytree

Review of grid search and random search

Grid search with XGBoost

Random search with XGBoost

Limits of grid search and random search

When should you use grid search and random search?

4

Using XGBoost in pipelines

Review of pipelines using sklearn

Exploratory data analysis

Encoding categorical columns I: LabelEncoder

Encoding categorical columns II: OneHotEncoder

Encoding categorical columns III: DictVectorizer

Preprocessing within a pipeline

Incorporating XGBoost into pipelines

Cross-validating your XGBoost model

Kidney disease case study I: Categorical Imputer

Kidney disease case study II: Feature Union

Kidney disease case study III: Full pipeline

Tuning XGBoost hyperparameters

Bringing it all together

Final Thoughts

Extreme Gradient Boosting with XGBoost

Course
Complete

Earn Statement of Accomplishment

Add this credential to your LinkedIn profile, resume, or CV
Share it on social media and in your performance review

Included withPremium or Teams

Don’t just take our word for it

*4.2

from 35 reviews

54%

26%

11%

9%

0%

Highest to Lowest
Lowest to Highest
Most recent
Top reviews

Kevin H.

about 1 month

Very good course, the instructor was clear and very good at explaining the content

Li D.

about 2 months

The course is for exploring machine learning. The instructor provides clear explanations which help with learning. Highly recommended!

Orlando R.

6 months

Excellent instructor. He explains a lot of difficult concepts with ease. The examples were great so as the exercises. Highly recommended.

Thomas M.

12 months

Exzellent!

Louis B.

about 1 year

Good coverage of an important topic.

"Very good course, the instructor was clear and very good at explaining the content"

Kevin H.

"The course is for exploring machine learning. The instructor provides clear explanations which help with learning. Highly recommended!"

Li D.

"Excellent instructor. He explains a lot of difficult concepts with ease. The examples were great so as the exercises. Highly recommended."

Orlando R.

Join over 16 million learners and start Extreme Gradient Boosting with XGBoost today!

Create Your Free Account

or

By continuing, you accept our Terms of Use, our Privacy Policy and that your data is stored in the USA.