Direkt zum Inhalt
StartseiteMachine LearningMonitoring Machine Learning Concepts

Monitoring Machine Learning Concepts

Learn about the challenges of monitoring machine learning models in production, including data and concept drift, and methods to address model degradation.

Kurs Kostenlos Starten
2 Stunden11 Videos33 Übungen

Kostenloses Konto erstellen

GoogleLinkedInFacebook

oder

Durch Klick auf die Schaltfläche akzeptierst du unsere Nutzungsbedingungen, unsere Datenschutzrichtlinie und die Speicherung deiner Daten in den USA.
Group

Trainierst du 2 oder mehr?

Versuchen DataCamp for Business

Beliebt bei Lernenden in Tausenden Unternehmen


Kursbeschreibung

Machine Learning Monitoring Concepts

Machine learning models influence more and more decisions in the real world. These models need monitoring to prevent failure and ensure that they provide business value to your company. This course will introduce you to the fundamental concepts of creating a robust monitoring system for your models in production.

Discover the Ideal Monitoring Workflow

The course starts with the blueprint of where to begin monitoring in production and how to structure the processes around it. We will cover basic workflow by showing you how to detect the issues, identify root causes, and resolve them with real-world examples.

Explore the Challenges of Monitoring Models in Production

Deploying a model in production is just the beginning of the model lifecycle. Even if it performs well during development, it can fail due to continuously changing production data. In this course, you will explore the difficulties of monitoring a model’s performance, especially when there’s no ground truth.

Understand in Detail Covariate Shift and Concept Drift

The last part of this course will focus on two types of silent model failure. You will understand in detail the different kinds of covariate shifts and concept drift, their influence on the model performance, and how to detect and prevent them.
Für Unternehmen

GroupTrainierst du 2 oder mehr?

Erhalten Sie für Ihr Team Zugriff auf die vollständige DataCamp-Bibliothek mit zentralisierten Berichten, Zuweisungen, Projekten und mehr
Testen Sie DataCamp for BusinessFür eine maßgeschneiderte Lösung buchen Sie eine Demo.

In den folgenden Tracks

Associate AI Engineer für Datenwissenschaftler

Gehe zu Track

IMachine Learning Engineer

Gehe zu Track

Machine Learning in der Produktion in Python

Gehe zu Track
  1. 1

    What is ML Monitoring

    Kostenlos

    The first chapter will explain why businesses need to monitor your machine learning models in production. You will learn about the ideal monitoring workflow and the steps involved, as well as some of the challenges that monitoring systems can face in production.

    Kapitel Jetzt Abspielen
    Why you need to monitor your model
    50 xp
    Why models fail?
    50 xp
    The benefits of monitoring systems
    50 xp
    The ideal monitoring workflow
    50 xp
    The importance of monitoring KPIs
    50 xp
    Ideal monitoring workflow
    100 xp
    Monitoring workflow in real-life scenario
    100 xp
    Challenges of monitoring ML models
    50 xp
    Delayed ground truth
    100 xp
    Covariate shift vs concept drift
    100 xp
  2. 2

    Theoretical Concepts of monitoring

    In Chapter 2, you'll discover the fundamental importance of performance monitoring in a reliable monitoring system. We'll explore the common challenges faced in real-world production environments, such as the availability of ground truth. By the end of the chapter, you'll know how to handle situations when ground truth data is delayed or absent , using performance estimation algorithms.

    Kapitel Jetzt Abspielen
  3. 3

    Covariate Shift and Concept Drift Detection

    Now that you know the basics of covariate shift and concept drift in production, let''s dive a little bit deeper. At the end of this chapter, you will know the different ways to detect and handle them in real-world scenarios.

    Kapitel Jetzt Abspielen
Für Unternehmen

GroupTrainierst du 2 oder mehr?

Erhalten Sie für Ihr Team Zugriff auf die vollständige DataCamp-Bibliothek mit zentralisierten Berichten, Zuweisungen, Projekten und mehr

In den folgenden Tracks

Associate AI Engineer für Datenwissenschaftler

Gehe zu Track

IMachine Learning Engineer

Gehe zu Track

Machine Learning in der Produktion in Python

Gehe zu Track

Mitwirkende

Collaborator's avatar
George Boorman
Collaborator's avatar
Arne Warnke

Voraussetzungen

MLOps ConceptsSupervised Learning with scikit-learn
Hakim Elakhrass HeadshotHakim Elakhrass

Co-founder and CEO of NannyML

Mehr Anzeigen

Was sagen andere Lernende?

Melden Sie sich an 14 Millionen Lernende und starten Sie Monitoring Machine Learning Concepts Heute!

Kostenloses Konto erstellen

GoogleLinkedInFacebook

oder

Durch Klick auf die Schaltfläche akzeptierst du unsere Nutzungsbedingungen, unsere Datenschutzrichtlinie und die Speicherung deiner Daten in den USA.