Monitoring Machine Learning 개념

The first chapter will explain why businesses need to monitor your machine learning models in production. You will learn about the ideal monitoring workflow and the steps involved, as well as some of the challenges that monitoring systems can face in production.

In Chapter 2, you'll discover the fundamental importance of performance monitoring in a reliable monitoring system. We'll explore the common challenges faced in real-world production environments, such as the availability of ground truth. By the end of the chapter, you'll know how to handle situations when ground truth data is delayed or absent , using performance estimation algorithms.

Now that you know the basics of covariate shift and concept drift in production, let''s dive a little bit deeper. At the end of this chapter, you will know the different ways to detect and handle them in real-world scenarios.