Production Machine Learning Monitoring: Principles, Patterns and Examples (Alejandro Saucedo). Covering Explainability, Outlier Detection, Concept Drift, Adversarial Detection and Performance Monitoring of production machine learning systems.
Sections:
Intro: (0:00)
Motivations (2:17)
Usecase Overview - Iris Classifier (3:37)
Deploying ML Model (4:56)
Monitoring Overview (6:31)
Performance Monitoring (8:25)
Statistical Monitoring (11:10)
Explainability Monitoring (17:50)
Outlier / Drift Monitoring (23:09)
Ensemble Monitoring Patterns & Outro (26:25)