System Design

Rubric + Sample Q&A

how to evaluate your model in production and monitor whether its accuracy is still satisfactory, how to detect data distribution shifts and deal with them, how often to retrain the model, and how to make sure that a newly trained model is better.