Model Performance Comparison (Cohort Analysis)

Our model behavior is quite complicated, especially when we have large amount of data. We really want to understand how our model performs in various subsets of our data.

With model performance comparison, we are able to answer questions like how did the model performance differ when our users were in San Francisco vs. when our customers were from Detroit. We can find weaknesses in our model behavior and fix them to ensure there are no biases in our model.