1. Discriminative vs Generative models: what are the differences? What are the advantages and disadvantages of each?
Discriminative Models ($P(Y|X)$):
- Concept: They learn the boundary between classes. They care about "what differentiates a cat from a dog", not "what makes a dog a dog".
-
Goal: Map input
$X$ to label$Y$ directly. - Examples: Logistic Regression, SVM, Neural Nets (standard classifiers).
- Advantages:
- Generally higher accuracy for classification tasks because they focus purely on the decision boundary.