Representation Learning
Representation learning aims to discover features that make downstream tasks easier — embeddings, hidden states, or discrete codes — rather than predicting with raw inputs alone.
Word embeddings, BERT states, and contrastive image encoders are all representation learners.