Normalization

Normalization rescales data or activations to a comparable range — e.g., z-score features, min-max scaling, or LayerNorm/RMSNorm inside networks.

It improves optimization conditioning; the exact form depends on whether you normalize inputs, batches, or layers.

← Back to AI Glossary