Parameter

Parameters are the learned weights (and biases) of a model. LLM size is often quoted as parameter count (7B, 70B), though architecture and training data matter as much as raw $N$.

PEFT methods update only a small parameter subset or add a few new ones.

← Back to AI Glossary