Base Model

A base model is a pretrained LM before instruction/chat alignment — strong at continuation, weaker at following assistant conventions.

Some domain recipes CPT a base model; others CPT an instruct model then lightly SFT again. Know which starting checkpoint you have.

← Back to AI Glossary