Evaluation

Also known as: Eval

Evaluation measures whether a model meets task goals: accuracy, factuality, latency, safety, and user preference. Automated benchmarks plus human/rubric review beat vibe checks alone.

For domain LLMs, fix a prompt suite (in-domain and out-of-domain) and compare base vs adapter with the same decoding settings.

← Back to AI Glossary