Glossary › LLM-as-Judge
LLM-as-Judge
Using a model to grade another model's output against a rubric. Cheap and scalable; must itself be validated against human labels on a sample, because judges have systematic biases (length, position, self-preference).
Where LLM-as-Judge shows up
All matching postsHow to Evaluate an LLM Application
Evaluation is the hardest part of LLM engineering. This post covers the evaluation stack: reference-based metrics, LLM-as-judge, task-specific evals, and how to build a reliable eval pipeline.
#llm#evaluation#rag