LLM-as-a-judge

Definition of LLM-as-a-judge

1. : using one language model to grade or compare the outputs of another, as a cheaper and faster alternative to human reviewers

   • We use LLM-as-a-judge to score tone, then spot-check by hand.
   • Judges can be biased toward longer answers.