DadgogoAI Dictionary

Dictionary entry

loss function

noun \ˈlȯs ˈfəŋ(k)-shən\

also loss

TopicFundamentals Senses1

Definition of loss function

  1. : a formula that measures how wrong a model's output is during training; training tries to make this number as small as possible

    • The loss went down steadily for two weeks, then flattened.
    • Choosing the right loss function is half of the design.
Advertisement

Test yourself

Which of these is the meaning of loss function?

Related terms

gradient descent an optimization method that improves a model step by step by moving its parameters a little in… training the process of feeding data to a model and repeatedly adjusting its parameters so its outputs… reward model a separate model trained to score how good a response is, used to guide reinforcement learning… perplexity a measure of how surprised a probabilistic language model is by a sequence of tokens, commonly… credit assignment the problem of determining which earlier actions, tokens, components, or agents contributed to…

Cite this entry

"Loss function." AI Dictionary, Dadgogo, https://dadgogo.com/dictionary/loss-function/. Accessed 13 Oct. 2026.

Dictionary entries near loss function

Advertisement