Dictionary entry
latency
TopicModels & Behavior Senses1
Advertisement
Definition of latency
-
: the delay between sending a request to a model and getting a response, often measured as time to the first token
- Voice assistants need very low latency or the conversation feels awkward.
- We switched to a smaller model to cut latency in half.
Two meanings, one word
In everyday English
The state of being present but hidden or not yet active.
In AI
The delay between sending a request to a model and getting a response, often measured as time to the first token.
Test yourself
Which of these is the meaning of latency?
Cite this entry
"Latency." AI Dictionary, Dadgogo, https://dadgogo.com/dictionary/latency/. Accessed 4 Oct. 2026.
Dictionary entries near latency
Advertisement