DadgogoAI Dictionary

Dictionary entry

quantization

noun \ˌkwän-tə-ˈzā-shən\
TopicTraining Senses1
Advertisement

Definition of quantization

  1. : shrinking a model by storing its numbers with less precision (for example 4 bits instead of 16), which makes it smaller and faster at a small cost in quality

    • Thanks to quantization, the model fits on a gaming GPU.
    • Aggressive quantization made the answers noticeably worse.

Test yourself

Which of these is the meaning of quantization?

Related terms

parameter one of the numbers inside a model that is adjusted during training; the total count of… on-device AI AI that runs directly on a phone, laptop, car, or other device instead of in the cloud, which… small language model a compact language model, usually with a few billion parameters or fewer, designed to run… distillation training a smaller "student" model to imitate the outputs of a larger "teacher" model…

Cite this entry

"Quantization." AI Dictionary, Dadgogo, https://dadgogo.com/dictionary/quantization/. Accessed 4 Oct. 2026.

Dictionary entries near quantization

Advertisement