Dictionary entry Trending
Densing Law
also densing law of LLMs or capability-density law or intelligence density law
Definition of Densing Law
-
: an empirical observation that the maximum capability delivered by large language models per model parameter increases exponentially over time, so a newer model may reach the same benchmark performance with progressively fewer parameters
- The Densing Law suggests that an on-device model may eventually match an older server model while using far fewer parameters.
- The researchers estimated from open-weight base models that maximum capability density had doubled roughly every three and a half months during the period they studied.
Two meanings, one word
In everyday English
A proposed rule describing how something becomes more concentrated or efficient over time.
In AI
An empirical observation that the maximum capability delivered by large language models per model parameter increases exponentially over time, so a newer model may reach…
Origin & history
Researchers from Tsinghua University and OpenBMB introduced capability density and the Densing Law in a 2024 preprint. The peer-reviewed study, published in Nature Machine Intelligence in 2025, analyzed 51 open-source pretrained base models and reported that their maximum capability density doubled approximately every 3.5 months over the observed period.
Editorial references
Sources & further reading
- Densing law of LLMs↗ Nature Machine Intelligence · 2025-11-06
- Densing Law of LLMs↗ arXiv · 2024-12-05
Test yourself
Which of these is the meaning of Densing Law?
Cite this entry
"Densing Law." AI Dictionary, Dadgogo, https://dadgogo.com/dictionary/densing-law/. Accessed 19 Nov. 2026.