Dictionary entry Trending
activation monitoring
also activation-based monitoring or internal activation monitoring or activation monitor
Definition of activation monitoring
-
: a technique for overseeing an AI model by examining patterns in its internal neural activations during inference, rather than relying only on its visible inputs, outputs, or reasoning text, in order to detect potentially harmful, deceptive, or abnormal behavior
- The safety team used activation monitoring to flag reward-hacking behavior before it became obvious in the agent's final answer.
- An activation monitor escalated the suspicious run to a larger external reviewer while allowing routine agent actions to continue.
Origin & history
Interpretability researchers had long used probes to read information from neural activations, but activation monitoring became a distinct AI-safety research direction in the mid-2020s. Anthropic described it as a promising form of deployment oversight in 2025, and 2026 research and commercial systems applied activation monitors to reward hacking, jailbreak defense, and autonomous agents.
Test yourself
Which of these is the meaning of activation monitoring?
Cite this entry
"Activation monitoring." AI Dictionary, Dadgogo, https://dadgogo.com/dictionary/activation-monitoring/. Accessed 8 Oct. 2026.