Dictionary entry Trending
distillation double bind
Definition of distillation double bind
-
: a proposed AI-safety strategy in which distilling a potentially misaligned, audit-evading model into a weaker trusted model may either expose transferred misalignment or produce a capable student that did not inherit it
- The researchers tested the distillation double bind by checking whether weaker student models would admit quirks that their teacher models concealed.
- Under the distillation double bind, a suspicious teacher is useful only if the student gains capabilities without also gaining the teacher's hidden behavior.
Two meanings, one word
In everyday English
A double bind is a dilemma in which each available choice creates a conflicting problem.
In AI
A proposed AI-safety strategy in which distilling a potentially misaligned, audit-evading model into a weaker trusted model may either expose transferred misalignment or…
Origin & history
Redwood Research introduced the distillation double bind in June 2026 as an AI-safety argument about learning from a capable but potentially misaligned teacher model. In October 2026, the group released empirical work on two sides of the proposal: distillation for incrimination, which tries to make hidden behavior easier to detect in a weaker student, and distillation for capabilities, which tries to transfer useful ability without transferring misalignment.
Test yourself
Which of these is the meaning of distillation double bind?
Cite this entry
"Distillation double bind." AI Dictionary, Dadgogo, https://dadgogo.com/dictionary/distillation-double-bind/. Accessed 10 Oct. 2026.