red teaming

Definition of red teaming

1. : deliberately attacking or stress-testing an AI system, often with outside experts, to find harmful behaviors, security holes, and failure modes before release

   • Red teaming found that the model would give unsafe chemistry advice if asked in poetry.
   • The company published a summary of its red teaming results.