  Generative models are rapidly gaining popularity and being integrated into
everyday applications, raising concerns over their safety issues as various
vulnerabilities are exposed. Faced with the problem, the field of red teaming
is experiencing fast-paced growth, which highlights the need for a
comprehensive organization covering the entire pipeline and addressing emerging
topics for the community. Our extensive survey, which examines over 120 papers,
introduces a taxonomy of fine-grained attack strategies grounded in the
inherent capabilities of language models. Additionally, we have developed the
searcher framework that unifies various automatic red teaming approaches.
Moreover, our survey covers novel areas including multimodal attacks and
defenses, risks around multilingual models, overkill of harmless queries, and
safety of downstream applications. We hope this survey can provide a systematic
perspective on the field and unlock new areas of research.
