Tag: Goal Alignment

During the conversational era of foundation models, red-teaming was primarily a linguistic discipline. Adversarial evaluators sat at chat consoles entering toxic prompts, ideological provocations, and roleplay scenarios, attempting to coerce a model into emitting prohibited text strings. Success was defined by whether the model generated unsafe words, and remediation consisted of updating reinforcement learning from […]