Safeguards Enforcement Analyst, Chem & Explosives Harms

Anthropic · Safeguards (Trust & Safety)

Pay: $245,000–$285,000/yr
Where: San Francisco, CA | New York City, NY | Washington, DC
Posted: Jul 11

Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.

As an Enforcement Analyst focused on Chem & Explosives Harms, you will play a critical role in protecting against the misuse of AI systems for chemical and explosives harms. You will enforce our Usage Policy with a specific focus on detecting and mitigating these risks, investigating potential violations, and help continuously strengthen our safeguards.

What you'd do

Enforce Usage Policies with a specific focus on detecting and mitigating potential chemical and explosives risks and harmful use of AI systems.
Take ownership of enforcement monitoring workflows for the chemical and explosives harm area, improving end-to-end detection, investigation, triage, and escalation processes.
Monitor and analyze platform activity to identify emerging patterns related to chemical and explosives threats (within the broader CBRNE landscape) that may require policy updates or enforcement action.
Design and architect automated enforcement systems and review workflows that scale effectively while maintaining high accuracy across a technically complex content surface.
Conduct thorough investigations of potential violations, gathering and documenting evidence to support enforcement decisions.
Proactively surface trends and propose improvements to detection methods and review workflows without waiting to be directed.
Partner with Engineering and Data Science teams to optimize detection models and automated enforcement systems for policy violations.
Partner with Policy and Threat Intelligence teams to understand potential exploits and contribute to risk-assessment frameworks, and partner with engineers iterating on safety systems.
Provide enforcement-grounded feedback on policy gaps, and handle escalations and time-sensitive situations related to chemical and explosives policy violations.

What they want

Hold a degree in a chemistry-related field (e.g., chemistry, chemical engineering, materials science) and/or relevant professional experience in a related field.
Possess experience in Trust & Safety, content moderation, or policy enforcement at platform scale, including working with generative AI tools to refine and optimize content review and enforcement workflows.
Possess experience in utilizing AI tools to develop data dashboards for metrics collection in support of continuous improvement efforts.
Can analyze complex, ambiguous situations and make well-reasoned, defensible decisions under time pressure.
Are proactive and self-directed: you spot trends, dig in, and ship improvements on your own initiative.
Communicate clearly in writing and can translate technical chemistry concepts for diverse audiences, including both technical and non-technical stakeholders.