Safeguards Enforcement Analyst, Bio Harms

Anthropic · Safeguards (Trust & Safety)

Pay: $245,000–$285,000/yr
Where: San Francisco, CA | New York City, NY | Washington, DC
Posted: Jul 11

Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.

As an Enforcement Analyst focused on Bio Harms, you will play a critical role in protecting against the misuse of AI systems for biological and related CBRNE harms. You will enforce our Usage Policy with a specific focus on detecting and mitigating bio risks, investigating potential violations, and help continuously strengthen our safeguards.

What you'd do

Enforce Usage Policies with a specific focus on detecting and mitigating potential bio risks and harmful use of AI systems.
Take ownership of enforcement monitoring workflows for the bio-harms area, improving end-to-end detection, investigation, triage, and escalation processes.
Monitor and analyze platform activity to identify emerging patterns related to biological (and adjacent chemical, radiological, nuclear, and explosive) threats that may require policy updates or enforcement action.
Design and architect automated enforcement systems and review workflows that scale effectively while maintaining high accuracy across a technically complex content surface.
Conduct thorough investigations of potential violations, gathering and documenting evidence to support enforcement decisions.
Proactively surface trends and propose improvements to detection methods and review workflows.
Partner with Engineering and Data Science teams to optimize detection models and automated enforcement systems for bio-related policy violations.
Partner with Policy and Threat Intelligence groups to understand potential exploits and contribute to risk-assessment frameworks, and partner with engineers iterating on safety systems.
Provide enforcement-grounded feedback on policy gaps, and handle escalations and time-sensitive situations related to potential bio-related Usage Policy violations.

What they want

Hold a degree in a bio-related field (e.g., microbiology, molecular biology, biochemistry, public health) and/or relevant professional experience in a related field.
Possess experience in Trust & Safety, content moderation, or policy enforcement at platform scale, including working with generative AI tools to refine and optimize content review and enforcement workflows.
Possess experience in utilizing AI tools to develop data dashboards for metrics collection in support of continuous improvement efforts.
Can analyze complex, ambiguous situations and make well-reasoned, defensible decisions under time pressure.
Are proactive and self-directed: you spot trends, dig in, and ship improvements on your own initiative.
Communicate clearly in writing and can translate technical bio concepts for diverse audiences, including both technical and non-technical stakeholders.