SME Careers
Red-Teaming Quality Assurance Lead (QAL)
$100 / hourRemote · US
- LLM evaluation
- policy evaluation
- Safety Taxonomies
- Trainer Feedback
- Risk Assessment
- Trust & Safety
- Adversarial Testing
- AI Safety
- AI red-teaming
- Prompt Engineering
In this hourly, remote contractor role, you will work as a Red-Teaming Quality Assurance Lead (QAL) to oversee quality, consistency, and trainer performance across AI red-teaming and safety-evaluation projects. You will review AI-generated safety evaluations, adversarial prompts, risk analyses, and trainer/QA work; evaluate output quality against project guidelines; provide precise written feedback; and ensure that all contributors follow the expected quality standards.
You will assess work for risk identification, adversarial reasoning, policy awareness, safety taxonomy alignment, prompt quality, scenario realism, vulnerability coverage, clarity, formatting, instruction-following, and adherence to project-specific rubrics. You will spot recurring quality issues, communicate updates to trainers and QAs, support onboarding, maintain documentation, and help activate contributors who are not working consistently. This role requires strong AI safety/red-teaming judgment, strong English communication skills, excellent attention to detail, structured communication, and the ability to manage quality workflows across remote expert teams.