AI Rater Guidelines Writer (Linguist / Instructional Designer)

Join a leading AI lab's cutting-edge GenAI team to be at the core of the AI revolution, where your expertise fuels the development of the most advanced Large Language Models.

1. Overview

Join a leading AI lab's cutting-edge GenAI team and help build foundational AI models from the ground up. We're seeking talented Linguists and Instructional Designers with deep experience translating ambiguous program requirements into clear, unambiguous rater guidelines to bring precision and consistency to our AI training data — working across domains from finance and retail to insurance, legal, and sports.

This is a W-2 employment position with Cincinnatus LLC, with the opportunity to be placed at a leading AI Lab as part of their extended workforce.

2. Key Responsibilities

• Guide research and program teams to close the gap between ambiguous program requirements and rater-ready instructions across a range of subject-matter domains.
• Design clear, non-contradictory rating guidelines and rubrics that raters can apply consistently, including under edge cases.
• Evaluate draft guidelines for ambiguity, internal contradiction, and coverage gaps, and revise until raters can apply them without escalation.
• Translate program specifications from domains such as finance, retail, insurance, legal, and sports into precise, discipline-specific rater instructions.
• Collaborate with other subject matter experts and program leads to ensure consistency and accuracy across guideline sets.

3. Core Qualifications

• 3+ years of professional experience in linguistics, instructional design, technical writing, or a closely related field, with direct experience writing or refining guidelines/rubrics for human raters in a GenAI/RLHF context.