SME Careers
Healthcare Specialist – Rubric Design
$100 / hourRemote · US
- Healthcare
- medicine
- Dentistry
- Pharmacy
- Clinical Pharmacology
- Nursing
- Surgery
- Radiology
- Pathology
- Emergency Medicine
- Clinical Reasoning
- AI Evaluation
In this hourly, remote contractor role, you will work as a Healthcare Subject Matter Expert (SME) to create challenging, expert-level healthcare questions, evaluate AI-generated clinical content, and design high-quality rubrics defining what an accurate, complete, and professionally appropriate answer should contain.
You will use your clinical or professional expertise to identify areas where frontier AI models may provide incomplete, inaccurate, poorly reasoned, overconfident, or clinically inadequate responses. You will write specialized questions within your field, develop detailed scoring criteria, critique rubrics created by other healthcare professionals, and provide precise written feedback.