Mercor
Task Writer: Project Agentic-MME
$60 / hourRemote · Worldwide
About the project Agentic-MME tests whether AI models can investigate an image rather than just look at it.
About the project
Agentic-MME tests whether AI models can investigate an image rather than just look at it. To solve a task, the model has to crop, rotate or enhance the image so a small detail becomes readable, then search the web for a fact, and then check each against the other before answering.
What you'll do
- Use high-resolution images where the key detail is small or degraded to test frontier AI models on the raw image and find what they miss, then build tasks around those gaps
- Write realistic prompts that need image work and at least one web search
- Record the shortest solution path step by step, with the image operations used and a credible source for each search
- Give one exact golden answer, a clear answer format and any accepted variants
What we're looking for
- Strong attention to detail
- Excellent writing skills
- Skill at web research, with a habit of using primary, authoritative sources
- Advanced degree holders
- Experience working on rubrics is a plus but not a must-have
Description from Mercor. Full details and the application are on Mercor's site.