Mercor
MLOps Engineer, LLM Systems (Serving, GPU Kernels, Profiling)
$90–$120 / hourRemote · CA, GB, US
Join a leading AI lab's cutting-edge GenAI team and help build foundational AI models from the ground up.
Join a leading AI lab's cutting-edge GenAI team to be at the core of the AI revolution, where your expertise fuels the development of the most advanced Large Language Models.
1. Overview
Join a leading AI lab's cutting-edge GenAI team and help build foundational AI models from the ground up. We're seeking MLOps Engineers with hands-on experience in large language model infrastructure across any of four areas: GPU kernel programming, performance profiling and trace analysis, debugging accelerated and distributed workloads, and high-throughput inference serving. This role involves AI model training and evaluation work, including writing and assessing MLOps and ML systems tasks and solutions to generate high-quality training data for frontier AI systems.
This is a W-2 employment position with Cincinnatus LLC, with the opportunity to be placed at a leading AI Lab as part of their extended workforce. This is a 40-hour full-time engagement, with no conflicts/no other engagements.
2. Key Responsibilities
- Design challenging, domain-relevant tasks across four areas, GPU kernels, performance profiling, debugging, and inference serving, and write accurate, well-structured solutions to them.
- Guide research and engineering teams to close knowledge gaps and improve AI model performance on ML systems, training infrastructure, and framework-level topics.
- Evaluate MLOps and ML systems tasks and solutions, and provide clear, written technical feedback that stands up to reviewer scrutiny.
- Develop guidelines and detailed rubrics or evaluation frameworks covering kernel-level optimization, profiler output interpretation, distributed systems reasoning, and serving throughput and latency trade-offs.
- Collaborate with other subject matter experts to keep training data consistent and accurate.