DesignJobs.World Logo

Mercor

Germany (Remote)

STEM Expert - Task Designer at Mercor

REMOTE MID
Posted about 22 hours ago
Mercor logo

Company snapshot

Mercor

MERCOR offers an AI-powered platform that streamlines the hiring process by sourcing, vetting, and facilitating payments for new employees.

B2C Insurance Finance Investment Banking
HQ
Chicago, Illinois, United States
Team size
1-10
Founded
2015
LinkedIn Twitter

Quick Summary

Role Overview

Mercor is seeking STEM Expert Task Pilots to develop high-level technical tasks for testing AI agents. This remote contract role involves creating open-ended, real-world challenges to push the boundaries of AI capabilities.

Key Responsibilities

  • Build challenging real-world tasks to test AI agents on expert-level technical work
  • Design open-ended tasks with no single right answer to allow for partial credit
  • Develop complex tasks such as building high-performance attention engines
  • Ensure tasks are evaluated automatically on a scale from zero to one
  • Work independently and asynchronously to meet project deadlines
  • Iterate on task designs to improve quality and technical depth

Requirements Snapshot

  • Expertise in a STEM field to create high-level technical tasks
  • Ability to design tasks that effectively challenge AI models
  • Capacity to work independently and asynchronously
  • Skill in developing tasks with automated scoring systems
  • Ability to meet deadlines while maintaining high task quality

Expected Impact

By creating rigorous and nuanced technical challenges, you will help leading AI research labs accurately measure and improve the capabilities of their AI agents. Your work ensures that AI models are tested against expert-level scenarios, ultimately driving the development of more sophisticated and reliable artificial intelligence.

A DesignJobs.World summary of the employer's posting, written to highlight scope, requirements, and fit (AI-assisted, human-reviewed). For full details, see the description below.

Job Description

About The Job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: STEM Expert Task Pilot

Type: Contract

Compensation: $2000 per task

Location: Remote

Commitment: 20 hours

Role Responsibilities

Build challenging, real-world tasks to test AI agents on expert-level technical work.Design open-ended tasks with no single right answer, allowing for partial credit scoring.Develop tasks like "Build the fastest possible attention engine" to push AI capabilities.Ensure tasks are evaluated automatically from 0 to 1 with partial credit.Work independently and asynchronously to meet deadlines and improve task quality.

Qualifications

Must-Have

Expertise in your field to create high-level technical tasks.Ability to design tasks that challenge AI models.

Start Date

Apply by Oct 4, 2026, 11:59pm PT; applications reviewed on a rolling basis.

Application Process (Takes 20–30 mins to complete)

Pick task types that fit your expertise.Describe one task idea in a few paragraphs.Await idea approval before building anything.

Resources & Support

For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcomeFor any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

,

View Original Job Post

Similar roles you might like

Check My Fit

No credit card required