DesignJobs.World Logo

Mercor

Berlin

STEM Expert - Task Designer at Mercor

REMOTE MID
Posted about 11 hours ago
Mercor logo

Company snapshot

Mercor

Mercor is an AI-based hiring platform designed to improve the recruitment process for both job seekers and companies.

B2C Insurance Finance Investment Banking
HQ
Chicago, Illinois, United States
Team size
51-250
Founded
2023
LinkedIn Twitter

Quick Summary

Role Overview

Mercor is seeking STEM Expert Task Pilots to create high-level technical challenges for testing AI agents. This remote contract role involves designing complex, open-ended tasks that push the boundaries of AI capabilities.

Key Responsibilities

  • Build challenging real world tasks to test AI agents on expert level technical work
  • Design open ended tasks with no single right answer allowing for partial credit
  • Develop tasks like building the fastest possible attention engine to push AI capabilities
  • Ensure tasks are evaluated automatically from zero to one with partial credit scoring
  • Work independently and asynchronously to meet deadlines and improve task quality
  • Pick task types that fit your expertise and describe task ideas for approval

Requirements Snapshot

  • Expertise in a STEM field to create high level technical tasks
  • Ability to design tasks that challenge AI models
  • Capability to work independently and asynchronously
  • Commitment to a twenty hour project timeline
  • Ability to meet application deadlines and follow the review process

Expected Impact

By creating rigorous and sophisticated technical benchmarks, you will help leading AI research labs evaluate and improve the performance of AI agents on expert-level work. Your contributions will directly influence the development of more capable and reliable artificial intelligence systems.

A DesignJobs.World summary of the employer's posting, written to highlight scope, requirements, and fit (AI-assisted, human-reviewed). For full details, see the description below.

Job Description

About The Job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: STEM Expert Task Pilot

Type: Contract

Compensation: $2000 per task

Location: Remote

Commitment: 20 hours

Role Responsibilities

Build challenging, real-world tasks to test AI agents on expert-level technical work.Design open-ended tasks with no single right answer, allowing for partial credit scoring.Develop tasks like "Build the fastest possible attention engine" to push AI capabilities.Ensure tasks are evaluated automatically from 0 to 1 with partial credit.Work independently and asynchronously to meet deadlines and improve task quality.

Qualifications

Must-Have

Expertise in your field to create high-level technical tasks.Ability to design tasks that challenge AI models.

Start Date

Apply by Oct 4, 2026, 11:59pm PT; applications reviewed on a rolling basis.

Application Process (Takes 20–30 mins to complete)

Pick task types that fit your expertise.Describe one task idea in a few paragraphs.Await idea approval before building anything.

Resources & Support

For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcomeFor any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

View Original Job Post

Similar roles you might like

Check My Fit

No credit card required