DesignJobs.World Logo

Mercor

Berlin

UI/UX Design Expert - Evaluator

REMOTE MID
Posted 1 day ago
Mercor logo

Company snapshot

Mercor

MERCOR offers an AI-powered platform that streamlines the hiring process by sourcing, vetting, and facilitating payments for new employees.

B2C Insurance Finance Investment Banking
HQ
Chicago, Illinois, United States
Team size
1-10
Founded
2015
LinkedIn Twitter

Quick Summary

Role Overview

Mercor connects elite creative and technical talent with leading AI research labs to advance the field of artificial intelligence. This remote contract role involves designing grading criteria and evaluating AI-generated design work to improve model performance.

Key Responsibilities

  • Design task-specific grading criteria for digital product and UX deliverables.
  • Score AI-generated and human work samples with detailed written justifications.
  • Apply consistent evidence-based judgment for reproducible and defensible scores.
  • Incorporate structured feedback from senior reviewers and iterate on work.
  • Work independently and asynchronously to evaluate AI model performance.
  • Use expert judgment to improve the quality of AI-generated design outputs.

Requirements Snapshot

  • Five or more years of professional experience in product design or UI/UX.
  • Experience working at leading digital product studios or in-house design teams.
  • Deep fluency in interaction design, visual design, and Figma software.
  • Exceptionally strong written communication skills for providing detailed feedback.
  • Professional background in design systems, UX lead roles, or UX writing.

Expected Impact

The UI/UX Design Expert will directly influence the quality of AI models by providing expert evaluation and structured feedback. By creating rigorous grading criteria and scoring work samples, this role ensures that AI-driven design tools achieve professional-grade accuracy and utility for real-world applications.

A DesignJobs.World summary of the employer's posting, written to highlight scope, requirements, and fit (AI-assisted, human-reviewed). For full details, see the description below.

Job Description

About The Job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: UI / UX Design Expert

Type: Contract

Compensation: $80–$150/hour

Location: Remote

Role Responsibilities

Design precise, task-specific grading criteria for real-world digital product and UX deliverables.Score AI-generated and human work samples against criteria with detailed written justifications.Apply consistent, evidence-based judgment for reproducible and defensible scores.Incorporate structured feedback from senior reviewers and iterate quickly on work.Work independently and asynchronously to evaluate and improve AI model performance.

Qualifications

Must-Have

5+ years of professional experience in product design, UI/UX, or design systems.Background at leading digital-product and UX studios or in-house product-design teams.Experience in Product / UI / Design Systems Design, UX Lead, or UX Writing.Deep fluency in interaction and visual design, design systems, and Figma.Exceptionally strong written communication skills.Detail-oriented and comfortable with peer-reviewed judgment.

Preferred

Prior experience with AI training, evaluation, or human-data projects.

Application Process (Takes 20–30 mins to complete)

Submit your resume, portfolio, or relevant professional background.Qualified applicants may complete a brief assessment or submit additional information.

Resources & Support

For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcomeFor any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

View Original Job Post

Similar roles you might like

Check My Fit

No credit card required

Sign in with Google to start instantly