Mercor

Germany (Remote)

UI/UX Design Expert - Evaluator

REMOTE MID
Posted 1 day ago
Mercor logo

Company snapshot

Mercor

MERCOR offers an AI-powered platform that streamlines the hiring process by sourcing, vetting, and facilitating payments for new employees.

B2C Insurance Finance Investment Banking
HQ
Chicago, Illinois, United States
Team size
1-10
Founded
2015

Quick Summary

Role Overview

Mercor is seeking a UI/UX Design Expert to evaluate and improve AI model performance by grading digital product deliverables. This contract role involves creating precise grading criteria and providing detailed justifications for AI-generated and human work samples.

Key Responsibilities

  • Design precise task-specific grading criteria for digital product deliverables
  • Score AI-generated and human work samples with written justifications
  • Apply consistent evidence-based judgment for reproducible and defensible scores
  • Incorporate structured feedback from senior reviewers to iterate quickly
  • Work independently and asynchronously to evaluate AI model performance
  • Ensure all evaluations meet high quality standards for AI training

Requirements Snapshot

  • Minimum of 5 years of professional experience in product design
  • Previous experience at leading digital product studios or in-house teams
  • Deep fluency in interaction design visual design and Figma
  • Exceptionally strong written communication skills for documentation
  • Detail-oriented mindset comfortable with peer-reviewed judgment

Expected Impact

By providing expert evaluation and structured feedback you will directly enhance the quality and reliability of AI models in the design space. Your work ensures that AI-generated design outputs meet professional standards ultimately bridging the gap between technical AI research and high-quality creative execution.

A DesignJobs.World summary of the employer's posting, written to highlight scope, requirements, and fit (AI-assisted, human-reviewed). For full details, see the description below.

Job Description

About The Job

Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.

Position: UI / UX Design Expert

Type: Contract

Compensation: $80–$150/hour

Location: Remote

Role Responsibilities

Design precise, task-specific grading criteria for real-world digital product and UX deliverables.Score AI-generated and human work samples against criteria with detailed written justifications.Apply consistent, evidence-based judgment for reproducible and defensible scores.Incorporate structured feedback from senior reviewers and iterate quickly on work.Work independently and asynchronously to evaluate and improve AI model performance.

Qualifications

Must-Have

5+ years of professional experience in product design, UI/UX, or design systems.Background at leading digital-product and UX studios or in-house product-design teams.Experience in Product / UI / Design Systems Design, UX Lead, or UX Writing.Deep fluency in interaction and visual design, design systems, and Figma.Exceptionally strong written communication skills.Detail-oriented and comfortable with peer-reviewed judgment.

Preferred

Prior experience with AI training, evaluation, or human-data projects.

Application Process (Takes 20–30 mins to complete)

Submit your resume, portfolio, or relevant professional background.Qualified applicants may complete a brief assessment or submit additional information.

Resources & Support

For details about the interview process and platform information, please check: https://talent.docs.mercor.com/welcomeFor any help or support, reach out to: support@mercor.com

PS: Our team reviews applications daily. Please complete your AI interview and application steps to be considered for this opportunity.

,

Check My Fit

No credit card required

Sign in with Google to start instantly