UX/UI Designer & Product Designers.
We are seeking experienced product designers, UX/UI designers, design system specialist, rapid prototypers, and AI-native product builders to create realistic evaluation tasks for advanced AI systems.
What You’ll Do
Analyze task execution frame by frame when necessaryIdentify important actions, events, behaviors, and outcomesApply structured labels, tags, and grades based on project guidelinesMark timestamps or video segments corresponding to key eventsDetermine whether tasks were completed correctlyIdentify partial completions, failed actions, mistakes, or unusual behaviorDocument observations and evaluation rationales clearlyApply annotation guidelines consistently across large volumes of videosParticipate in reviewer calibration and quality discussionsCollaborate asynchronously with project trainers and other contributorsFlag unclear or ambiguous cases for additional reviewProvide feedback on labeling guidelines and annotation workflowsOrganize and submit completed annotations within project timelinesMaintain high standards for precision, consistency, and quality
Who Can Apply
Relevant backgrounds include:
Product Designers, Senior Product Designers, Staff Product Designers, Principal Product Designers, Lead Product Designers, UX Designers, UI Designers, UX/UI Designers, Interaction Designers, Experience Designers, Digital Product Designers, Visual Designers, Interface Designers, Web Designers, Mobile Product Designers, and Application Designers.
Design leadership backgrounds may include:
Design Leads, Design Managers, Product Design Managers, Heads of Design, Design Directors, UX Directors, Creative Directors, Experience Design Directors, Design Principals, and Design Consultants.
Design systems backgrounds may include:
Design Systems Designers, Design Systems Leads, Design Systems Engineers, UI Systems Designers, Component Library Designers, Design Technologists, UX Engineers, Design Engineers, Frontend Design Engineers, and Design Infrastructure Specialists.
Video and media backgrounds may include:
Video Editors, Video Producers, Multimedia Editors, Content Editors, Motion Designers, Motion Graphics Artists, Filmmakers, Videographers, Cinematographers, Post-Production Specialists, and Audiovisual Professionals.
Research and usability backgrounds may include:
UX Researchers, User Researchers, Product Researchers, Usability Researchers, Human Factors Specialists, Human-Computer Interaction Professionals, HCI Researchers, UX Strategists, Service Designers, Information Architects, and Customer Experience Designers.
Annotation and AI data backgrounds may include:
Video Annotators, Data Annotators, Data Labelers, AI Data Trainers, AI Evaluators, Computer Vision Annotators, Image Annotators, Multimedia Annotators, Human Feedback Specialists, Annotation Quality Analysts, and Data Quality Reviewers.
Requirements
Professional or academic background in UX/UI, product design, video editing, photography, multimedia, engineering, data annotation, or a closely related fieldStrong visual attention to detailAbility to analyze video content carefullyComfortable applying detailed annotation and grading guidelinesAbility to work consistently across repetitive review tasksStrong written communication skillsAbility to explain annotation decisions clearlyComfortable learning new annotation toolsStrong organizational skillsAbility to meet deadlinesComfortable collaborating with remote teamsAbility to work independently while maintaining high quality
Preferred Background
Portfolio demonstrating shipped products, applications, interfaces, or design systemsExperience at a product-led technology company, design-forward organization, startup, or independent product studioExperience building and shipping products using AI coding assistantsExperience owning large-scale design systems or component librariesExperience moving rapidly from concept to functional prototypeStrong understanding of both UX principles and technical implementationExperience reviewing or critiquing the work of designers or engineersExperience creating product design standards, training materials, design critiques, or evaluation frameworks
A formal credential is not required. A strong portfolio of shipped work, real product ownership, and demonstrated senior-level judgment are highly valued.
This opportunity is ideal for experienced product builders who understand both the craft of creating excellent user experiences and the rapidly evolving workflows of AI-assisted product development. We are a referral partner of the client.
Check My Fit
