Domain Contributor - Evaluation Specialists create and assess challenging, subject-specific tasks for an internal project to evaluate and improve advanced AI models. The work covers areas such as history, law, finance, journalism, and technology. Contractors work about 15 hours per week, submit tasks on a rolling basis, and must meet a weekly minimum submission requirement.
Apply machine learning to genomic, transcriptomic, proteomic, and multi-omics data through model development, pipeline design, and research tasks. The remote, project-based work runs over 2–3 weeks and follows an asynchronous schedule. You can expect 10–20 hours per week for projects you accept, with assignments made on a project-by-project basis.
Mercor seeks experienced engineers at companies that serve retail investors for a paid, one-time interview with a leading AI company building financial intelligence products. In a 45–60 minute remote conversation, you’ll explain how your team evaluates and selects third-party APIs or AI vendors, then share what shaped the integration and vendor experience. The interview covers your own views, not confidential employer information.
Create civil engineering questions and case studies for AI training, then assess model answers for technical accuracy and alignment with engineering standards. The work spans topics such as structural analysis, foundation design, transportation planning, hydraulics, soil mechanics, construction management, building codes, and environmental engineering. You will also work with engineering and technical experts to shape the difficulty and educational value of the material.
Review AI conversations about relationships, family, emotional wellbeing, personal beliefs and difficult decisions. You’ll judge whether responses stay balanced, safe and within the model’s role, then explain your reasoning and help researchers set evaluation standards. The part-time role requires at least 20 weekday hours per week, with the option to work up to 40. Cincinnatus LLC employs the expert on a W-2 basis and places them with a leading AI lab.
Create rehabilitation scenarios that help AI labs assess how models handle real clinical decisions. You’ll write cases from initial evaluation through discharge, explain progression choices, and review model responses for patient safety and evidence-based care. The work is remote, async, and ongoing, with a minimum commitment of 10 hours per week and no fixed schedule or maximum hours. AfterQuery engages contributors as independent contractors.
Bring recent bench or computational biology expertise to the design and evaluation of AI models for biology. You’ll create challenging biology tasks, assess model responses, and help research and engineering teams improve work across genomics and cell biology. This part-time engagement runs through Cincinnatus LLC or an appropriate international entity, which employs professionals placed with a leading AI lab.
Create tax-law scenarios and reference analyses that help AI labs assess model judgment. You’ll work in your tax specialty, drawing on the Code, regulations, and relevant authority to write examples and evaluate model answers. The contract is fully remote and asynchronous, with no fixed hours; commit at least 10 hours each week and adjust your workload from week to week.
Bring hands-on drug discovery expertise to the design and evaluation of AI models for science. You will help research and engineering teams improve model performance across pharmacology, ADME/Tox, and PK/PD. The part-time role runs through Cincinnatus LLC or an appropriate international entity, with placement at a leading AI lab. The remote position lists London, UK, and the US East Coast.
AfterQuery’s expert data lab creates evaluation and training data for frontier AI labs. As a contract linguist, you’ll write scenarios that probe model reasoning in areas such as syntax, semantics, and phonology, then assess the accuracy of model analyses. The work runs remotely on an async schedule, with at least 10 hours of work each week and no set maximum.
Apply hands-on chemistry expertise to the design and evaluation of AI models for chemistry. You’ll create challenging training tasks, assess model reasoning, and help research and engineering teams improve performance in synthesis, reaction mechanisms, structure elucidation, and physical-chemical property analysis. The part-time role requires at least 20 weekday hours per week and is listed for remote candidates in London, UK, or the US East Coast.
As a biomedical engineering contractor, you will review AI-generated medical device and biomedical engineering content for technical accuracy. You will also create expert examples from your own practice and assess model responses against engineering standards. The work is fully remote and asynchronous, with hourly pay and a schedule you choose.
Apply to Mercor’s network for future contract projects with AI labs and companies. After you complete your profile and pass an AI interview, Mercor may match you to projects as they arise. Experts train and evaluate AI models, build work from real-world compliance and risk scenarios, and give domain feedback. Project scope and duration vary; typical commitments run 15–30 hours per week.
Evaluate how image-generation models handle professional brand and layout work. You’ll create briefs, explain design judgments, and assess generated images for typography, logo accuracy, composition, and brand consistency. The role suits an experienced graphic designer who can make visual decisions clear in writing. Work runs on a remote, async contractor basis, with a minimum commitment of 10 hours per week.
A senior engineering specialist will help a leading AI lab assess and improve how its models handle real software and engineering work. You will review model outputs, write task instructions and reference solutions, and create evaluation benchmarks with the research team. The position is full-time W-2 employment through Cincinnatus LLC, based in the Bay Area with on-site work multiple days each week when required.
Work on a part-time, remote project that trains AI models in cybersecurity workflows. You will create code repositories with OSS-Fuzz-style vulnerabilities, then develop and check patches for them. The work suits cybersecurity professionals with at least one year of hands-on vulnerability research experience. Set your own hours and complete each task asynchronously, with no scheduled meetings.
Edit and assess Brazilian Portuguese speech recordings used to build machine learning datasets for speech and text-to-speech systems. You’ll check technical quality, correct audio defects, and judge pronunciation, fluency, and naturalness across large batches. The role requires native or near-native Brazilian Portuguese and hands-on experience editing spoken audio.
Create and assess media production challenges that help train AI models to apply film, television, and theater principles. You will build scenarios around creative decisions, storytelling, and project management, then review model answers against production practices and industry standards. The role calls for production leadership experience and strong communication and analytical skills.
Assess paired AI-generated videos from the perspective of a film, theater, or visual effects professional. You’ll compare craft elements such as lighting, composition, camera direction, continuity, realism, and performance, then explain your decisions in clear, specific terms. The evaluation work continues across new rounds as video models emerge.
Shape how AI systems handle real product decisions. You’ll write scenarios drawn from ambiguous product problems, explain the reasoning behind a strong decision, and assess model responses to specs, roadmaps, and strategy. The work is remote and async, with a minimum commitment of 10 hours per week and no weekly maximum. AfterQuery hires contributors as independent contractors for ongoing project work.
Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$85/hr
product management
product strategy
product roadmaps
Product ManagementView job
Showing 20 active roles of 801. Dates reflect what the source published, not when AIWorkJobs last synced.
Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.