Create mortgage origination scenarios that help AI labs assess model judgment, from prequalification and loan selection through underwriting and closing. You’ll write answers that explain lending decisions, assess model responses against agency and regulatory guidelines, and catch advice that conflicts with lending rules. The work is remote and async, with a commitment of at least 10 hours per week and no stated maximum.
Mercor maintains a standing pool of legal professionals for AI training and evaluation projects. Depending on the project, you may write legal scenarios with reference answers or assess model-generated legal work for accuracy and context. Apply with your resume, confirm where you work from, and complete an AI interview of about 20 minutes. Mercor contacts candidates when a project matches their background.
Review candidate CVs and recorded AI interviews to support hiring decisions across technical and non-technical roles. You will assess qualifications, identify relevant experience, and write structured recommendations that help maintain fair, consistent hiring evaluations. The role requires fluent English, a bachelor’s degree or higher, and a personal computer suitable for reviewing candidate materials and completing evaluation work.
Assess short Dutch audio clips produced by AI models, focusing on whether the speech sounds native and fluent. You’ll judge pronunciation, grammar, and linguistic authenticity, then record language-specific feedback using project tools and guidelines. The work supports AI training for a global customer. No previous AI experience is needed.
Create research-grade AI evaluation tasks from computational work you have performed in your field. AfterQuery commissions tasks across life, physical, Earth, mathematical, and engineering sciences. You will define how evaluators should assess a strong solution, revise your task after expert feedback, and may also review work from other domain experts. The work follows a flexible, task-based schedule with no fixed weekly hours.
Mercor is seeking experienced music producers and audio engineers to assess generative music models for a leading AI lab. You will rate songs and review lyrics and vocals using detailed standards, working in German and English. The project can start immediately and run for up to six months. Most experts contribute about 20 hours per week, with no set hour cap. Apply with a resume and complete a German Bilingual Competency Interview; onboarding details should arrive within a few days.
Create practical image-editing tasks in GIMP, prepare the files and resources each workflow needs, then record your screen as you complete the work. You will document task goals and steps in SuperAnnotate for reviewers. Work may cover photo retouching, masks, color adjustments, text overlays, or export preparation for web and social content.
Review Hebrew audio for a language and AI training project. You will judge speaker or model fluency, pronunciation, intonation, and naturalness, then explain your findings in English. No previous AI experience is needed; the work calls for native-level Hebrew and careful linguistic judgment.
Create and refine consulting challenges that help train AI models to handle real client work. You will build authentic business deliverables, write prompts for the analysis behind them, and assess model responses against consulting methods and standards. The role calls for at least six months of consulting experience, native English, and strong Excel and PowerPoint skills.
Bring hands-on preclinical drug development experience to an AI lab expanding its platform for pharmaceutical R&D. You’ll assess technical materials and real-world data, annotate scientific content and model outputs, and advise on development choices across drug modalities. The work also draws on your wet-lab and translational expertise to shape dataset standards and support models for drug discovery.
Review AI-generated advertising and create expert ad assets, from copy variations and creative briefs to test plans and performance analysis. You will assess strategy, audience logic, persuasion, and policy fit, then explain your ratings with clear written feedback. This is a remote hourly contract with no immediate project; qualified experts may be contacted when relevant work becomes available.
Review Polish audio for speaker or model fluency, pronunciation, intonation, and natural language use. You’ll write English feedback with reasons for your ratings and help improve Polish language understanding and generation in AI systems. No AI experience is needed; native Polish proficiency and English at B2 level or higher are listed skills.
Create and assess writing for AI training, from prompts and stories to articles, summaries, and dialogue. You’ll draw on at least three years of English content writing or copywriting experience, apply your knowledge of large language models, and judge text for accuracy, quality, and fit with user intent. The independent contractor engagement calls for 40 hours each week over 3–6 months.
Use your clinical judgment to help AI research teams assess model responses. Work may include creating clinical vignettes, grading diagnostic reasoning, and identifying recommendations that fail to account for a patient’s circumstances. This standing physician pool is not a specific opening; Mercor contacts candidates when a project matches their background, which may take a week or several months. Apply with a resume, complete an AI interview of about 20 minutes, and verify your license and background.
Create practical coding and debugging exercises in IntelliJ IDEA, then document and record each workflow for AI training. You will prepare project files, SDKs, and dependencies before demonstrating tasks such as Java or Kotlin development, Maven or Gradle builds, testing, refactoring, and Git use. English proficiency at B2 level or higher is required.
Review Italian audio for speaker or model fluency, pronunciation, intonation, and naturalness. You’ll record assessments in English, explain your judgments, and share language feedback that supports AI training. No previous AI experience is needed; Italian expertise is central to the work.
Create ALS scenarios that help AI labs assess emergency medicine judgment. You will write cases from dispatch through transfer of care, explain the reasoning behind interventions, and evaluate model responses for protocol accuracy and patient safety. The work is remote, asynchronous contract work, with a commitment of at least 10 hours per week.
Join a standing pool for project-based AI training and evaluation work across the creative fields. You may write briefs and grading references based on completed work, assess model output in areas such as graphic design, UX/UI, writing, and imagery, and explain when an answer misses the standards of its medium. After a background check and a roughly 20-minute AI interview, Mercor may contact you when a project fits your discipline. Timing can range from a week to several months.
Review AI-generated insurance responses or create expert material for coverage, claims, and underwriting scenarios. You will check policy reasoning, flag unsupported conclusions, and write clear corrections grounded in insurance language. This hourly contract has no immediate project; qualified experts may hear about relevant assignments through the expert network.
Current and former civilian intelligence professionals can bring firsthand agency knowledge to a project with a frontier AI lab. You will assess AI-generated intelligence content and unclassified scenarios, then give evidence-based feedback to improve how AI systems represent agency operations, decision-making, and national security work.
Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$80–$170/hr
intelligence analysis
program management
organizational decision-making
CybersecurityView job
Showing 20 active roles of 801. Dates reflect what the source published, not when AIWorkJobs last synced.
Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.