AfterQuery hires geologists and earth scientists as independent contractors to create and assess evaluation material for AI models. You’ll build scenarios from field observations through interpretation, explain the reasoning behind reference answers, and judge whether model responses reflect sound geoscience and climate science. Work takes place remotely on an async schedule, with a minimum commitment of 10 hours per week.
Mercor’s network connects HR and administration specialists with future projects for AI labs and companies. After you complete your profile and pass an AI interview, Mercor can match you with projects as they open. Work may cover AI model training and evaluation, scenario-based tasks, and expert feedback. Projects vary in scope and duration, with typical commitments of 15–30 hours per week.
Review AI-generated legal analyses and create expert explanations or model answers. You will judge legal reasoning, check authorities and procedural context, and write focused feedback that shows where an answer went wrong and how to correct it. This hourly remote contract role has no immediate project; qualified experts may be contacted when relevant work becomes available.
Review English audio for fluency, pronunciation, intonation, and naturalness, then explain your judgments in clear written feedback. Your evaluations will support AI language training and model performance. The role requires native English and US residency; prior AI experience is not needed.
AfterQuery needs practicing litigators to create and assess legal scenarios used to evaluate AI models. You’ll build disputes from the complaint through dispositive motions, explain the reasoning behind legal judgments, and review model responses for procedural and strategic accuracy. The work is remote and asynchronous, with a minimum commitment of 10 hours per week and no set schedule.
Assess AI-narrated audiobooks in European Portuguese with the perspective of a regular listener and the precision of a reviewer. You’ll identify speech errors, mark their exact locations in review tools, and report how natural and enjoyable each recording feels. The remote, part-time role calls for about 20 hours per week, or roughly four hours per day.
Use your Tamil language expertise and mathematics degree to shape AI training content and assess model responses. You will write prompts and reference answers, compare outputs for accuracy, fluency, tone, and cultural fit, and explain language or reasoning issues in English. The role requires native or near-native written Tamil, C1 English, and at least three years of relevant professional experience.
Review AI-generated work tied to federal IT operations and AI training. You will assess material such as ATO packages, incident reports, privacy impact assessments, and IT investment business cases, then check technical documentation, configurations, and security controls against real federal IT practices. The work also covers incident response simulations and feedback that helps improve AI performance.
As a contract Mathematics Teacher Expert, you’ll create instruction scenarios and worked solutions that help AI labs assess how models handle mathematics. You’ll also review model answers for both mathematical accuracy and teaching quality. The project runs remotely and asynchronously, with a commitment of at least 10 hours per week and no fixed schedule.
Cincinnatus LLC employs a senior legal specialist for a full-time, 40-hour-per-week role supporting a leading AI lab’s research and program management teams. You will assess legal work and model responses, write task instructions and reference solutions, and develop evaluations for legal reasoning. The initial engagement lasts six months. The role requires regular on-site work in the Bay Area.
Apply your healthcare specialty to build questions that test advanced AI systems and scoring rubrics that separate sound clinical reasoning from unsafe or incomplete answers. You will assess model responses, review colleagues’ rubrics, and create reference material for AI evaluation and training workflows. Applicants need a recognized healthcare qualification, at least three years of experience, and English proficiency at C1 or higher.
A US-only contractor role for a Federal Grants Management Specialist supporting AI training. You will bring federal grants and compliance expertise to application reviews, monitoring materials, and realistic grant scenarios, while assessing AI-generated work against federal procedures, including 2 CFR Part 200.
AfterQuery seeks experienced English teachers to create and assess reading and writing scenarios used to evaluate AI models. You will write sample feedback with clear teaching rationale and judge model responses for sound literary analysis and useful guidance. The role is remote and asynchronous, with ongoing contractor work, no fixed hours, and a minimum commitment of 10 hours per week.
Review GPU and accelerator kernel-development tasks that support training and evaluation of a frontier AI lab’s models. Judge numerical correctness, benchmark fairness, task scope, and compilation and runtime validity across varied kernel work. You’ll also write rubric-based feedback that explains your findings.
Review marketing and editorial content produced by AI, then explain how each response handles brand voice, audience intent, structure, and factual accuracy. You may also write reference copy across formats such as landing pages, emails, ads, and guides. This remote, hourly contract has no immediate project; qualified experts may hear about relevant work through the network.
Apply Laser Shearography expertise to an aerospace inspection project that helps train AI systems. You will assess shearography data and composite defects, interpret technical inspection materials, and explain your findings in writing. Prior AI experience is not required. All assessments must rely on manual review, without AI tools.
Create and assess legal scenarios that test how AI models handle paralegal work, from legal research and citation formats to document drafting, discovery, and case management. You will judge model answers against paralegal best practices and legal standards, then work with legal and technical specialists to shape content that teaches practical, real-world skills.
Evaluate survey quality and AI-generated research content for a project with an AI research organization. You’ll draw on at least three years of experience in survey research or a related field to assess questionnaire design, sampling, bias, fieldwork, and whether a survey can produce useful evidence. The role suits practitioners from market research, consumer insights, behavioral science, UX, polling, and social research.
Review and create Croatian content used to train and assess AI models. You will compare model responses, write reference answers, and explain language issues in English, from case and agreement errors to awkward translations and mismatched tone. The role requires native or near-native Croatian, English at C1 or higher, and at least three years of language-focused professional experience.
Create finance research questions about real US public companies, then verify each answer against filings or investor relations materials and compare it with AI model responses. Tasks may take around 4 to 8 hours. Applicants need hands-on experience with US SEC filings and familiarity with US GAAP. The selection process includes a short finance interview; selected candidates receive guidelines and complete an initial task for review.
Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$30–$85/hr
Equity Research
FP&A
Corporate Finance
Finance & AccountingView job
Showing 20 active roles of 801. Dates reflect what the source published, not when AIWorkJobs last synced.
Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.