Use your quality and patient safety nursing expertise to build clinical cases and assess AI responses. You will work remotely as a US-based contractor on a 12-week project, with a target start date of November 2, 2026. Choose 20 or 40 hours per week and plan for four hours of overlap with Pacific working hours. Selection involves an application review and assessment.
Use your chemical engineering experience with real plant or pilot data to create research-level problems that test and train AI models. The work centers on data grounded in plant operations, including performance across columns, reactors, membranes and utilities, as well as guarantee testing. You can take on flexible, task-based contract work without a fixed weekly schedule.
Review coding agents as they tackle real engineering tickets, then work through problems in codebases you know to pinpoint and correct model mistakes. The contract offers 40 hours of work each week, with flexible scheduling and weekly renewal when your work meets quality standards. The selection process includes a proctored coding assessment and a paid trial task.
Lead quality reviews for Traditional Chinese Hong Kong and Cantonese AI training projects. You will assess generated content and contributor work against project rubrics, give actionable feedback in English, and guide remote trainers and reviewers through Hong Kong-specific language standards. The role is a contract opportunity with no immediate project; qualified experts may be contacted when relevant work becomes available.
Bring your experience shipping search systems into a 25-minute conversation about search quality, evaluation, and the tradeoffs behind real implementations. The interview has no coding or take-home exercise. Candidates whose interviews stand out may be invited to a paid, 30-minute live conversation with the team; payment follows completion of the call.
Test two AI agents on your phone by asking them to handle everyday errands, then review what happened from a user’s perspective. Each run takes about 1.5 hours, including recording evidence and scoring results. You’ll need an active personal account with a popular AI service, such as ChatGPT, and a smartphone with screen recording. After presentation to the hiring manager, onboarding typically takes 24–48 hours.
AfterQuery needs experienced software engineers to create realistic, multi-step coding challenges for advanced AI coding agents. You will draw on a substantial private codebase you own, frame problems that require investigation across modules, and create Docker-based environments with tests that assess solutions and catch regressions.
Use your software engineering experience to assess coding agents on real engineering problems. You’ll give an agent a ticket and review its work, then work through a problem in a codebase you know and mark where the model fails. The contract offers 40 hours of work each week, with flexible scheduling and weekly renewal based on quality standards.
Lead quality reviews for art history, visual culture, and cultural studies AI training work. You will assess generated explanations and visual analyses, check trainer and QA work against project rubrics, and flag historical errors, weak context, or biased interpretations. The role also covers contributor onboarding, review guidance, and project records maintained with tools such as Discord, Google Docs, and Google Sheets.
Listen to AI-generated audiobooks in US and North American English and assess whether the narration sounds natural, accurate, and enjoyable. You’ll mark speech and audio issues in review tools, identify where the listening experience falters, and rate listener satisfaction. The role calls for native or near-native English fluency, regular audiobook listening, and availability for about 20 hours each week.
Work on an AI safety initiative by testing models for ethical jailbreaks, prompt injection, and tool-use abuse. You’ll develop adversarial evaluation methods, probe multi-turn weaknesses, maintain regression tests, and share findings with technical and non-technical audiences. AI experience is not required; relevant domain knowledge matters.
AfterQuery engages licensed engineers to create and assess scenarios that test how AI models handle professional engineering decisions. You will build examples spanning design, review, and approval, then explain the code and safety considerations behind sound answers. The work is remote and asynchronous, with a minimum commitment of 10 hours per week.
Review coding agents on real engineering tickets, run their code, and assess the results as you would a teammate’s pull request. You’ll also work through a problem in a codebase you know, noting where the model falters. The contract provides 40 hours of work each week, with flexible scheduling, and requires at least four years of professional software engineering experience.
Lead quality checks for TypeScript AI training work by reviewing code and contributor output against project rubrics. You’ll coach trainers and QA reviewers, resolve questions about type safety and runtime behavior, and maintain calibration and onboarding materials. This is a contract role with no immediate project assignment; qualified candidates may be contacted when relevant work opens. Selection includes an AI interview, a domain task, and a recruiter interview.
Build and refine software engineering evaluations from completed pull requests, using Mercor’s in-house framework to assess frontier coding agents such as Claude Code and Codex. You’ll work with an internal research team whose benchmarks compare frontier large language models, then take ownership of evaluation selection, development, and refinement after onboarding.
Create and assess consulting challenges for AI training, drawing on experience with technology services and client engagements. You will write questions and case studies about areas such as solution architecture, vendor selection, and technology strategy, then review model answers for accuracy and alignment with professional services standards. The role also involves working with other technology experts to shape content difficulty and learning value.
Create and evaluate datasets to enhance large language model performance.
Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Pay not listed
python
javascript
react
Machine Learning & AIView job
Showing 20 active roles of 113. Dates reflect what the source published, not when AIWorkJobs last synced.
Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.