Evaluate AI-generated project plans, reports, communications, and workflows using at least four years of project management experience. The work covers technical and cross-functional projects, with a commitment of 20 or more hours per week. The project starts immediately and runs for about 4–6 weeks. Payment starts per task after approval; completing the first task within the required timeline qualifies you for hourly pay for the rest of the project.
Use your expertise in instrumental performance, composition, or music production to create training data and assess AI-generated music content. You’ll give feedback on accuracy and relevance across musical styles, traditions, and cultures. The remote work runs on a flexible, asynchronous schedule with no minimum hours; contributors often work about 5–20 hours per week during active projects. Project placement depends on current needs, with future projects also possible.
In this remote, hourly contract role, you will assess AI-generated Bulgarian and create reference answers across areas such as education, customer support, translation, and everyday conversation. Apply native or near-native Bulgarian expertise to check grammar, meaning, tone, and cultural fit, then explain your judgments in written English. The work also calls for comparing model responses and producing strong Bulgarian rewrites.
Review and code clinical records for a project that uses expert input to train AI systems. You’ll assign and sequence codes from the documentation, flag gaps for follow-up, and share feedback on complex cases. Medical coding expertise matters; prior AI experience is not required. The role is remote and limited to people located in the US.
Join a research cohort of senior experts who assess how frontier AI models handle complex, real-world problems in hardware design, including CAD, RTL, and robotics. You will define standards for correct, high-quality work through scenario design, reference solutions, rubrics, and model-output reviews. The role centers on research and evaluation, not production engineering. The process includes a thorough background check.
Support a research project for a leading AI lab by completing real productivity and automation workflows on your own Mac. You will narrate your work and help create training data that benchmarks and improves AI models. Applicants need a Mac running macOS 15 or higher, plus either relevant postgraduate study or the specified education and experience background.
Use your energy industry experience to create training data and review AI responses about utility workflows and customer data management. The remote, hourly contract work has a flexible schedule, no minimum hour requirement, and no set weekly commitment. Contributors often work about 5–20 hours per week during active projects. Project placement depends on current needs, with consideration for future projects.
Lead quality across Finnish AI training projects by reviewing model outputs and contributor work against project rubrics. You will coach trainers and QA reviewers, resolve questions on Finnish language choices, and maintain the guidance they use, including standards for selkokieli. The work also covers contributor onboarding and activity follow-up, with team coordination through Discord and quality records in Google Sheets.
Create and assess medical coding content used to train and evaluate AI systems. You’ll write scenarios, documentation excerpts, questions, answer explanations, and scoring materials across inpatient, outpatient, and professional fee settings. The work calls for knowledge of current coding rules and codes. AI experience is not required, and the role is remote within the US.
Turn computational work from your chemistry research into evaluation tasks for AI models. You will build each task around work you have run and debugged, with connected subproblems, a Python reference solution, and tests. The role suits researchers across fields such as electronic structure, kinetics, spectroscopy, catalysis, and chemical thermodynamics. Work follows a flexible, task-based schedule.
Build and refine software engineering evaluations from completed pull requests, using Mercor’s in-house framework to assess frontier coding agents such as Claude Code and Codex. You’ll work with an internal research team whose benchmarks compare frontier large language models, then take ownership of evaluation selection, development, and refinement after onboarding.
Use your energy industry experience to create expert training data and assess AI-generated content about project development and cost estimation. The work draws on knowledge of energy project estimation, construction planning, or solar design. It is remote, project-based contract work with a flexible schedule and no minimum hours; contributors often work 5–20 hours per week during active projects. No AI experience is needed.
Review AI-generated finance work or create expert examples that show sound analysis, from DCF assumptions and valuation to forecasts and unit economics. You will check calculations, compare model responses, and explain errors in clear written feedback. This is an hourly remote contract, and there is no immediate project; qualified experts may be contacted when relevant work becomes available.
Review English audio for fluency, pronunciation, intonation, and naturalness, then explain your judgments in clear written feedback. Your evaluations will support AI language training and model performance. The role requires native English and US residency; prior AI experience is not needed.
Create rehabilitation scenarios that help AI labs assess how models handle real clinical decisions. You’ll write cases from initial evaluation through discharge, explain progression choices, and review model responses for patient safety and evidence-based care. The work is remote, async, and ongoing, with a minimum commitment of 10 hours per week and no fixed schedule or maximum hours. AfterQuery engages contributors as independent contractors.
Mercor keeps this physics listing open as a standing pool for AI training and evaluation projects, rather than a single active opening. You may write discipline-specific problems and reference answers or assess model derivations and numerical work. After you submit a resume, confirm your work location, and complete an AI interview of about 20 minutes, Mercor may contact you when a project fits. Matching can take a week or several months.
Bring your QGIS expertise to a project that helps AI models handle real geospatial work. You’ll build challenging tasks from workflows such as spatial analysis, cartography, geospatial data management, and remote sensing, then assess model responses and write feedback. Work remotely at your own pace, with no set schedule or minimum hours, alongside your current role.
Lead quality workflows for Vietnamese AI training projects by reviewing trainer and QA work against project rubrics, correcting language issues, and aligning contributors on project standards. The role calls for native or near-native Vietnamese, strong English, and experience with language review or AI training. No project is active now; qualified candidates may be contacted when a suitable assignment becomes available.
Review AI-generated work tied to federal IT operations and AI training. You will assess material such as ATO packages, incident reports, privacy impact assessments, and IT investment business cases, then check technical documentation, configurations, and security controls against real federal IT practices. The work also covers incident response simulations and feedback that helps improve AI performance.
In this remote, project-based role, you will bring substantial gaming experience to annotation and evaluation work. You will review game content, data samples, and AI model outputs, then use your knowledge of games and the industry to judge their accuracy, quality, and relevance. The role also asks experts to create prompts for further game evaluation.
Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$20/hr
video games
arcade gaming
esports
Quality Assurance & TestingView job
Showing 20 active roles of 1,328. Dates reflect what the source published, not when AIWorkJobs last synced.
Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.