AIWorkJobs

Job index

AI / LLM Evaluation jobs

Current roles from specialist AI work platforms. Pay and eligibility are shown as each source publishes them.

Filters1ShowHide
Pay
Reset

Mercor

Commercial Video Editor & Post-Production Lead (AI Evaluation)

Shape how an AI lab evaluates commercial editing by bringing hands-on agency and post-production judgment to its training data. You’ll build realistic editing exercises, create reference cuts, assess generated video, and set quality standards across editorial and finishing work. Cincinnatus LLC employs this full-time W-2 role, places you with a leading AI lab, and expects a weekday commitment of 40 hours per week.

Location and eligibility
Remote · United States only
Engagement type
Full-time
Compensation
$70–$120/hr
  • adobe premiere pro
  • davinci resolve
  • avid media composer
Design & CreativeView job

Handshake AI

Meter Data Analyst

Use your energy industry experience to create expert training material and assess AI-generated responses about utility metering, customer operations, and billing systems. You’ll check responses for accuracy and relevance, then share feedback on utility workflows and customer data practices. The remote, project-based work has flexible hours, no minimum commitment, and no AI experience requirement.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $85/hr
  • utility metering
  • customer operations
  • energy billing
Data Science & AnalyticsView job

SME Careers

Persian Team Lead

Lead Persian (Farsi) quality reviews across AI training projects by checking generated content and contributor work against project rubrics. You will give trainers and QA reviewers clear feedback, answer language and formatting questions, and maintain resources such as style guides and quality trackers. The work calls for strong Persian and English, sound judgment on language and culture, and experience with LLM evaluation or related review workflows.

Location and eligibility
Remote · Eligible in 8 countries
Engagement type
Contract
Compensation
Up to $25/hr
  • persian
  • farsi
  • english
Language & LinguisticsView job

micro1

Federal Contract Specialist

Use your federal acquisition experience on a part-time, project-based contract supporting AI evaluation materials. You’ll write realistic procurement scenarios and reference answers, then assess work from other specialists against FAR requirements and established contracting practice. The role is remote for US-based applicants and pays $60–$80 USD per hour. No AI background is needed. Applicants complete an AI interview after applying.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$60–$80/hr
  • federal contracting
  • federal acquisition regulation (far)
  • federal acquisition lifecycle
Talent Acquisition & RecruitingView job

Turing

AI Quality Analyst - Portuguese (Portugal)

Evaluate personalized AI responses using your own experiences and insights.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$15/hr
  • portuguese
  • gemini
  • gmail
AI evaluationView job

AfterQuery

Science Teacher Expert

AfterQuery engages science teachers as independent contractors to create and assess scenarios that AI labs use to evaluate model judgment. You will write classroom-ready examples, provide answer explanations, and review model responses for scientific accuracy and lab safety. The work runs remotely on an asynchronous schedule, with ongoing project assignments and a minimum commitment of 10 hours each week.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$60/hr
  • science education
  • biology
  • chemistry
Science & ResearchView job

Outlier · via Braintrust

U.S. Attorney & Legal Expert - AI Training

Create challenging legal prompts and assess AI responses for a short-term training project. You will draw on multiple source files, check answers for legal accuracy and realism, and judge whether the model uses the supplied materials faithfully. The work calls for professional legal judgment in one or more listed practice areas.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$75/hr
  • legal writing
  • contract law
  • legal prompt writing
LegalView job

Mercor

Mechanical Engineer Reviewer

Reviewers help assess AI evaluation material for enterprise product design and manufacturing. You will check technical scenarios, reference answers, and grading rubrics against either the US ASME track, the international ISO track, or both. The work reflects the design complexity, safety demands, and production scale found at Fortune 500 companies and large industrial manufacturers.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Hourly
Compensation
$90/hr
  • mechanical engineering
  • asme
  • iso
EngineeringView job

Handshake AI

Electrician

Licensed electricians and other electrical professionals can contribute field expertise to AI research through remote, project-based contract work. You’ll create expert training data and assess AI responses about electrical work, drawing on experience with installation, wiring, troubleshooting, and code compliance. The schedule is flexible, with no minimum hours; contributors often work 5–20 hours per week while a project is active.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $85/hr
  • electrical installation
  • electrical wiring
  • circuit troubleshooting
Machine Learning & AIView job

SME Careers

German Team Lead

Lead quality workflows for German-language AI training projects by reviewing generated content and contributor work against project rubrics. You will coach trainers and QA reviewers, maintain German-specific guidance, and address recurring language or process issues. No project is active now; qualified applicants may be contacted for future work. The selection process includes an AI interview, a domain task, and a recruiter interview.

Location and eligibility
Remote · Austria, Germany
Engagement type
Contract
Compensation
Up to $60/hr
  • german
  • english
  • ai training
Language & LinguisticsView job

micro1

AI Agent Evaluator

Test two AI agents on your phone by asking them to handle everyday errands, then review what happened from a user’s perspective. Each run takes about 1.5 hours, including recording evidence and scoring results. You’ll need an active personal account with a popular AI service, such as ChatGPT, and a smartphone with screen recording. After presentation to the hiring manager, onboarding typically takes 24–48 hours.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$25–$45/hr
  • ChatGPT
  • Muse
  • AI agents
Quality Assurance & TestingView job

Turing

Medical Expert – Dermatology (USA)

Evaluate AI-generated dermatology content for accuracy and safety.

Location and eligibility
Remote · United States only
Engagement type
Freelance
Compensation
Pay not listed
  • dermatology
  • medical image review
  • clinical content review
AI evaluationView job

AfterQuery

Video Editor & Post Production Expert

AfterQuery engages experienced editors as independent contractors to create and assess post-production work used in AI model evaluations. You’ll build scenarios from raw footage to final cut, explain your editorial choices, and assess generated video. The work runs remotely and asynchronously, with no fixed hours, a minimum commitment of 10 hours per week, and ongoing project assignments.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$70/hr
  • video editing
  • post-production
  • premiere pro
Design & CreativeView job

Mercor

Expert Project Manager

Manage projects that advance LLM browsing capabilities, with a focus on tracking project and annotator performance in Google Sheets, checking annotation quality, and communicating with contributors. The role suits someone who can organize work, analyze results, and take an unfamiliar problem from first steps through completion. Project or operations experience can help, but ownership matters most.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Hourly
Compensation
$50–$60/hr
  • project management
  • operations
  • google sheets
Operations & ManagementView job

Handshake AI

Intensivist

Use your critical care training and ICU experience to shape AI research. You’ll create challenging clinical tasks, assess AI responses for accuracy and patient safety, and write feedback grounded in current practice and guidelines. The work is remote, project-based, and part-time, with no set schedule or minimum hours. Projects open throughout the year, so you can contribute alongside your current role.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$180/hr
  • critical care medicine
  • medical critical care
  • surgical critical care
Health Informatics & Medical RecordsView job

SME Careers

Kotlin Engineer

Review and compare AI-generated Kotlin solutions for correctness, sound reasoning, and fit with each prompt. You will also write model answers and explanations, check technical claims, and flag errors in code or architecture. This remote contract role has no immediate project; qualified engineers may be contacted when relevant work opens through the expert network.

Location and eligibility
Remote · Eligible in 17 countries
Engagement type
Contract
Compensation
Up to $55/hr
  • kotlin
  • android development
  • android jetpack
Machine Learning & AIView job

micro1

Graphic Designer

Graphic designers in the United States can contribute to a project that assesses AI-generated images. You’ll submit original photographs, compare them with generated images, and describe differences such as issues with lighting, composition, perspective, texture, or image quality. The work calls for careful visual judgment and clear feedback. Prior AI experience is not required.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$21–$45/hr
  • Image Evaluation
  • Attention to Visual Detail
  • Comparative Ranking
Design & CreativeView job

AfterQuery

Technology and Professional Services Expert

Create and assess consulting challenges for AI training, drawing on experience with technology services and client engagements. You will write questions and case studies about areas such as solution architecture, vendor selection, and technology strategy, then review model answers for accuracy and alignment with professional services standards. The role also involves working with other technology experts to shape content difficulty and learning value.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$80/hr
  • technology consulting
  • professional services
  • systems integration
Sales Engineering & Solutions ConsultingView job

Mercor

HR & Administration Specialist Talent Network

Mercor’s network connects HR and administration specialists with future projects for AI labs and companies. After you complete your profile and pass an AI interview, Mercor can match you with projects as they open. Work may cover AI model training and evaluation, scenario-based tasks, and expert feedback. Projects vary in scope and duration, with typical commitments of 15–30 hours per week.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$60–$80/hr
  • talent acquisition
  • employee onboarding
  • payroll administration
Talent Acquisition & RecruitingView job

Showing 20 active roles of 782. Dates reflect what the source published, not when AIWorkJobs last synced.

Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.