AIWorkJobs

Job index

AI / LLM Evaluation jobs

Current roles from specialist AI work platforms. Pay and eligibility are shown as each source publishes them.

Filters1ShowHide
Pay
Reset

AfterQuery

Compliance Officer Expert

Create and assess regulatory compliance challenges that help train AI models. You will write scenarios on topics such as regulatory interpretation, risk assessment, audits, investigations, and ethics, then review model answers for accuracy and alignment with compliance standards. The work draws on practical compliance expertise and takes place remotely with a flexible, asynchronous schedule.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$75/hr
  • regulatory compliance
  • regulatory frameworks
  • risk assessment
Machine Learning & AIView job

Mercor

Payer & Market Access Expert, Gross-to-Net & Formulary

A biotech and pharma research team needs a US-based payer and market access expert to build and critique evaluation rubrics for commercial drugs and drug-development programs. The paid pilot runs remotely for about 10–20 hours over 1–2 weeks, with the possibility of recurring work as the project grows. You will assess gross-to-net, rebate, and formulary-tier assumptions against payer behavior.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$175–$200/hr
  • market access
  • gross-to-net
  • formulary tiering
AI evaluationView job

Handshake AI

Energy Professional

Bring your energy-sector experience to project-based AI research. You’ll create expert training examples and assess AI responses for accuracy and relevance, drawing on the tools and workflows you use at work. The work runs remotely on a flexible, asynchronous schedule with no minimum hours; contributors often work 5–20 hours per week during active projects. Project access depends on current needs, with possible consideration for future work.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $80/hr
  • energy industry
  • oil and gas
  • power generation
Energy & Power GenerationView job

SME Careers

Legal & Compliance Specialist – Rubric Design

Create demanding legal and compliance scenarios, then build rubrics that specify the issues, standards, reasoning, exceptions, and risks a sound answer should address. You will assess AI-generated analysis for accuracy, completeness, and sound judgment, with subject matter drawn from your area of expertise, such as contracts, privacy, or financial regulation.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Up to $120/hr
  • ai evaluation
  • compliance
  • contract law
LegalView job

Turing

Real Estate Broker

Apply your real estate brokerage experience to projects that assess and improve AI systems. You will create transaction scenarios, explain deal and contract decisions, and rate AI responses for accuracy, professionalism, and clarity. The work draws on broker-level expertise; prior AI experience is not required. Projects run for about one month, with possible extensions.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Freelance
Compensation
Pay not listed
  • real estate brokerage
  • property sales
  • deal negotiation
AI evaluationView job

AfterQuery

Students Across All Disciplines (Undergrad)

AfterQuery seeks junior and senior undergraduates at research universities to evaluate AI-related content across academic fields. You will draw on your coursework, lab work, or research to judge specialist material, explain your decisions, and interpret field-specific visuals. Work arrives asynchronously by project, and you can accept projects that fit your academic schedule. The listing describes a commitment of up to 10 hours per week per project; another section cites 10–20 hours per week.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$100/hr
  • academic research
  • subject-matter evaluation
  • academic writing
AI evaluationView job

Mercor

Education & Training Expert

Mercor maintains an ongoing pool of educators for AI training and evaluation projects, rather than hiring for one active opening. Work can include creating teaching problems and reference answers, assessing model-generated lessons and explanations, and spotting content that may confuse learners. Apply with a resume, confirm where you work from, and complete an AI interview of about 20 minutes. Project invitations may arrive within a week or several months.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$30–$85/hr
  • education
  • teaching
  • tutoring
Education & TrainingView job

Handshake AI

Tamil AI Evaluation Specialist (Singaporean Dialect)

Use your command of Singaporean Tamil to compare AI responses and explain which answers better reflect individual users’ needs. You’ll complete ongoing, project-based work remotely, at your own pace, with no set schedule or minimum hours. The role requires a bachelor’s degree or higher, but prior AI training experience is not necessary.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$30/hr
  • tamil
  • singaporean tamil
  • english
AI evaluationView job

SME Careers

Icelandic Team Lead

Lead quality reviews for Icelandic AI training projects, checking model outputs and contributor work against project rubrics for language accuracy, natural phrasing, tone, and cultural fit. You will coach trainers and QA reviewers, keep Icelandic guidance current in Google Docs and Google Sheets, and coordinate updates through Discord. No project is active now; qualified candidates may be contacted when a suitable project opens.

Location and eligibility
Remote · Iceland only
Engagement type
Contract
Compensation
Up to $60/hr
  • icelandic
  • english
  • quality assurance
AI evaluationView job

Turing

AI Quality Analyst (Personalization) - Portuguese

Evaluate AI personalization quality using your personal experiences and insights.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$15/hr
  • portuguese
  • ai quality evaluation
  • personalization evaluation
Language & LinguisticsView job

AfterQuery

Court Interpreter Expert

AfterQuery engages certified court interpreters to create and assess legal interpretation scenarios used to evaluate AI models. You will draw on courtroom and legal experience to write reference interpretations, explain terminology and register choices, and judge whether model responses preserve the intended legal meaning in both working languages. The work is remote, asynchronous contract work with a minimum commitment of 10 hours per week.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$80/hr
  • court interpreting
  • legal terminology
  • legal interpretation
Language & LinguisticsView job

Mercor

Legal Expert

Mercor maintains a standing pool of legal professionals for AI training and evaluation projects. Depending on the project, you may write legal scenarios with reference answers or assess model-generated legal work for accuracy and context. Apply with your resume, confirm where you work from, and complete an AI interview of about 20 minutes. Mercor contacts candidates when a project matches their background.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$60–$150/hr
  • legal practice
  • criminal justice
  • litigation
LegalView job

Handshake AI

Estimator

Bring your energy project experience to AI research by creating expert training data and reviewing AI-generated responses. You’ll assess content about project development workflows, construction planning, solar design, and cost estimation, then share feedback on its accuracy and relevance. The work is remote and project-based, with flexible hours and no minimum-hour requirement. Active projects typically involve 5–20 hours per week.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $85/hr
  • energy project estimation
  • pre-construction
  • solar design
Sales Engineering & Solutions ConsultingView job

SME Careers

Swedish Language Expert

Review AI-generated Swedish and create reference answers that show accurate grammar, natural phrasing, and appropriate tone. You will compare model responses, check facts and cultural context, and explain language issues in written feedback. The work calls for native or near-native Swedish, C1-level English, and at least three years of language-focused professional experience.

Location and eligibility
Remote · Finland, Sweden
Engagement type
Contract
Compensation
Up to $55/hr
  • swedish
  • english
  • copyediting
Language & LinguisticsView job

Turing

Private Equity Associate

Evaluate AI models for private equity deal analysis and performance improvement.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Freelance
Compensation
$100/hr
  • private equity
  • lbo modeling
  • deal sourcing
Machine Learning & AIView job

AfterQuery

ML Research Expert — Published First Author (Benchmark Authoring)

Create and validate research-grade benchmark tasks that test frontier AI models across machine learning. The role suits researchers with a master's or PhD, at least one first-author paper, and hands-on experience writing ML code for training, evaluation, or systems work. Work remotely on an asynchronous, flexible schedule of 5 to 40 hours per week, with hourly compensation of $150.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$150/hr
  • machine learning
  • language models
  • deep learning
Machine Learning & AIView job

Mercor

Music Production Expert - German

Mercor is seeking experienced music producers and audio engineers to assess generative music models for a leading AI lab. You will rate songs and review lyrics and vocals using detailed standards, working in German and English. The project can start immediately and run for up to six months. Most experts contribute about 20 hours per week, with no set hour cap. Apply with a resume and complete a German Bilingual Competency Interview; onboarding details should arrive within a few days.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Task-based
Compensation
$11.37 fixed
  • music production
  • audio engineering
  • mixing
AI evaluationView job

Handshake AI

Malay AI Evaluation Specialist (Singaporean Dialect)

Use your knowledge of Singaporean Malay to assess AI-generated answers and explain which responses better reflect local language and user needs. You’ll add feedback through an annotation platform, drawing on your experience with AI tools. The work is ongoing and project-based, with no set schedule or minimum hours. Previous AI training experience is not required.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$30/hr
  • malay
  • singaporean malay
  • english
AI evaluationView job

SME Careers

Hebrew Team Lead

Lead quality checks across Hebrew AI training projects by reviewing generated content and trainer work against project rubrics. You will give contributors actionable feedback, answer language questions, and maintain resources such as Hebrew style guides and quality trackers. The role requires strong English communication and Hebrew language expertise. There is no immediate project; qualified candidates may be contacted for future work. Selection includes an AI interview, a domain task, and a recruiter interview.

Location and eligibility
Remote · Israel only
Engagement type
Contract
Compensation
Up to $55/hr
  • hebrew
  • english
  • hebrew quality assurance
Language & LinguisticsView job

Showing 20 active roles of 782. Dates reflect what the source published, not when AIWorkJobs last synced.

Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.