AIWorkJobs

Job index

AI / LLM Evaluation jobs

Current roles from specialist AI work platforms. Pay and eligibility are shown as each source publishes them.

Filters1ShowHide
Pay
Reset

Turing

Community Association Manager (Real Estate)

Apply your property management and community association experience to projects that assess and improve AI. You will create realistic industry scenarios and write structured solutions for areas such as tenant relations, lease administration, budgets, and maintenance. No prior AI experience is needed. Projects run for about one month, with possible extensions.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Freelance
Compensation
Pay not listed
  • property management
  • community association management
  • real estate operations
AI evaluationView job

AfterQuery

Real Estate Agent Expert

Create real estate questions and case studies for AI training, then assess model answers against practical standards and regulations. The work draws on an active real estate license and experience in practice, brokerage, or property management. You will also work with real estate and technical specialists to shape challenges that test topics such as valuation, contracts, financing, zoning, and market analysis.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$75/hr
  • real estate
  • property valuation
  • contract negotiation
Machine Learning & AIView job

Mercor

Machine Learning Expert

Mercor keeps this listing open to build a pool of machine learning practitioners for AI training and evaluation projects. You may write problems from systems you have shipped, assess model-generated code, or spot approaches that could fail in production. Apply with your resume, confirm where you work from, and complete an AI interview that takes about 20 minutes. Project invitations can arrive within a week or several months.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$70–$120/hr
  • machine learning
  • model training
  • model evaluation
Machine Learning & AIView job

Handshake AI

Demand Planner

Use your retail supply chain experience to help assess and improve AI-generated content. You’ll create training questions based on real workflows, review model responses, and write feedback on their accuracy and relevance. The work centers on demand forecasting, inventory planning, and freight management, with project-based tasks you can complete on your own schedule and no minimum hour requirement.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$80/hr
  • retail demand planning
  • supply chain management
  • demand forecasting
AI evaluationView job

SME Careers

Korean Quality Assurance Lead (QAL)

Guide quality across Korean AI training projects by reviewing model outputs and trainer or QA work against project rubrics. You will give specific feedback, resolve questions about Korean usage, and keep contributor guidance current through Discord and Google Docs. The role is remote and contract-based, with no immediate project; qualified candidates may hear about future assignments through the expert network.

Location and eligibility
Remote · Eligible in 6 countries
Engagement type
Contract
Compensation
Up to $45/hr
  • korean
  • english
  • korean proofreading
Quality Assurance & TestingView job

Turing

AI Benchmark & Red-Teaming Specialist

Research and build benchmark tasks to expose AI model weaknesses.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
Pay not listed
  • large language models
  • ai benchmarking
  • red teaming
Machine Learning & AIView job

AfterQuery

Attorney

AfterQuery seeks a JD-trained attorney to create and assess legal reasoning challenges for AI training modules. You will develop scenarios across areas such as contract law, constitutional law, and intellectual property, then review model answers for sound reasoning and proper use of legal principles. The role is remote, flexible, and asynchronous.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$138/hr
  • legal research
  • legal analysis
  • contract law
LegalView job

Boron · via Mercor

Certified Medical Coder (ICD-10) — Multilingual Clinical Documentation & AI Evaluation

Bring your medical coding and documentation expertise to the review of clinical records and AI-generated notes. You will check coding accuracy, annotate documentation, and share feedback that helps improve clinical AI tools. Applicants must live in the US, hold an active qualifying certification, and speak, read, and write English plus another language at C1 level or above.

Location and eligibility
Remote · United States only
Engagement type
Hourly
Compensation
$45–$65/hr
  • icd-10
  • medical coding
  • clinical documentation
Health Informatics & Medical RecordsView job

Handshake AI

Technical Writers

Use your technical writing or editorial experience to create training material and assess AI-generated documentation. You’ll review accuracy, relevance, structure, clarity, consistency, voice, and tone against professional writing standards. The work is remote, project-based, and flexible, with no minimum hours. Contributors often work about 5–20 hours per week during active projects, alongside other employment.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $100/hr
  • technical writing
  • technical documentation
  • content creation
Technical Writing & DocumentationView job

SME Careers

Hindi Quality Assurance Lead (QAL)

As a Hindi Quality Assurance Lead, you will review Hindi AI-training content and contributor work against project rubrics. You will assess language accuracy, tone, cultural fit, and instruction-following, then give clear feedback and maintain resources such as Hindi style guides and Devanagari examples. The role also covers contributor onboarding, guideline updates, and recurring quality issues across Hindi projects.

Location and eligibility
Remote · India only
Engagement type
Contract
Compensation
Up to $25/hr
  • hindi
  • english
  • devanagari
Language & LinguisticsView job

Turing

Senior Software Engineer - AI Evaluation / Coding Agents

Evaluate and improve AI coding models by reviewing generated code.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$100–$150/hr
  • python
  • typescript
  • javascript
Machine Learning & AIView job

AfterQuery

Elementary School Teacher Expert

AfterQuery engages primary teachers as independent contractors to create and assess classroom scenarios for AI model evaluations. You’ll build examples that cover lesson planning through assessment, explain the developmental reasoning behind reference answers, and judge model responses for instructional accuracy and age fit. The work runs remotely on an asynchronous schedule, with a minimum commitment of 10 hours each week.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$50/hr
  • elementary education
  • primary education
  • early literacy
Education & TrainingView job

Mercor

Senior Counsel — Legal Domain Expert

Use your legal practice experience to help a leading AI lab assess and improve how its models handle real legal work. You will review legal tasks and model responses, write task instructions and reference solutions, and create evaluations alongside research teams. The role requires 8 to 15 years of post-qualification practice, U.S. bar admission, and a Bay Area residence for a hybrid schedule. Cincinnatus LLC employs this full-time W-2 role for an initial six-month engagement.

Location and eligibility
Hybrid · United States only
Engagement type
Full-time
Compensation
$85–$120/hr
  • legal analysis
  • legal research
  • legal writing
LegalView job

Handshake AI

Customer Ops Analyst

Use your energy industry experience to create expert training data and assess AI-generated responses about utility workflows and customer data management. The work draws on hands-on knowledge of utility metering, customer operations, and energy billing systems. Projects are remote and hourly, with flexible scheduling, no minimum hours, and about 5–20 hours per week during active projects. Placement depends on project needs; no prior AI experience is required.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $85/hr
  • utility metering
  • customer operations
  • energy billing systems
Data Science & AnalyticsView job

SME Careers

Norwegian Team Lead

Lead Norwegian-language quality work for AI training projects by reviewing model content and contributor work against project rubrics. You’ll coach trainers and QA reviewers, answer questions on language standards, and maintain resources such as style guides and onboarding materials. The role is a remote contract with no immediate project; qualified candidates may be contacted when a suitable project becomes available.

Location and eligibility
Remote · Norway only
Engagement type
Contract
Compensation
Up to $60/hr
  • norwegian
  • bokmål
  • nynorsk
Language & LinguisticsView job

Turing

Equity Research Analyst

Evaluate AI models using financial analysis and investment strategies.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Freelance
Compensation
$100/hr
  • equity research
  • credit research
  • financial statement analysis
Machine Learning & AIView job

AfterQuery

Mandarin Research Reviewer

Reviewers help improve an AI research tool that turns complex questions into structured tables. You will check Mandarin-language research results against primary sources, assess each entry for accuracy and completeness, and search for missing information. The remote, project-based work is asynchronous and self-paced, with an expected commitment of 10–20 hours per week over the next several weeks. Each task takes about 1.5–2 hours.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$30/hr
  • mandarin chinese
  • web research
  • source verification
AI evaluationView job

Boron · via Mercor

Pediatric Emergency / Care Physician (MD)

A healthcare AI partner needs a US-based physician with pediatric emergency or urgent care experience to assess clinical documentation and AI-generated summaries. You will review encounter records, annotate them against detailed guidelines, and flag clinical issues that could affect the accuracy and safety of documentation tools. The part-time remote schedule requires at least 10 hours per week through mid-November.

Location and eligibility
Remote · United States only
Engagement type
Hourly
Compensation
$150/hr
  • pediatric emergency medicine
  • pediatric urgent care
  • clinical documentation review
Healthcare & MedicalView job

Handshake AI

Store Operation Manager

Use your retail management experience to create training examples and assess AI-generated answers about store operations. You’ll provide feedback on accuracy and relevance, drawing on practical knowledge of performance reporting, cash reconciliation, and inventory management. The work is remote, project-based, and part-time, with flexible scheduling and no minimum hours. Active projects typically involve 5–20 hours per week, and placement depends on project needs.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$80/hr
  • retail store management
  • retail operations
  • store management workflows
Operations & ManagementView job

SME Careers

Ukrainian Team Lead

Guide quality across Ukrainian AI training projects by reviewing generated content and contributor work against project rubrics. You’ll coach trainers and QA reviewers, resolve questions about Ukrainian usage, and maintain the documentation that keeps standards consistent across a remote team. The role is a contract position and calls for professional Ukrainian and English, plus experience with language review or related workflows.

Location and eligibility
Remote · Eligible in 6 countries
Engagement type
Contract
Compensation
Up to $30/hr
  • ukrainian
  • english
  • ukrainian grammar
Language & LinguisticsView job

Showing 20 active roles of 782. Dates reflect what the source published, not when AIWorkJobs last synced.

Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.