AIWorkJobs

Job index

AI / LLM Evaluation jobs

Current roles from specialist AI work platforms. Pay and eligibility are shown as each source publishes them.

Filters2ShowHide
Pay
Reset

Ethos

Operations Manager / Capacity & Process Improvement

Use your operations expertise to help train a foundational AI model on professional documents, spreadsheets, and slide decks. You will create, assess, and refine materials for capacity planning, inventory forecasting, process mapping, standard operating procedures, business cases, and operational readiness.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$70/hr
  • operations management
  • capacity planning
  • inventory forecasting
Operations & ManagementView job

AfterQuery

Operations Research & Applied Mathematics Specialist

Use your experience with operations research, applied mathematics, or a related field to create research-level problems that test and train AI models. You’ll work with real operational data, such as data from supply chains, scheduling, or physical processes. The contract is remote and task-based, with no fixed weekly schedule.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$50/hr
  • operations research
  • applied mathematics
  • python
Machine Learning & AIView job

Turing

Senior Python Engineer – LLM Evaluation (US-based)

Create and evaluate datasets to enhance large language model performance.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Pay not listed
  • python
  • c++
  • c
Machine Learning & AIView job

General Translation · via Mercor

Thai Linguistic Expert

Assess Thai-language output from a large language model and help build linguistic data that supports its training and improvement. You’ll review work such as translations, summaries, dialogue, and grammar corrections, then edit or annotate Thai text and share findings with AI researchers. The role calls for strong Thai language judgment, cultural awareness, and professional English fluency.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$40/hr
  • thai
  • english
  • translation
Language & LinguisticsView job

SureHost · via Braintrust

AI Model Benchmarking Intern Iowa-Based

SureHost is a Des Moines hospitality technology company that uses documented property standards, photos, video, AI-assisted review, and human judgment to check short-term rentals after cleaning. You will work with the AI Chief Architect to benchmark language and vision models against real product needs and share findings that guide model choices and the roadmap. The six-month internship is remote for Iowa residents, runs 15–20 hours per week with flexible scheduling, and pays $22–$28 per hour based on experience and independence. Start timing can accommodate school schedules; the team holds a monthly in-person check-in in Des Moines.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$22–$28/hr
  • python
  • data analysis
  • machine learning
Machine Learning & AIView job

Handshake AI

Completions Engineer

Apply your energy industry experience to create expert training data and assess AI-generated content about drilling and completions work. The project runs remotely with a flexible, asynchronous schedule and no minimum hours. Contributors often work 5–20 hours per week during active projects, and placement depends on current project needs, with future projects also possible.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $85/hr
  • drilling operations
  • completions
  • well planning
Data EngineeringView job

SME Careers

Life & Environmental Sciences Team Lead

Lead quality checks for AI training work across biology, ecology, environmental science, and related life sciences. You will assess scientific content against project rubrics, coach trainers and QAs, maintain review documentation, and flag risks such as unsupported environmental claims or unsafe recommendations. The role calls for native Punjabi fluency, strong English communication, and at least three years of relevant scientific experience.

Location and eligibility
Remote · India only
Engagement type
Contract
Compensation
Up to $20/hr
  • biology
  • ecology
  • environmental science
Science & ResearchView job

micro1

E-commerce Simulation Expert

Use your e-commerce background to build realistic digital stores and shopping scenarios for AI training. You’ll create and maintain product catalogs, assess model responses, and refine data based on observed errors. At least three years of experience in e-commerce operations, merchandising, or catalog management is required. Previous AI experience is not required.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$40–$50/hr
  • E-commerce Operations
  • Product Catalog Structuring
  • AI / LLM Prompting & Evaluation
Machine Learning & AIView job

Ethos

Strategy Consultant

Help a leading foundational AI lab train its latest language model on professional presentation work. You will create, assess, and refine AI-generated presentations and slide decks across strategy consulting workflows. Work remotely on your own schedule; client task volume determines available hours, and most experts work under 10 hours a week. The role has no weekly hours cap.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$80/hr
  • strategy consulting
  • powerpoint
  • storylining
Business Analysis & StrategyView job

AfterQuery

Civil, Geotechnical & Structural Field Engineer

Use your experience with civil, geotechnical or structural field data to create research-level problems that test and train AI models. The work draws on real site and monitoring data, including settlement, pile and load tests, inspections, and instrumentation. AfterQuery offers remote, flexible contract work with no set weekly schedule.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$50/hr
  • python
  • civil engineering
  • geotechnical engineering
Machine Learning & AIView job

General Translation · via Mercor

Arabic Linguistic Expert

Assess how well a large language model handles Arabic tasks such as translation, summarization, dialogue, and grammar correction. You will also refine Arabic text, annotate linguistic features, and share findings with AI researchers to support model training. The work calls for native or near-native Arabic, professional English, and experience with Arabic language work.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$40/hr
  • arabic
  • english
  • linguistic annotation
Language & LinguisticsView job

Outlier · via Braintrust

Senior Finance & Operations Experts - AI Benchmarking

Create realistic finance and operations challenges that help benchmark AI systems. You’ll build scenarios from professional workflows, set clear criteria for correct results, and assess proposed answers for accuracy and sound reasoning. The project expects 20 hours of work per week for 1–6 months and pays $1,350 per task.

Location and eligibility
Remote · Eligible in 25 countries
Engagement type
Contract
Compensation
$1,350 fixed
  • finance
  • operations
  • compliance
Machine Learning & AIView job

Handshake AI

Biology Expert, PhD

Use advanced training in biology to assess AI-generated material and give feedback on biological concepts, experimental design, scientific reasoning, and technical problem-solving. The work is remote, asynchronous, and project-based, with no minimum hour requirement. During active projects, contributors typically work about 5–20 hours per week; placement depends on project needs, with consideration for future projects.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$150/hr
  • biology
  • biological concepts
  • experimental design
Science & ResearchView job

SME Careers

Kotlin Engineer

Review and compare AI-generated Kotlin solutions for correctness, sound reasoning, and fit with each prompt. You will also write model answers and explanations, check technical claims, and flag errors in code or architecture. This remote contract role has no immediate project; qualified engineers may be contacted when relevant work opens through the expert network.

Location and eligibility
Remote · Eligible in 17 countries
Engagement type
Contract
Compensation
Up to $55/hr
  • kotlin
  • android development
  • android jetpack
Machine Learning & AIView job

micro1

Specialist

Help assess how AI models handle federal procurement work by creating realistic contracting tasks, reviewing model responses, and supplying expert feedback. The work spans the acquisition lifecycle, from pre-award planning and solicitation through negotiation and post-award administration. The role is listed for applicants in the United States and focuses on federal contracting expertise.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$60–$80/hr
  • Federal Contracting
  • Contract Negotiation
  • Pre-Award and Post-Award Procedures
Talent Acquisition & RecruitingView job

Ethos

Academic Researcher / Postdoctoral Fellow

Help a foundational AI lab train its language model to produce professional research presentations. You will create, assess, and refine AI-generated slide decks and related materials across research communication workflows. The work draws on active academic research, conference presentations, and strong PowerPoint skills. Work remotely on your own schedule; task volume varies, and hours are not guaranteed.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$70/hr
  • powerpoint
  • academic research
  • conference presentations
Machine Learning & AIView job

AfterQuery

Office Manager Expert

Create and assess office management challenges used to train AI models. You will draw on experience in administrative leadership to develop scenarios about team supervision, operational workflows, and practical problem-solving, then check model answers against established office management standards. The role is remote and asynchronous, with a flexible schedule.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$85/hr
  • office management
  • administrative leadership
  • team supervision
Machine Learning & AIView job

Turing

Senior Python Engineer – LLM Evaluation (US-based)

Create and refine Python solutions for training large language models.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Pay not listed
  • python
  • javascript
  • reactjs
Machine Learning & AIView job

General Translation · via Mercor

Korean Linguistic Expert

Assess Korean-language output from a large language model and prepare linguistic data that supports its training and improvement. You will review translation, summarization, dialogue, and grammar correction, then use your expertise in Korean linguistics and language annotation to flag errors and guide AI researchers. The project partners with a leading research lab.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$40/hr
  • korean
  • english
  • korean linguistics
Language & LinguisticsView job

Showing 20 active roles of 323. Dates reflect what the source published, not when AIWorkJobs last synced.

Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.