AIWorkJobs

Job index

AI / LLM Evaluation jobs

Current roles from specialist AI work platforms. Pay and eligibility are shown as each source publishes them.

Filters1ShowHide
Pay
Reset

Google DeepMind · via Braintrust

Credit Research Analyst / Investment Analyst

Use your investment research experience to assess AI-generated analysis of companies, markets, and investment opportunities. You’ll review equity, fixed-income, credit, and fundamental research, then flag errors, weak reasoning, unsupported claims, and gaps. Your feedback will help improve AI systems’ ability to produce research that meets institutional standards. Applicants must be based in the United States.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$100–$145/hr
  • credit risk
  • credit analysis
  • equity research
Market Research & InsightsView job

General Translation · via Mercor

Thai Linguistic Expert

Assess Thai-language output from a large language model and help build linguistic data that supports its training and improvement. You’ll review work such as translations, summaries, dialogue, and grammar corrections, then edit or annotate Thai text and share findings with AI researchers. The role calls for strong Thai language judgment, cultural awareness, and professional English fluency.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$40/hr
  • thai
  • english
  • translation
Language & LinguisticsView job

Handshake AI

Retail Finance Director

Use senior retail finance experience to help improve AI research. You’ll write training questions based on real planning and budgeting work, assess AI responses, and give written feedback. The work is ongoing and project-based, with a flexible schedule, no minimum hour requirement, and room to fit tasks around your current work.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$80/hr
  • retail finance
  • financial leadership
  • long-range financial planning
Finance & AccountingView job

SME Careers

Indonesian Quality Assurance Lead (QAL)

Lead language quality across Indonesian AI training projects by reviewing model content and trainer or QA work against project rubrics. You will assess grammar, meaning, tone, cultural fit, and instruction-following, then give contributors clear feedback and maintain Indonesian-specific guidance. The role also covers onboarding, quality documentation, and contributor follow-up using tools such as Discord and Google Sheets.

Location and eligibility
Remote · Indonesia only
Engagement type
Contract
Compensation
Up to $25/hr
  • bahasa indonesia
  • indonesian
  • english
Quality Assurance & TestingView job

micro1

E-commerce Simulation Expert

Use your e-commerce background to build realistic digital stores and shopping scenarios for AI training. You’ll create and maintain product catalogs, assess model responses, and refine data based on observed errors. At least three years of experience in e-commerce operations, merchandising, or catalog management is required. Previous AI experience is not required.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$40–$50/hr
  • E-commerce Operations
  • Product Catalog Structuring
  • AI / LLM Prompting & Evaluation
Machine Learning & AIView job

Ethos

Marketing Manager (B2B)

Work with a leading foundational AI lab to train its latest language model on professional presentations. You will create, assess, and refine AI-generated decks across marketing and leadership workflows, including campaign reviews, product launches, budgets, events, and positioning. The role is fully remote with a flexible schedule; hours depend on client task volume, are not guaranteed, and most experts work under 10 hours per week. The start date is ASAP, with no weekly cap on hours.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$70/hr
  • b2b marketing
  • powerpoint
  • slide design
Marketing & Brand ManagementView job

AfterQuery

Experimental Biologist & Physiologist (Lab)

Create research-level problems for AI models using your hands-on experience with biology, biochemistry, plant science, or a related field. The work draws on raw lab and greenhouse readouts, including assays, cell counts, growth and physiology measurements, and isotope labeling. This remote, task-based contract has no fixed weekly schedule, and you choose how many tasks to accept.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$50/hr
  • biology
  • biochemistry
  • plant science
Science & ResearchView job

Meridial by Invisible

Audio Evaluations: JSON & Coding Expert (Welsh)

Review AI-generated coding and technical customer service content, including virtual agent replies, JSON structures, and audio-related material. You’ll assess accuracy, clarity, natural Welsh, and usefulness against project guidelines. The role requires native-level Welsh as spoken in Wales, but you do not need to live in the United Kingdom. You’ll complete a language introduction and a JSON skills assessment.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$11/hr
  • welsh
  • json
  • coding
Language & LinguisticsView job

Google DeepMind · via Braintrust

AML / KYC Investigator / Financial Crime Compliance

Use your financial crime investigation experience to assess how AI systems analyze suspicious activity, transaction monitoring alerts, and fraud scenarios. You’ll review casework and AI-generated conclusions for accuracy, sound risk judgment, and consistency with established practices, then explain gaps and missed indicators through structured feedback. Applicants need at least four years of relevant professional experience and must be based in the United States.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$100–$145/hr
  • aml
  • kyc
  • transaction monitoring
Data Science & AnalyticsView job

General Translation · via Mercor

Arabic Linguistic Expert

Assess how well a large language model handles Arabic tasks such as translation, summarization, dialogue, and grammar correction. You will also refine Arabic text, annotate linguistic features, and share findings with AI researchers to support model training. The work calls for native or near-native Arabic, professional English, and experience with Arabic language work.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$40/hr
  • arabic
  • english
  • linguistic annotation
Language & LinguisticsView job

Handshake AI

Spanish AI Evaluation Specialist (Mexico)

Use your experience with ChatGPT and other AI assistants to compare Spanish-language responses and explain which answers better fit a user’s needs. You’ll complete project-based annotation work at your own pace, with no set schedule or minimum hours. Applicants must live in Mexico and agree to share their ChatGPT conversation history for research and product improvement; the company will handle that history confidentially.

Location and eligibility
Remote · Mexico only
Engagement type
Part-time
Compensation
$25/hr
  • spanish
  • english
  • chatgpt
AI evaluationView job

SME Careers

Catalan Language Expert

Review AI-generated answers in Catalan and English, judging language quality, factual accuracy, and how well each response follows its prompt. You will score and compare model outputs, write prompts and model explanations, and record decisions in English. The work calls for advanced Catalan proficiency, structured linguistic QA, and careful use of reliable references.

Location and eligibility
Remote · Spain only
Engagement type
Full-time
Compensation
Up to $26/hr
  • catalan
  • english
  • fact-checking
Language & LinguisticsView job

micro1

Specialist

Help assess how AI models handle federal procurement work by creating realistic contracting tasks, reviewing model responses, and supplying expert feedback. The work spans the acquisition lifecycle, from pre-award planning and solicitation through negotiation and post-award administration. The role is listed for applicants in the United States and focuses on federal contracting expertise.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$60–$80/hr
  • Federal Contracting
  • Contract Negotiation
  • Pre-Award and Post-Award Procedures
Talent Acquisition & RecruitingView job

Ethos

Revenue/GTM Operations Specialist

Use your revenue and CRM operations expertise to help train a language model from a foundational AI lab. You will create, assess, and refine professional documents, spreadsheets, and slide decks for core GTM workflows, including field mapping, lead routing, territory models, pipeline audits, funnel dashboards, and data deduplication.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$100/hr
  • revenue operations
  • gtm operations
  • crm operations
Sales & Business DevelopmentView job

Turing

Venture Capital Analyst

Evaluate AI models for venture capital insights and market analysis.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Freelance
Compensation
$100/hr
  • venture capital
  • startup valuation
  • term sheet analysis
AI evaluationView job

AfterQuery

Speech Language Pathologist Expert

AfterQuery needs practicing speech-language pathologists to create and assess clinical scenarios that help AI labs evaluate model judgment in communication and swallowing care. You’ll write cases and reference answers, then review model responses for accuracy, safety, and sound clinical reasoning. The independent contractor work runs remotely and asynchronously, with a minimum commitment of 10 hours per week.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$88/hr
  • speech-language pathology
  • clinical evaluation
  • diagnosis
Language & LinguisticsView job

Meridial by Invisible

Dutch speakers specialist

Assess Dutch audio and language model responses by comparing samples and judging their accuracy, fluency, naturalness, and overall quality. The work calls for a strong grasp of Dutch grammar, pronunciation, and speech patterns, including dialect variation. Individual evaluations take about 30 seconds to 4 minutes.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$1.3 fixed
  • dutch
  • dutch grammar
  • dutch spelling
Language & LinguisticsView job

Turing · via Braintrust

Mental Health Clinician - AI Evaluation

Assess AI responses in behavioral health by creating clinical scenarios and judging therapeutic fit, empathy, safety, and clinical reasoning. The six-week remote contract is for US-based clinicians and starts immediately. It requires eight hours of work per day, including four hours of overlap with Pacific Time. The project starts with paid certification hours; clinicians who pass can move into production work.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$30–$42/hr
  • mental health
  • clinical psychology
  • clinical social work
Healthcare & MedicalView job

General Translation · via Mercor

Korean Linguistic Expert

Assess Korean-language output from a large language model and prepare linguistic data that supports its training and improvement. You will review translation, summarization, dialogue, and grammar correction, then use your expertise in Korean linguistics and language annotation to flag errors and guide AI researchers. The project partners with a leading research lab.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$40/hr
  • korean
  • english
  • korean linguistics
Language & LinguisticsView job

Showing 20 active roles of 782. Dates reflect what the source published, not when AIWorkJobs last synced.

Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.