AIWorkJobs

Job index

AI / LLM Evaluation jobs

Current roles from specialist AI work platforms. Pay and eligibility are shown as each source publishes them.

Filters1ShowHide
Pay
Reset

Handshake AI

Linguistics Expert (India)

Use your linguistics or computational linguistics expertise on flexible, part-time contract projects supporting AI research. You’ll create realistic linguistic problems, assess AI responses for accuracy and analytical rigor, and write structured feedback. The work is ongoing and project-based, with no fixed schedule or minimum hour requirement, so you can complete assignments alongside your current role.

Location and eligibility
Remote · India only
Engagement type
Part-time
Compensation
$40/hr
  • linguistics
  • computational linguistics
  • morphology
Language & LinguisticsView job

SME Careers

Cantonese Quality Assurance Lead (QAL)

Lead quality reviews for Traditional Chinese Hong Kong and Cantonese AI training projects. You will assess generated content and contributor work against project rubrics, give actionable feedback in English, and guide remote trainers and reviewers through Hong Kong-specific language standards. The role is a contract opportunity with no immediate project; qualified experts may be contacted when relevant work becomes available.

Location and eligibility
Remote · Hong Kong only
Engagement type
Contract
Compensation
Up to $40/hr
  • cantonese
  • traditional chinese
  • hong kong chinese
Quality Assurance & TestingView job

micro1

Equity & Credit Research Expert

Use your financial research expertise to assess company statements, market data, and investment scenarios for an AI training project. You will develop equity and credit commentary, review research materials, and provide examples and feedback that help shape useful training data. Prior AI experience is not required; the role calls for strong knowledge of financial markets and analysis.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$90–$120/hr
  • financial analysis
  • equity research
  • credit research
Market Research & InsightsView job

Ethos

Pharmaceutical Brand / Commercial Manager

Use your pharmaceutical commercial experience to help a foundational AI lab train its language model on professional presentations. You will create, assess, and refine decks covering brand plans, launch readiness, market performance, payer value stories, sales force materials, and lifecycle strategy. Work remotely on your own schedule; hours depend on client task volume, most experts work under 10 hours per week, and there is no weekly cap.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$80/hr
  • pharmaceutical brand management
  • pharmaceutical commercial strategy
  • powerpoint
Product ManagementView job

Turing

Senior Python Engineer – LLM Evaluation (US-based)

Create and refine Python solutions for training large language models.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Pay not listed
  • python
  • javascript
  • reactjs
Machine Learning & AIView job

AfterQuery

Security Engineer — Cryptanalysis / Reverse Engineering

AfterQuery is assembling senior security experts to assess how frontier AI models handle difficult, real-world problems in cryptanalysis and reverse engineering. You will define what strong reasoning and correct answers look like through research and evaluation work, rather than production engineering. The role calls for 6–10 years of experience and a bachelor's degree; a master's degree is preferred.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$135/hr
  • security
  • cryptanalysis
  • reverse engineering
CybersecurityView job

Meridial by Invisible

Application-Level AI Audio Testing Expert

As an independent contractor, you’ll install a specified application version and assess its voice and audio behavior against detailed project instructions. The work covers instruction adherence, model logic, dynamic test scenarios, and the naturalness of recorded audio outputs. A compatible device and operating system are required; the project team will confirm setup during application. Referrals who finish all 10 tasks earn you a $25 USD bonus when you invite them with your unique tracked link.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$9/hr
  • audio evaluation
  • voice testing
  • application testing
Quality Assurance & TestingView job

Etsy · via Braintrust

Merchandising Manager

Reporting to the Director of Merchandising Intelligence & Integrations, you’ll bring category judgment and inventory expertise to model quality work across Etsy. You’ll shape standards and examples that help models recognize distinctive products, shops, and buyer experiences. The contract role is based in Brooklyn, with on-site work two days a week and EST hours. Applicants should send a cover letter and resume. Interviews include a 30-minute hiring manager conversation, a 60-minute technical assessment, and a 30-minute team conversation.

Location and eligibility
On-site · United States only
Engagement type
Contract
Compensation
$60–$65/hr
  • merchandising
  • category management
  • curation
Digital & Performance MarketingView job

General Translation · via Mercor

Latin American Spanish Linguistic Expert

Assess how well a large language model handles Spanish-language tasks, then refine and annotate Spanish data to support its training. You will review areas such as translation, summarization, dialogue, and grammar correction, applying native or near-native Latin American Spanish expertise and an understanding of regional usage.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$40/hr
  • latin american spanish
  • spanish grammar
  • spanish syntax
Language & LinguisticsView job

Handshake AI

Completions Engineer

Apply your energy industry experience to create expert training data and assess AI-generated content about drilling and completions work. The project runs remotely with a flexible, asynchronous schedule and no minimum hours. Contributors often work 5–20 hours per week during active projects, and placement depends on current project needs, with future projects also possible.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
Up to $85/hr
  • drilling operations
  • completions
  • well planning
Data EngineeringView job

SME Careers

Cultural Studies Quality Assurance Lead (QAL)

Lead quality reviews for art history, visual culture, and cultural studies AI training work. You will assess generated explanations and visual analyses, check trainer and QA work against project rubrics, and flag historical errors, weak context, or biased interpretations. The role also covers contributor onboarding, review guidance, and project records maintained with tools such as Discord, Google Docs, and Google Sheets.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Up to $65/hr
  • art history
  • cultural studies
  • visual analysis
Quality Assurance & TestingView job

micro1

Senior Commercial Underwriter

Apply your commercial underwriting background to a customer project focused on risk assessment, coverage, pricing, and quotes. You’ll review business exposures and loss records, then use underwriting principles to support sound decisions. The part-time independent contractor role is remote and open to candidates based in the United States or Canada. Applicants complete a short AI interview about their experience.

Location and eligibility
Remote · Canada, United States
Engagement type
Part-time
Compensation
$50–$80/hr
  • commercial insurance underwriting
  • risk assessment
  • insurance pricing and quoting
AI evaluationView job

Ethos

Contracts Attorney / Legal Diligence & Redlines

Help train a foundational AI lab’s language model by creating, assessing, and refining professional legal and business materials. You’ll work on commercial contract redlines, diligence analyses, and related documents, spreadsheets, and slide decks. Work remotely on your own schedule, with an ASAP start. Client task volume varies; most experts work under 10 hours per week, and no weekly cap applies.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$100/hr
  • commercial contracts
  • contract redlining
  • contract negotiation
LegalView job

Turing

AI Quality Analyst (Personalization) - Turkish

Evaluate Turkish Gemini responses using personal context for relevance.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$15/hr
  • turkish
  • gemini
  • prompt engineering
Quality Assurance & TestingView job

AfterQuery

Tax Accountant Expert

Create and assess tax preparation and planning scenarios that test how AI models apply tax principles to real-world compliance and advisory questions. You will write challenges, review model answers against tax practices and IRS rules, and work with tax and technical experts to shape content that teaches as well as tests.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$113/hr
  • tax accounting
  • tax preparation
  • tax compliance
Finance & AccountingView job

Meridial by Invisible

Audio Evaluations: JSON & Coding Expert (French, Canada)

Review AI-generated coding and technical customer service content, including virtual agent replies, JSON, and audio-related material. You will check accuracy, clarity, usefulness, and fit with project guidelines. The work suits an independent contractor with native-level Canadian French and enough coding knowledge to spot basic issues. You do not need to live in Canada.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$11/hr
  • canadian french
  • json
  • coding
AI evaluationView job

Google DeepMind · via Braintrust

Architectural & Interior Visualization Specialist - AI Training

Support AI training and evaluation with architectural expertise. You’ll build plan-to-render tasks from .dwg and .skp files, review floor plans, and create spatial and building-code rubrics. The work also covers plan sets at 1:20 scale, interior and twilight renders, lighting, composition, materials, and material boards. The commitment is 39 hours per week. Interviews include a 15-minute AI interview and, for candidates who advance, a 45-minute technical interview.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$55–$85/hr
  • autocad
  • dwg
  • sketchup
Architecture & Urban PlanningView job

General Translation · via Mercor

Polish Linguistic Expert

Assess how well an LLM handles Polish across translation, summarization, dialogue, and grammar correction. You will also refine Polish text, annotate language features, and share findings with AI researchers to support model training. The project calls for strong Polish language judgment, professional English, and experience with translation, editing, linguistic annotation, or Polish NLP data.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$40/hr
  • polish
  • english
  • translation
Language & LinguisticsView job

Handshake AI

Biology Expert, PhD

Use advanced training in biology to assess AI-generated material and give feedback on biological concepts, experimental design, scientific reasoning, and technical problem-solving. The work is remote, asynchronous, and project-based, with no minimum hour requirement. During active projects, contributors typically work about 5–20 hours per week; placement depends on project needs, with consideration for future projects.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$150/hr
  • biology
  • biological concepts
  • experimental design
Science & ResearchView job

SME Careers

Thai Team Lead

Lead Thai quality work across AI training projects by reviewing generated content and contributor output against project rubrics. You will give trainers and QA reviewers specific feedback, answer questions about Thai language and cultural conventions, and keep project guidance current in style guides and Google Docs. The role is a contract opportunity; no project is available immediately, but qualified candidates may be contacted for future work.

Location and eligibility
Remote · Eligible in 5 countries
Engagement type
Contract
Compensation
Up to $30/hr
  • thai
  • english
  • thai grammar
Language & LinguisticsView job

Showing 20 active roles of 782. Dates reflect what the source published, not when AIWorkJobs last synced.

Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.