AIWorkJobs
AfterQuery logoAfterQueryPlatform listing

ML Research Expert — Published First Author (Benchmark Authoring)

Create and validate research-grade benchmark tasks that test frontier AI models across machine learning. The role suits researchers with a master's or PhD, at least one first-author paper, and hands-on experience…

Remote · Eligibility not specifiedNot specified
Work arrangement
Remote
Eligibility
Eligibility not specified
Engagement
Not specified
Compensation
$150/hr

About the role

Create and validate research-grade benchmark tasks that test frontier AI models across machine learning. The role suits researchers with a master's or PhD, at least one first-author paper, and hands-on experience writing ML code for training, evaluation, or systems work. Work remotely on an asynchronous, flexible schedule of 5 to 40 hours per week, with hourly compensation of $150.

What you would do

  • Design realistic ML research tasks in your area of expertise.
  • Build problem sets that measure what frontier AI models can do across machine learning.
  • Validate benchmark tasks for research relevance and soundness.
  • Write expert-level reference solutions for the tasks you create.
  • Develop grading rubrics for evaluating task responses.

Requirements

  • At least one first-author research paper in machine learning or a closely related field.
  • A master's or PhD in ML, computer science, statistics, mathematics, or a related quantitative field, completed or in progress.
  • At least one year of hands-on ML research experience; the listing sets no upper limit.
  • Practical experience writing ML code for training, evaluation, or systems work.
  • Research and coding experience, not annotation or data-labelling experience.
  • Meet the experience and education bar described in the full listing.
  • Provide a link to a first-author paper and its headline result with your application.
  • Meet the stated requirements; the application process includes thorough background checks.

Preferred qualifications

The source marks these as preferred, not required.

  • Multiple first-author publications, or papers showing measured gains over a baseline.
  • Publications at NeurIPS, ICML, ICLR, CVPR, ACL, EMNLP, CoRL, or MLSys.
  • Deep expertise in one or more listed task areas rather than broad familiarity.

Who should apply

Researchers with a master's or PhD in a quantitative field, at least one first-author paper, and hands-on ML coding experience should apply. The best fit brings deep knowledge of one or more listed research areas and can provide a paper link and headline result.

How applying works on AfterQuery

Create an account, complete an interview and a domain assessment, then get matched to a project.

  1. Create an account and submit the short application.
  2. Complete a live or asynchronous video interview.
  3. Pass a short domain skills assessment.
  4. Get matched to a project and begin work.

Paid steps: Not stated by the source

Assessment requirements and payment setup can vary by project.

Process checked Nov 19, 2026. AIWorkJobs does not submit applications or charge a fee. Read the full AfterQuery process and its official source on the AfterQuery page.

Skills mentioned by the source

  • machine learning
  • language models
  • deep learning
  • reinforcement learning
  • computer vision
  • generative models
  • robotics
  • ml systems
  • efficient machine learning
  • optimization
  • learning theory
  • classical machine learning
  • adaptive learning
  • time series forecasting
  • causal reasoning
  • trustworthy machine learning

Listing reference: ml-research-expert-published-first-author-benchmark-authoring-215159. Source: AfterQuery. If something here contradicts the source, the source controls. Report a correction.

Related roles

Other work on the index.

See more in this category

Leading AI Lab · via Braintrust

Conduct & Communications Surveillance Analyst – AI Evaluation

Use your surveillance investigation experience to build realistic cases that assess whether AI can interpret trade records and employee communications, identify relevant evidence, and reach a defensible conclusion. You’ll create fictional-firm scenarios that test the distinction between potential misconduct and legitimate activity, including cases with incomplete records or competing explanations.

Location and eligibility
Remote · Eligible in 11 countries
Engagement type
Contract
Compensation
$70–$90/hr
  • regulatory compliance
  • risk management
  • trade surveillance
Market Research & InsightsView job

Handshake AI

Domain Expert, AI Evaluation (US)

Use your STEM expertise to help improve large language models across scientific and technical fields. Project work may involve creating and solving challenging problems, writing domain-specific prompts, and judging model answers for accuracy and reasoning quality. The year-round fellowship offers remote, asynchronous project work for about 5 to 20 hours per week; assignments depend on project availability.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$200/hr
  • mathematics
  • chemistry
  • biology
Machine Learning & AIView job

SME Careers

Japanese Team Lead

Lead Japanese quality reviews across AI training projects, checking model outputs and contributor work against project rubrics. You’ll give specific feedback, answer language questions, coordinate updates through Discord, and maintain resources such as Japanese style guides and QA trackers. This is a remote contract role with no immediate project; qualified candidates may be contacted when relevant work becomes available.

Location and eligibility
Remote · Eligible in 7 countries
Engagement type
Contract
Compensation
Up to $55/hr
  • japanese
  • english
  • japanese quality assurance
Language & LinguisticsView job

micro1

Personal Injury Lawyer

Review legal scenarios and AI-generated legal work for a project aimed at improving legal reasoning and accuracy in AI systems. You will assess liability, spot gaps or errors, and give structured corrections grounded in your legal expertise. Applicants must hold a J.D. from a U.S. law school, maintain an active license in at least one U.S. state, and live in the United States.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$100–$170/hr
  • legal reasoning
  • issue-spotting
  • document review
LegalView job