Shape how frontier coding agents are tested and improved. You will create evaluation methods, datasets, and tools, then study model performance across software engineering tasks. The work combines Python and software engineering, LLM and agent systems, benchmark design, and model failure analysis. You will also share research findings with technical and client audiences.
Help assess how frontier AI models handle difficult, real-world questions in your area of expertise. You’ll shape technical scenarios and problem sets, write reference answers and grading criteria, then judge model responses for accuracy, depth, and sound domain reasoning. The work centers on research and evaluation rather than production engineering, across seven specialist tracks.
Help train a foundational AI lab’s language model by creating, reviewing, and refining presentations for core private equity workflows. You’ll draw on deal-facing experience to assess investment narratives and slide quality. Work remotely on your own schedule; client task volume varies, and most experts work under 10 hours per week. The role has no weekly hours cap and starts as soon as possible.
Bring your mechanical design experience or postgraduate engineering studies to a research project with a leading AI lab. You’ll complete and explain real CAD workflows on your own Mac, producing training data that helps benchmark and improve AI models. The role calls for about 10–20 hours each week and requires a Mac running macOS 15 or later.
Bring your energy project experience to AI research by creating expert training data and reviewing AI-generated responses. You’ll assess content about project development workflows, construction planning, solar design, and cost estimation, then share feedback on its accuracy and relevance. The work is remote and project-based, with flexible hours and no minimum-hour requirement. Active projects typically involve 5–20 hours per week.
Develop and assess LLM-powered agents and AI systems used in enterprise workflows. The role combines applied research with hands-on engineering: you will design evaluations, investigate failures, run experiments, and help improve system performance. You will also build research tools and infrastructure while working with researchers, engineers, domain experts, and enterprise customers.
Create and validate research-grade benchmark tasks that test frontier AI models across machine learning. The role suits researchers with a master's or PhD, at least one first-author paper, and hands-on experience writing ML code for training, evaluation, or systems work. Work remotely on an asynchronous, flexible schedule of 5 to 40 hours per week, with hourly compensation of $150.
Use your research expertise to assess mathematical reasoning in AI model outputs and shape the standards used to judge correctness. You will write rigorous problem specifications, reference solutions, and proofs, then build evaluation sets in your area of specialization. The role is fully remote and requires a United States base.
Use your materials science and engineering expertise to help AI systems handle real-world modeling and research work. You’ll create training scenarios, assess AI responses, and write feedback grounded in your experience with computational modeling and materials simulation. The work is project-based, part-time, and self-scheduled, with no set hours or minimum time commitment.
Realm Lab needs a Member of Technical Staff to evaluate and improve frontier AI systems. You’ll work across machine learning, data research, and evaluation engineering, building benchmarks, reinforcement learning environments, and datasets. The role calls for hands-on experience with LLM evaluation, Python, and experimental methods, plus the ability to turn real-world workflows into structured tests of model capabilities.
Build complete applications that become examples in AI training datasets. You’ll create production-ready software across business domains, using Next.js, Redis, SQL databases, and Tailwind CSS to show varied features and architectural approaches. The work spans frontend experiences, backend logic, data handling, and application functionality.
Bring senior research expertise to the evaluation of AI systems in biology and the life sciences. You will assess scientific tasks and model responses, create precise problem specifications and reference solutions, and build research-level benchmarks in your specialty. The role suits a practicing specialist who can distinguish sound scientific reasoning from claims that only sound convincing.
Use your energy industry experience to create expert training data and assess AI-generated responses about utility workflows and customer data management. The work draws on hands-on knowledge of utility metering, customer operations, and energy billing systems. Projects are remote and hourly, with flexible scheduling, no minimum hours, and about 5–20 hours per week during active projects. Placement depends on project needs; no prior AI experience is required.
Apply antitrust and competition law expertise to a legal data annotation project supporting AI training. You’ll work with materials on merger reviews, compliance, monopolization, price fixing, and litigation, then help create accurate reference data and guidance. The role seeks US-based legal professionals; prior AI experience is not required.
Help train and assess AI models that handle finance questions. You may write challenging prompts, check responses for accurate calculations and sound reasoning, and catch subtle errors in metrics. The work covers financial modeling, valuation, accounting, corporate finance, and markets.
Apply senior physics expertise to assess how AI models handle research-level reasoning. You will review model answers, write precise problems and reference solutions, and build evaluations in your area of specialization. The role suits an established researcher with a PhD, a strong publication record, hands-on experience with large language models, and a United States base.
Use your retail management experience to create training examples and assess AI-generated answers about store operations. You’ll provide feedback on accuracy and relevance, drawing on practical knowledge of performance reporting, cash reconciliation, and inventory management. The work is remote, project-based, and part-time, with flexible scheduling and no minimum hours. Active projects typically involve 5–20 hours per week, and placement depends on project needs.
As an Employment Lawyer on a project to improve AI legal reasoning, you’ll assess employment law scenarios and review AI-generated analyses, arguments, and documents. Your legal judgment and written feedback will help identify errors and gaps and guide improvements to model outputs. Applicants must be based in the US, hold a U.S. law degree, and have an active bar license.
Create real estate questions and case studies for AI training, then assess model answers against practical standards and regulations. The work draws on an active real estate license and experience in practice, brokerage, or property management. You will also work with real estate and technical specialists to shape challenges that test topics such as valuation, contracts, financing, zoning, and market analysis.
Mercor maintains an ongoing pool of educators for AI training and evaluation projects, rather than hiring for one active opening. Work can include creating teaching problems and reference answers, assessing model-generated lessons and explanations, and spotting content that may confuse learners. Apply with a resume, confirm where you work from, and complete an AI interview of about 20 minutes. Project invitations may arrive within a week or several months.
Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$30–$85/hr
education
teaching
tutoring
Education & TrainingView job
Showing 20 active roles of 636. Dates reflect what the source published, not when AIWorkJobs last synced.
Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.