AIWorkJobs
Mercor logoMercorPlatform listing

Engineering & Software Domain Expert

A senior engineering specialist will help a leading AI lab assess and improve how its models handle real software and engineering work. You will review model outputs, write task instructions and reference solutions…

Hybrid · United States onlyFull-time

This role is no longer active.

This listing is retained for reference. Related current roles are listed below.

Work arrangement
Hybrid
Eligibility
United States only
Engagement
Full-time
Compensation
$65–$105/hr
Specialty
Software Engineering
Weekly commitment
40 hours per week

About the role

A senior engineering specialist will help a leading AI lab assess and improve how its models handle real software and engineering work. You will review model outputs, write task instructions and reference solutions, and create evaluation benchmarks with the research team. The position is full-time W-2 employment through Cincinnatus LLC, based in the Bay Area with on-site work multiple days each week when required.

What you would do

  • Review engineering tasks and model responses for missing behavior, weak reasoning, subtle code errors, unhandled edge cases, and work that would not hold up in a code review.
  • Write clear task specifications and create reference solutions that define correct engineering work.
  • Develop engineering tasks that reflect real-world practice and build challenging evaluation sets.
  • Partner with researchers to develop engineering-specific skills and tools.
  • Align review standards with researchers and specialists in adjacent fields, and turn engineering judgment into clear evaluation criteria.

Requirements

  • Bachelor's degree or higher in computer science, software engineering, or a closely related engineering discipline.
  • At least 4 years of substantive professional engineering experience building and shipping production software or engineered systems at a reputable organization. Internships and coursework alone do not qualify.
  • Deep expertise in at least one area, such as distributed systems and backend infrastructure, security and cryptography, embedded systems and firmware, machine learning systems, developer tooling and platform engineering, or quality and test engineering.
  • Progression to a senior level, such as Senior, Staff, Principal, Architect, or Engineering Lead, with ownership of systems and design decisions.
  • Hands-on professional use of large language models and the ability to distinguish sound reasoning from plausible but incorrect answers.
  • Availability for 40 hours per week during an initial 6-month engagement.
  • Current residence in the Bay Area, California, and ability to work on-site with the client multiple days each week when required. Candidates outside the area must relocate at their own expense before the engagement starts. No relocation assistance is available.
  • Strong written communication and the ability to provide precise, well-structured feedback.

Preferred qualifications

The source marks these as preferred, not required.

  • Master's or PhD in computer science, software engineering, or a closely related engineering discipline.
  • Visible engineering work, such as shipped systems, granted patents, open-source contributions, or published technical work.

Who should apply

Senior engineers with deep expertise in a specific engineering discipline can bring the production experience and technical judgment this role needs. Applicants must live in the Bay Area or relocate there at their own expense, and commit to 40 hours per week for an initial 6 months.

Skills mentioned by the source

  • software engineering
  • computer science
  • distributed systems
  • backend infrastructure
  • security
  • cryptography
  • embedded systems
  • firmware
  • machine learning systems
  • developer tooling
  • platform engineering
  • quality engineering
  • test engineering
  • large language models
  • benchmark design
  • technical writing

Specialty areas

Specialties come from the source platform’s category taxonomy and are used to filter the job index.

Listing reference: engineering-software-domain-expert-BCzY6E. Source: Mercor. If something here contradicts the source, the source controls. Report a correction.

Related roles

Other work on the index.

See more in this category

Mercor

Software Engineer (Foundational)

Build and assess software engineering training material for foundational AI models at a leading AI lab. You will create realistic coding challenges, review model-generated solutions, and help research and engineering teams improve model performance. Cincinnatus LLC employs this part-time role on a W-2 basis and places you with the client team. The listing is for candidates in the United States.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$80–$120/hr
  • python
  • java
  • c++
Software EngineeringView job

SME Careers

C++ Engineer

Review AI-generated C++ code, system designs, and technical explanations, then produce reference implementations and clear reasoning for challenging engineering problems. You will judge correctness, safety, and performance, including issues in concurrency and memory handling. This remote contract role has no immediate project; qualified engineers may be contacted when relevant work becomes available.

Location and eligibility
Remote · Eligible in 17 countries
Engagement type
Contract
Compensation
Up to $65/hr
  • c++
  • modern c++
  • systems programming
Software EngineeringView job

Handshake AI

Electrical Engineering Expert

Use your industry experience in electrical or computer engineering to create realistic engineering problems and assess AI-generated answers. You will judge technical accuracy and practical feasibility, then provide written feedback to support AI research. The work is ongoing, project-based, part-time, and self-scheduled, with no set schedule or minimum hour requirement.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$120/hr
  • electrical engineering
  • computer engineering
  • power systems
EngineeringView job