AIWorkJobs
Braintrust logoOutlierListed on Braintrust

Senior Systems & Hardware Experts - AI Benchmarking

Use your systems or hardware engineering experience to create difficult, clearly specified challenges for AI agents to solve in a Linux terminal. The project is task-based and expected to last a few weeks. Tasks…

Remote · Eligible in 25 countriesContract
Work arrangement
Remote
Eligibility
Eligible in 25 countries
Engagement
Contract
Compensation
$1,350 fixed
Specialty
AI Training
Experience
5–10 years

About the role

Use your systems or hardware engineering experience to create difficult, clearly specified challenges for AI agents to solve in a Linux terminal. The project is task-based and expected to last a few weeks. Tasks average six to seven hours, with early submissions potentially taking longer. Earn up to $1,350 per task, with higher rates possible based on task quality and submission volume. Onboarding requires two courses, a graded assessment of about 90 minutes, and a live webinar.

What you would do

  • Find challenging, meaningful problems in your area of systems or hardware expertise.
  • Turn each problem into a well-defined challenge that an AI agent can solve from scratch in a Linux terminal.
  • Design tasks that test the limits of advanced AI agents.
  • Test each task against three leading models, giving each model three attempts.
  • Confirm that the task proves difficult enough for the models to fail in most attempts.

Requirements

  • At least 9 years of relevant professional experience in systems engineering or hardware engineering.
  • Relevant systems experience may include DevOps, site reliability engineering (SRE), cloud engineering, platform engineering, infrastructure engineering, or distributed systems.
  • Completed bachelor's degree or higher.
  • Degree must be complete, and applicants must not be enrolled in a degree program.
  • At least one academic or professional publication.
  • Practical comfort working in a Linux terminal.
  • Current residence in Argentina, Mexico, Puerto Rico, New Zealand, Canada, the United Kingdom, the United States, Australia, Peru, Colombia, Austria, Ireland, Spain, Luxembourg, Italy, France, Germany, Belgium, the Netherlands, Sweden, Finland, Singapore, Denmark, Norway, or Switzerland.

Who should apply

Systems or hardware engineering professionals with at least 9 years of experience, a completed bachelor's degree or higher, and a publication can apply if they live in an eligible country and feel comfortable working in a Linux terminal.

How applying works on Braintrust

Create a Braintrust profile, complete the AI skills interview, then browse and accept tasks from the dashboard.

  1. Create and complete a Braintrust profile.
  2. Complete the AI skills interview used for expertise and pay-level matching.
  3. Browse the dashboard for available tasks.
  4. Accept a task and complete the work.

Typical timeline: A new member profile takes about 20 minutes.

Paid steps: Not stated by the source

Individual client projects can add their own interview, assessment, or identity check.

Process checked Nov 19, 2026. AIWorkJobs does not submit applications or charge a fee. Read the full Braintrust process and its official source on the Braintrust page.

Skills mentioned by the source

  • systems engineering
  • hardware engineering
  • linux
  • ai evaluation
  • benchmarking
  • devops
  • site reliability engineering
  • cloud engineering
  • platform engineering
  • infrastructure engineering
  • distributed systems
  • research
  • technical writing
  • problem solving

Specialty areas

Specialties come from the source platform’s category taxonomy and are used to filter the job index.

Listing reference: senior-systems-hardware-experts-ai-benchmarking-18138. Source: Braintrust. If something here contradicts the source, the source controls. Report a correction.

Related roles

Other work on the index.

See more in this category

Outlier · via Braintrust

Senior Coding, ML & Security Experts - AI Benchmarking

Create difficult benchmark tasks from your professional experience in coding, machine learning, or cybersecurity. Each task must run in a Linux terminal and challenge advanced AI agents: three leading models get three attempts each, and they should fail most attempts. The project should run for the next few weeks. Onboarding requires two courses, a graded assessment of about 90 minutes, and a live webinar before tasking. Pay reaches $1,350 per task, with higher rates possible based on task quality and submission volume; tasks average six to seven hours, and your first tasks may take longer.

Location and eligibility
Remote · Eligible in 25 countries
Engagement type
Contract
Compensation
$1,350 fixed
  • coding
  • machine learning
  • cybersecurity
Machine Learning & AIView job

Handshake AI

Senior Software Engineer - AI Data (US)

Work with coding agents on real software engineering problems to pinpoint errors in frontier AI models and assess their output. The contract offers 40 hours of work each week, with flexible scheduling and weekly renewal tied to quality standards. The role requires US work authorization, 4+ years of professional software engineering experience, and a computer science or related degree. No AI background is needed.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$150/hr
  • software engineering
  • coding agents
  • code review
Software EngineeringView job

micro1

Hardware Expert

Contribute to AI training projects by creating, solving, and assessing realistic hardware engineering challenges. Work remotely from anywhere, with a flexible schedule of about 15 hours per week, including weekends if you choose. Payment is output-based, at a listed rate of $60–$120 per hour, for tasks that meet project specifications; task time varies. Selected experts must begin their first task within 24–48 hours after onboarding.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$60–$120/hr
  • RTL
  • Hardware
Hardware & Embedded SystemsView job