AIWorkJobs
Braintrust logoOutlierListed on Braintrust

Senior Coding, ML & Security Experts - AI Benchmarking

Create difficult benchmark tasks from your professional experience in coding, machine learning, or cybersecurity. Each task must run in a Linux terminal and challenge advanced AI agents: three leading models get three…

Remote · Eligible in 25 countriesContract
Work arrangement
Remote
Eligibility
Eligible in 25 countries
Engagement
Contract
Compensation
$1,350 fixed
Specialty
AI Training
Experience
5–10 years

About the role

Create difficult benchmark tasks from your professional experience in coding, machine learning, or cybersecurity. Each task must run in a Linux terminal and challenge advanced AI agents: three leading models get three attempts each, and they should fail most attempts. The project should run for the next few weeks. Onboarding requires two courses, a graded assessment of about 90 minutes, and a live webinar before tasking. Pay reaches $1,350 per task, with higher rates possible based on task quality and submission volume; tasks average six to seven hours, and your first tasks may take longer.

What you would do

  • Select difficult, meaningful problems from your area of expertise.
  • Turn each problem into a clearly defined challenge that an AI agent can solve from scratch in a Linux terminal.
  • Design tasks that expose limitations in advanced AI agents.
  • Test each task against three leading models, giving each model three attempts, and confirm that the models fail on most attempts.

Requirements

  • At least 8 years of relevant professional experience in coding, machine learning, or cybersecurity.
  • A completed bachelor's degree or higher; applicants must not currently be enrolled in a degree program.
  • At least one academic or professional publication.
  • Practical comfort working in a Linux terminal.
  • Current residence in Argentina, Mexico, Puerto Rico, New Zealand, Canada, the United Kingdom, the United States, Australia, Peru, Colombia, Austria, Ireland, Spain, Luxembourg, Italy, France, Germany, Belgium, the Netherlands, Sweden, Finland, Singapore, Denmark, Norway, or Switzerland.
  • Complete two onboarding courses and a graded assessment, which take about 90 minutes.
  • Attend a live onboarding webinar before starting task work.

Who should apply

Experienced coding, machine learning, or cybersecurity professionals with at least 8 years in the field, a completed degree, and a publication can apply if they live in an eligible country. The work suits someone comfortable building and testing challenging problems in a Linux terminal.

How applying works on Braintrust

Create a Braintrust profile, complete the AI skills interview, then browse and accept tasks from the dashboard.

  1. Create and complete a Braintrust profile.
  2. Complete the AI skills interview used for expertise and pay-level matching.
  3. Browse the dashboard for available tasks.
  4. Accept a task and complete the work.

Typical timeline: A new member profile takes about 20 minutes.

Paid steps: Not stated by the source

Individual client projects can add their own interview, assessment, or identity check.

Process checked Nov 19, 2026. AIWorkJobs does not submit applications or charge a fee. Read the full Braintrust process and its official source on the Braintrust page.

Skills mentioned by the source

  • coding
  • machine learning
  • cybersecurity
  • linux
  • ai evaluation
  • benchmark design
  • technical writing
  • research
  • problem solving

Specialty areas

Specialties come from the source platform’s category taxonomy and are used to filter the job index.

Listing reference: senior-coding-ml-security-experts-ai-benchmarking-18137. Source: Braintrust. If something here contradicts the source, the source controls. Report a correction.

Related roles

Other work on the index.

See more in this category

Outlier · via Braintrust

Senior Systems & Hardware Experts - AI Benchmarking

Use your systems or hardware engineering experience to create difficult, clearly specified challenges for AI agents to solve in a Linux terminal. The project is task-based and expected to last a few weeks. Tasks average six to seven hours, with early submissions potentially taking longer. Earn up to $1,350 per task, with higher rates possible based on task quality and submission volume. Onboarding requires two courses, a graded assessment of about 90 minutes, and a live webinar.

Location and eligibility
Remote · Eligible in 25 countries
Engagement type
Contract
Compensation
$1,350 fixed
  • systems engineering
  • hardware engineering
  • linux
Hardware & Embedded SystemsView job

Handshake AI

Senior Software Engineer - AI Data (US)

Work with coding agents on real software engineering problems to pinpoint errors in frontier AI models and assess their output. The contract offers 40 hours of work each week, with flexible scheduling and weekly renewal tied to quality standards. The role requires US work authorization, 4+ years of professional software engineering experience, and a computer science or related degree. No AI background is needed.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$150/hr
  • software engineering
  • coding agents
  • code review
Software EngineeringView job

AfterQuery

Advanced Coding Expert

Create realistic, investigation-heavy coding challenges from a substantial private codebase you own. Your tasks will help evaluate and train advanced AI coding agents, so you’ll need to trace changes across large, multi-file projects and build containerized environments with tests that reflect careful engineering review.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$85/hr
  • javascript
  • typescript
  • java
Software EngineeringView job