AIWorkJobs
Micro1 logomicro1Platform listing

Member of Technical Staff, Cortex Lab (applied AI research)

Develop and assess LLM-powered agents and AI systems used in enterprise workflows. The role combines applied research with hands-on engineering: you will design evaluations, investigate failures, run experiments, and…

Remote · Eligibility not specifiedFull-time
Work arrangement
Remote
Eligibility
Eligibility not specified
Engagement
Full-time
Compensation
$100–$130/hr
Specialty
Machine Learning & AI

About the role

Develop and assess LLM-powered agents and AI systems used in enterprise workflows. The role combines applied research with hands-on engineering: you will design evaluations, investigate failures, run experiments, and help improve system performance. You will also build research tools and infrastructure while working with researchers, engineers, domain experts, and enterprise customers.

What you would do

  • Create evaluation frameworks, benchmarks, and datasets for LLM agents and complex AI workflows.
  • Find, assess, and prioritize failures in models, agents, and production workflows.
  • Run experiments to test hypotheses, measure performance, and improve agent reliability and effectiveness.
  • Work with enterprise customers and researchers to evaluate, deploy, and improve AI systems in production workflows.
  • Prepare training and evaluation data, task specifications, and feedback methods to improve system performance.
  • Build Python evaluation pipelines, experiment tools, and lightweight research infrastructure.
  • Set evaluation strategies and improvement plans with researchers, domain experts, and customer stakeholders.
  • Write technical reports and share benchmarks and research findings that guide future system improvements.

Requirements

  • Background in applied AI research, research engineering, machine learning, or LLM-based systems.
  • Practical experience designing and implementing evaluations for agents, including tool use, multi-step workflows, and task completion.
  • Strong Python skills and experience building evaluation pipelines, experiment tools, or ML infrastructure.
  • Experience creating benchmarks, datasets, evaluation metrics, and experimental methods for AI systems.
  • Ability to investigate agent failures, identify root causes, and turn findings into measurable improvements.
  • Understanding of LLM behavior and agentic architectures, including reliability, robustness, and generalization challenges.
  • Ability to turn ambiguous real-world problems into structured experiments and actionable technical solutions.
  • Strong communication and collaboration skills for working across research, engineering, and customer teams.

Preferred qualifications

The source marks these as preferred, not required.

  • Experience assessing or improving AI agents in production or enterprise settings.
  • Familiarity with reinforcement learning, reward modeling, or post-training methods.
  • Experience creating research infrastructure, evaluation tools, or automated experimentation frameworks.
  • Previous work at a frontier AI lab or in applied AI research.
  • Contributions to research publications, open-source benchmarks, or AI evaluation frameworks.
  • Experience working directly with enterprise customers or technical stakeholders.

Who should apply

Candidates with applied AI or research engineering experience and a track record in agent evaluation will find a close match here. Strong Python skills and the ability to turn failures in LLM systems into measurable improvements are central to the role.

How applying works on Micro1

Apply through the opportunities portal, complete an AI interview, verify your identity, and join the certified talent pool.

  1. Apply through the opportunities portal or accept a platform invitation.
  2. Complete the AI interview covering communication, reasoning, and role skills.
  3. Verify your government ID and sign the platform contract.
  4. Join the certified talent pool and wait for project matching.

Typical timeline: Micro1 does not publish a fixed interview length. Certification is typically reviewed within 30 days.

Paid steps: Not stated by the source

Certification does not guarantee a project placement.

Process checked Nov 19, 2026. AIWorkJobs does not submit applications or charge a fee. Read the full Micro1 process and its official source on the Micro1 page.

Skills mentioned by the source

  • AI Agent Evaluation & Benchmark Design
  • Python & Research Engineering
  • Agent Failure Analysis & Experimentation
  • LLM & Agentic Systems

Specialty areas

Specialties come from the source platform’s category taxonomy and are used to filter the job index.

Listing reference: member-of-technical-staff-cortex-lab-applied-ai-research-2038a3. Source: Micro1. If something here contradicts the source, the source controls. Report a correction.

Related roles

Other work on the index.

See more in this category

micro1

Member of Technical Staff, Realm Lab (frontier AI research)

Realm Lab needs a Member of Technical Staff to evaluate and improve frontier AI systems. You’ll work across machine learning, data research, and evaluation engineering, building benchmarks, reinforcement learning environments, and datasets. The role calls for hands-on experience with LLM evaluation, Python, and experimental methods, plus the ability to turn real-world workflows into structured tests of model capabilities.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Full-time
Compensation
$100–$130/hr
  • LLM Evaluation & Benchmark Design
  • Python & ML Engineering
  • Reinforcement Learning & Agentic Systems
Machine Learning & AIView job

Turing

Senior Software Engineer – LLM Evaluation

Evaluate and refine AI-generated code for efficiency and reliability.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
Pay not listed
  • python
  • javascript
  • reactjs
Machine Learning & AIView job

Mercor

Applied Engineer, Evaluations Role

Build and refine software engineering evaluations from completed pull requests, using Mercor’s in-house framework to assess frontier coding agents such as Claude Code and Codex. You’ll work with an internal research team whose benchmarks compare frontier large language models, then take ownership of evaluation selection, development, and refinement after onboarding.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$100–$120/hr
  • typescript
  • javascript
  • python
Machine Learning & AIView job

micro1

Member of Technical Staff, Coding Agent Research & Evaluations

Shape how frontier coding agents are tested and improved. You will create evaluation methods, datasets, and tools, then study model performance across software engineering tasks. The work combines Python and software engineering, LLM and agent systems, benchmark design, and model failure analysis. You will also share research findings with technical and client audiences.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Full-time
Compensation
$8–$9/hr
  • Coding Agent Evaluation & Benchmark Design
  • Software Engineering & Python
  • LLM & Agentic Systems
Machine Learning & AIView job