AIWorkJobs
Braintrust logoTuringListed on Braintrust

Emergency Medicine Physician - AI Evaluation

Use your emergency medicine expertise on a 12-week remote contract evaluating AI systems. You’ll build clinical cases and scoring rubrics, assess model responses, and help set defensible standards for emergency…

Remote · United States onlyContract
Work arrangement
Remote
Eligibility
United States only
Engagement
Contract
Compensation
$135/hr
Specialty
AI Training
Experience
5–10 years

About the role

Use your emergency medicine expertise on a 12-week remote contract evaluating AI systems. You’ll build clinical cases and scoring rubrics, assess model responses, and help set defensible standards for emergency decision-making and patient safety. The project targets a November 2, 2026 start and offers 20 or 40 hours per week, with four hours of overlap with Pacific working hours. Selection includes an application review and assessment.

What you would do

  • Create challenging clinical tasks, longitudinal chart scenarios, reference answers, and evaluation rubrics for emergency decision-making, patient safety, and emergency-care or EMS handoffs.
  • Synthesize fragmented records and identify contradictions, missing actions, and gaps in clinical reasoning or documentation.
  • Assess model responses for clinical reasoning, documentation quality, and patient safety.
  • Apply structured rubrics, review specialist feedback, and refine cases during calibration cycles.
  • Review and calibrate contributor work, resolve ambiguous clinical or rubric questions, and maintain consistent quality standards.

Requirements

  • At least 8 years of relevant professional experience.
  • Current emergency medicine practice or practice within the last three years.
  • An active physician license and board certification or a recognized credential appropriate to emergency medicine.
  • A relevant healthcare degree or equivalent practical experience.
  • Strong clinical reasoning, chart-review, documentation, and written communication skills.
  • Ability to reach defensible clinical conclusions with attention to patient safety.
  • Ability to follow standardized rubrics, incorporate critique, and work through fast-paced review and calibration cycles.
  • Based in the United States and able to overlap with Pacific working hours for four hours.
  • Availability for 20 hours per week part-time or 40 hours per week full-time during the 12-week project.

Preferred qualifications

The source marks these as preferred, not required.

  • Familiarity with US clinical guidelines, payer policies, regulatory requirements, and healthcare workflows.
  • Experience with AI evaluation, clinical content or assessment development, expert review, or quality improvement.

Who should apply

Emergency medicine physicians with at least 8 years of relevant experience and current or recent practice will bring the right clinical foundation. US-based applicants should hold an active license and an appropriate board certification or recognized credential, and be available for the project’s Pacific-hours overlap.

How applying works on Braintrust

Create a Braintrust profile, complete the AI skills interview, then browse and accept tasks from the dashboard.

  1. Create and complete a Braintrust profile.
  2. Complete the AI skills interview used for expertise and pay-level matching.
  3. Browse the dashboard for available tasks.
  4. Accept a task and complete the work.

Typical timeline: A new member profile takes about 20 minutes.

Paid steps: Not stated by the source

Individual client projects can add their own interview, assessment, or identity check.

Process checked Nov 19, 2026. AIWorkJobs does not submit applications or charge a fee. Read the full Braintrust process and its official source on the Braintrust page.

Skills mentioned by the source

  • emergency medicine
  • clinical decision-making
  • clinical case development
  • longitudinal chart review
  • clinical documentation
  • patient safety
  • ems handoffs
  • evaluation rubrics
  • ai evaluation
  • healthcare workflows

Specialty areas

Specialties come from the source platform’s category taxonomy and are used to filter the job index.

Listing reference: emergency-medicine-physician-ai-evaluation-18113. Source: Braintrust. If something here contradicts the source, the source controls. Report a correction.

Related roles

Other work on the index.

See more in this category

micro1

Emergency Medicine Physician

An Emergency Medicine Physician will review clinical material for an AI training project, drawing on hands-on emergency care experience to assess scenarios and AI-generated responses. The work calls for sound clinical judgment, careful evaluation of medical information, and clear explanations of findings. The engagement is remote, part-time, and project-based, with a short AI interview as part of the application process.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
Pay not listed
  • emergency medicine
  • acute care assessment
  • clinical decision-making
Healthcare & MedicalView job

Turing

Emergency Medicine Physician (MD/DO)

Evaluate AI responses for accuracy in emergency medicine scenarios.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
Pay not listed
  • emergency medicine
  • acute care
  • trauma management
Healthcare & MedicalView job

Mercor

General Physician

Assess health AI responses across diagnosis, clinical reasoning, and care workflows in a six-week project with a leading AI lab. You’ll judge clinical accuracy and safety, document clear feedback, and flag risks to patient care. Applicants must hold an active, unrestricted US medical license, have completed residency, and see patients in practice. The commitment is part-time, at least 20 hours per week.

Location and eligibility
Remote · United States only
Engagement type
Hourly
Compensation
$150/hr
  • clinical evaluation
  • clinical reasoning
  • diagnosis
Healthcare & MedicalView job

Turing · via Braintrust

Clinical Pharmacist - AI Evaluation

Create clinical pharmacy cases and evaluation standards for AI systems, then assess model responses for sound reasoning, documentation quality, and patient safety. The remote contract runs for 12 weeks, targets a November 2, 2026 start, and is open to US-based professionals. Choose 20 or 40 hours per week, with four hours of overlap with Pacific working hours. Selection includes an application review and assessment.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$38/hr
  • clinical pharmacy
  • medication reconciliation
  • medication safety
AI evaluationView job