AIWorkJobs
Braintrust logoToloka AI B.V.Listed on Braintrust

Licensed Physicians - Medical Content Reviewer

Review clinical EHR vignettes for a project-based medical AI evaluation program, with a focus on general and internal medicine. During active project phases, expect an estimated 10–20 hours of work per week; actual…

On-site · United States onlyContract
Work arrangement
On-site
Eligibility
United States only
Engagement
Contract
Compensation
$100/hr
Specialty
Healthcare & Medical
Experience
5–10 years

About the role

Review clinical EHR vignettes for a project-based medical AI evaluation program, with a focus on general and internal medicine. During active project phases, expect an estimated 10–20 hours of work per week; actual workload depends on project needs. Submit your CV in English and state your English proficiency level. The work is not permanent employment.

What you would do

  • Assess diagnosis and treatment vignettes across cardiovascular, nervous, hematologic, respiratory, digestive, urinary, reproductive, musculoskeletal, and integumentary systems.
  • Rate vignette accuracy and completeness, including whether the clinical details reveal the answer.
  • Check answer correctness and whether each answer supports consistent grading.
  • Evaluate the quality of distractor or trap answers.
  • Determine whether each reasoning chain reaches its conclusion using only the facts in the vignette.
  • Correct reasoning traces and write short rationales.
  • Complete independent blind reads before physician adjudication.
  • Submit work by the stated deadlines and meet each project's acceptance criteria.

Requirements

  • Hold an MD or DO degree.
  • Maintain an active, unrestricted US medical license, verified with the issuing medical board.
  • Be based in an eligible US state: Alabama, Alaska, Arizona, Florida, Georgia, Idaho, Iowa, Kentucky, Louisiana, Michigan, Minnesota, Mississippi, Missouri, Montana, New York, North Carolina, North Dakota, Ohio, Oklahoma, Oregon, Pennsylvania, Rhode Island, South Carolina, South Dakota, Utah, Virginia, West Virginia, Wisconsin, or Wyoming. A license from any US state qualifies, but your residence must be in an eligible state.
  • Hold board certification or have completed residency training.
  • Have recent direct patient care experience; attending-level experience is preferred.
  • Bring broad diagnostic and treatment experience in internal, family, emergency, or hospital medicine.
  • Apply strong clinical reasoning to differential diagnoses, next-step management, and evidence-based guidelines.
  • Demonstrate written English at C1 level or higher.
  • Be available for an estimated 10–20 hours per week during active project phases.

Preferred qualifications

The source marks these as preferred, not required.

  • Attending-level clinical experience.
  • Prior work in medical AI evaluation, clinical content or exam-question review, or medical annotation and quality assurance.

Who should apply

Practicing US physicians with an MD or DO, an active unrestricted license, recent patient care, and broad diagnostic experience may fit this project. The work suits physicians based in an eligible state who can take on part-time project work; it is not open to students, unlicensed graduates, non-physician clinicians, or non-clinical healthcare professionals.

How applying works on Braintrust

Create a Braintrust profile, complete the AI skills interview, then browse and accept tasks from the dashboard.

  1. Create and complete a Braintrust profile.
  2. Complete the AI skills interview used for expertise and pay-level matching.
  3. Browse the dashboard for available tasks.
  4. Accept a task and complete the work.

Typical timeline: A new member profile takes about 20 minutes.

Paid steps: Not stated by the source

Individual client projects can add their own interview, assessment, or identity check.

Process checked Nov 19, 2026. AIWorkJobs does not submit applications or charge a fee. Read the full Braintrust process and its official source on the Braintrust page.

Skills mentioned by the source

  • medicine
  • clinical reasoning
  • differential diagnosis
  • diagnosis
  • treatment planning
  • evidence-based medicine
  • electronic health records
  • medical content review
  • medical ai evaluation
  • clinical annotation
  • quality assurance

Specialty areas

Specialties come from the source platform’s category taxonomy and are used to filter the job index.

Listing reference: licensed-physicians-medical-content-reviewer-17980. Source: Braintrust. If something here contradicts the source, the source controls. Report a correction.

Related roles

Other work on the index.

See more in this category

Mercor

General Physician

Assess health AI responses across diagnosis, clinical reasoning, and care workflows in a six-week project with a leading AI lab. You’ll judge clinical accuracy and safety, document clear feedback, and flag risks to patient care. Applicants must hold an active, unrestricted US medical license, have completed residency, and see patients in practice. The commitment is part-time, at least 20 hours per week.

Location and eligibility
Remote · United States only
Engagement type
Hourly
Compensation
$150/hr
  • clinical evaluation
  • clinical reasoning
  • diagnosis
Healthcare & MedicalView job

SME Careers

Medical General Expert

Review AI-generated medical responses or create healthcare content that demonstrates sound clinical reasoning. You will check evidence, test interpretation, timelines, dosing logic, and care-setting choices, then explain errors and compare answers with clear written feedback. This remote, hourly contract has no immediate project; qualified experts may hear about future work through the network.

Location and eligibility
Remote · Eligible in 17 countries
Engagement type
Contract
Compensation
Up to $90/hr
  • clinical reasoning
  • differential diagnosis
  • risk stratification
Healthcare & MedicalView job

Handshake AI

Physicians

Physicians use clinical expertise to create challenging medical tasks and assess AI-generated responses for accuracy, patient safety, and consistency with current practice and guidelines. The work spans acute care, medicine, and surgery. Projects open throughout the year, and contributors can work remotely on a flexible, part-time basis alongside another role, with no set schedule or minimum hours.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$180/hr
  • clinical medicine
  • acute care
  • stroke neurology
Healthcare & MedicalView job

AfterQuery

Psychiatrist Expert (Clinical Review)

Join a three-week review project starting this month, assessing AI responses to psychiatric cases. You will evaluate diagnostic accuracy, treatment reasoning, medication considerations, and risk handling, then explain what a psychiatrist should do instead. Some contributors may also create clinical vignettes and reference responses. The work is remote and asynchronous, with no fixed hours.

Location and eligibility
Remote · United States only
Engagement type
Not specified
Compensation
$125/hr
  • psychiatry
  • clinical review
  • diagnostic reasoning
Healthcare & MedicalView job