AIWorkJobs
Mercor logoMercorPlatform listing

Behavioral Health Expert, AI Safety and Model Evaluation

Review AI conversations about relationships, family, emotional wellbeing, personal beliefs and difficult decisions. You’ll judge whether responses stay balanced, safe and within the model’s role, then explain your…

Remote · United States onlyPart-time
Work arrangement
Remote
Eligibility
United States only
Engagement
Part-time
Compensation
$45–$70/hr
Specialty
AI Training
Weekly commitment
20 hours per week

About the role

Review AI conversations about relationships, family, emotional wellbeing, personal beliefs and difficult decisions. You’ll judge whether responses stay balanced, safe and within the model’s role, then explain your reasoning and help researchers set evaluation standards. The part-time role requires at least 20 weekday hours per week, with the option to work up to 40. Cincinnatus LLC employs the expert on a W-2 basis and places them with a leading AI lab.

What you would do

  • Assess AI conversations about relationships, family matters, emotional wellbeing, spiritual or metaphysical questions, and unconventional or unfounded beliefs.
  • Identify responses that take sides, agree too readily, reinforce distorted or unfounded beliefs, moralize, or give directive advice beyond the model’s role.
  • Document concerns with clear, specific written reasoning.
  • Create evaluation rubrics, guidelines and reference responses grounded in counseling and behavioral health practice.
  • Design test conversations that examine model responses to sensitive topics that do not involve crises.
  • Coordinate with researchers and other experts to keep evaluation standards consistent, calibrated and well documented.

Requirements

  • A degree in psychology, counseling, social work, behavioral health, behavioral science, human services or a related field, or equivalent professional experience in mental health.
  • At least 3 years of professional experience supporting people in mental health, counseling or social services.
  • Experience may come from roles such as therapist, counselor, clinical social worker, psychologist, psychiatric nurse, case manager, crisis counselor, peer support specialist or mental health advocate.
  • Ability to assess diverse perspectives, relationships, belief systems and worldviews with neutrality and without judgment.
  • Ability to explain the basis for professional judgments.
  • Working familiarity with sycophancy, cognitive distortions, healthy boundaries and client-centered approaches such as motivational interviewing.
  • Availability for at least 20 hours per week on weekdays.
  • Strong written communication and the ability to provide precise, well-structured feedback.

Preferred qualifications

The source marks these as preferred, not required.

  • Clinical licensure such as LMFT, LCSW, LPC, LMHC, PsyD or PhD.
  • Experience in AI safety, applied ethics, trust and safety, or content policy.
  • Experience with couples, family or relationship counseling.
  • Familiarity with spiritual care, religious or alternative belief communities, or the psychology of misinformation and conspiracy beliefs.
  • Experience evaluating, annotating or red teaming AI systems.

Who should apply

Behavioral health professionals with at least 3 years of direct support experience may suit this role, especially those who can assess sensitive conversations without taking sides and explain their judgments in writing. Applicants need weekday availability for at least 20 hours each week.

How applying works on Mercor

Create a profile, complete the role checklist and AI interview, then verify your identity before a project offer.

  1. Create an account and confirm your résumé.
  2. Complete the role checklist, written assessment, and AI interview where the listing requires them.
  3. Submit the application and wait for review or matching.
  4. Complete a work trial and identity verification before onboarding.

Typical timeline: The AI interview is about 20 minutes; work trials are often 4–6 hours; identity checks are usually minutes.

Paid steps: The work trial is paid.

Assessment and interview requirements vary by role. Check the checklist inside the specific listing.

Process checked Nov 19, 2026. AIWorkJobs does not submit applications or charge a fee. Read the full Mercor process and its official source on the Mercor page.

Skills mentioned by the source

  • behavioral health
  • mental health counseling
  • social work
  • motivational interviewing
  • cognitive distortions
  • ai safety
  • ai evaluation
  • red teaming
  • content policy
  • trust and safety

Specialty areas

Specialties come from the source platform’s category taxonomy and are used to filter the job index.

Listing reference: behavioral-health-expert-ai-safety-and-model-evaluation-hLrYa3. Source: Mercor. If something here contradicts the source, the source controls. Report a correction.

Related roles

Other work on the index.

See more in this category

Turing · via Braintrust

Mental Health Clinician - AI Evaluation

Assess AI responses in behavioral health by creating clinical scenarios and judging therapeutic fit, empathy, safety, and clinical reasoning. The six-week remote contract is for US-based clinicians and starts immediately. It requires eight hours of work per day, including four hours of overlap with Pacific Time. The project starts with paid certification hours; clinicians who pass can move into production work.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$30–$42/hr
  • mental health
  • clinical psychology
  • clinical social work
Healthcare & MedicalView job

Mercor

Responsible AI / Security Specialist

Work on AI training data and evaluations for security and responsible AI, creating adversarial tasks, reviewing solutions, and assessing model responses. Cincinnatus LLC employs specialists as W-2 staff and places them with a leading AI lab. The arrangement includes payroll, benefits, and compliance support, with a weekday commitment of at least 20 hours per week.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$90–$140/hr
  • cybersecurity
  • responsible ai
  • red teaming
CybersecurityView job

AfterQuery

Behavioral Economist Expert

Create and assess behavioral economics material that tests how AI models handle decision-making concepts, from cognitive biases and prospect theory to choice architecture and nudge design. You will review model answers against research standards and work with behavioral science and technical specialists to shape challenging, educational content. The role is remote and offers a flexible, asynchronous schedule.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$80/hr
  • behavioral economics
  • behavioral science
  • experimental design
Market Research & InsightsView job

micro1

AI Safety & Evaluation Specialist

Evaluate how personal AI agents handle sensitive information through privacy-focused tests and response reviews. The work centers on spotting improper disclosures and data-protection risks, then recording evidence-based feedback. This is a United States-based, part-time contractor project lasting six weeks. Applicants complete an AI interview; no other assessments are required.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$30–$50/hr
  • privacy risk assessment
  • data protection
  • ai evaluation
Data Science & AnalyticsView job