AIWorkJobs
SME Careers logoSME CareersPlatform listing

Red-Teaming Quality Assurance Lead (QAL)

Review adversarial prompts, model responses, risk analyses, and safety evaluations against project rubrics. You will identify weak scenarios, policy errors, unsafe outputs, and gaps in vulnerability testing, then guide…

Remote · United States onlyContract
Work arrangement
Remote
Eligibility
United States only
Engagement
Contract
Compensation
Up to $100/hr
Specialty
Quality Assurance & Testing
Experience
Mid–senior level
Interview language
English

About the role

Review adversarial prompts, model responses, risk analyses, and safety evaluations against project rubrics. You will identify weak scenarios, policy errors, unsafe outputs, and gaps in vulnerability testing, then guide trainers and QAs through feedback, onboarding, and documentation. The work uses Discord, Google Sheets, and Google Docs. No project is available immediately; qualified experts may be contacted for future work.

What you would do

  • Sample red-team submissions and give contributors specific feedback on quality problems; escalate repeated or serious concerns.
  • Assess prompts, model responses, risk labels, safety analyses, policy rationales, and vulnerability reports for accuracy and realism.
  • Alert trainers and QAs in Discord to changes in guidelines, project workflows, and review expectations.
  • Answer contributor questions about risk categories, adversarial approaches, policy boundaries, severity, and rubric interpretation.
  • Contact inactive contributors, record follow-ups, and report availability concerns.
  • Build and update style guides, FAQs, trackers, quality examples, calibration tasks, and onboarding resources in Google Docs and Google Sheets.
  • Lead onboarding and training calls that explain rubrics, workflows, and red-teaming review standards.
  • Check that trainers and QAs apply safety and red-team guidance consistently as project requirements change.
  • Flag unsafe, unrealistic, poorly documented, or policy-inconsistent submissions.
  • Identify recurring quality gaps and recommend changes to red-team QA workflows.

Requirements

  • Bring a degree or professional background in a relevant area such as computer science, cybersecurity, AI safety, trust and safety, public policy, psychology, linguistics, law, security studies, or risk analysis.
  • Have at least three years of experience in a related field, such as AI safety, red-teaming, cybersecurity, model evaluation, content policy, risk analysis, or content moderation.
  • Communicate in English with enough precision to interpret project instructions and write useful feedback.
  • Understand AI risk categories, adversarial prompting, jailbreaks, harmful-content taxonomies, misuse scenarios, policy interpretation, model behavior, and safety evaluation.
  • Apply detailed rubrics to identify weak adversarial design, implausible scenarios, inaccurate risk labels, policy errors, unsafe outputs, and shallow vulnerability tests.
  • Maintain organized project materials such as style guides, trackers, FAQs, calibration exercises, onboarding resources, and documentation.
  • Work with remote project tools such as Discord, Google Sheets, Google Docs, trackers, dashboards, and project management systems.

Preferred qualifications

The source marks these as preferred, not required.

  • Experience with prompt injection, social engineering, cybersecurity abuse, fraud, self-harm safety, extremist content, misinformation, privacy risks, illicit behavior, bias, or model refusal behavior.
  • Experience leading or supporting remote teams of red-teamers, reviewers, policy analysts, annotators, researchers, or QA staff.
  • Background in AI training, LLM evaluation, safety evaluation, content moderation QA, policy QA, or rubric-based review.

Who should apply

Red-team, AI safety, cybersecurity, and trust-and-safety professionals with at least three years of relevant experience should apply. Candidates who can assess adversarial work against detailed rubrics and guide remote contributors through clear feedback will fit the role's core work.

How applying works on SME Careers

Create an account and submit the listing application with your CV. The official site does not publish the later screening steps.

  1. Sign up with LinkedIn or email.
  2. Open the listing and submit the application with your CV.
  3. Wait for the platform to contact you about any assessment or next step.

Paid steps: Not stated by the source

SME Careers does not publicly document its full screening process. Some roles may add an assessment; confirm with the platform.

Process checked Nov 19, 2026. AIWorkJobs does not submit applications or charge a fee. Read the full SME Careers process and its official source on the SME Careers page.

Skills mentioned by the source

  • ai red-teaming
  • ai safety
  • llm evaluation
  • adversarial testing
  • prompt engineering
  • jailbreak testing
  • policy evaluation
  • risk assessment
  • safety taxonomies
  • trust and safety
  • quality assurance
  • rubric-based review
  • content moderation
  • trainer feedback
  • google sheets
  • google docs

Specialty areas

Specialties come from the source platform’s category taxonomy and are used to filter the job index.

Listing reference: red-teaming-quality-assurance-lead-qal-L26402. Source: SME Careers. If something here contradicts the source, the source controls. Report a correction.

Related roles

Other work on the index.

See more in this category

SME Careers

English Quality Assurance Lead (QAL)

Guide English quality across AI training projects by reviewing contributor work and generated content against project rubrics. You will spot-check submissions for accuracy, clarity, tone, grammar, formatting, and instruction-following, then share actionable feedback through Discord and maintain guidance in Google Docs and Google Sheets. The role also covers onboarding, contributor follow-ups, and consistent application of changing guidelines across remote teams.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Up to $35/hr
  • english grammar
  • english quality assurance
  • content review
Quality Assurance & TestingView job

micro1

AI Jailbreak & Prompt-Injection Security Expert

Work on an AI safety initiative by testing models for ethical jailbreaks, prompt injection, and tool-use abuse. You’ll develop adversarial evaluation methods, probe multi-turn weaknesses, maintain regression tests, and share findings with technical and non-technical audiences. AI experience is not required; relevant domain knowledge matters.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$50–$90/hr
  • Ethical Jailbreaks
  • LLM Red Teaming
  • Prompt Injection
Machine Learning & AIView job

SME Careers

Legal Quality Assurance Lead (QAL)

Lead quality checks for legal AI training work by reviewing model responses and contributor submissions against project rubrics. You will guide trainers and QAs, flag legal reasoning and safety issues, and maintain resources such as calibration tasks and style guides. This remote contract has no immediate project; qualified candidates may be contacted when relevant work becomes available. Selection includes an AI interview, a domain task, and a recruiter interview.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Up to $120/hr
  • legal quality assurance
  • legal reasoning
  • legal research
Quality Assurance & TestingView job

SME Careers

Medical Quality Assurance Lead (QAL)

Lead medical quality reviews across AI training projects by checking clinical content and contributor work against project rubrics. You will flag patient-safety risks, give trainers and QAs actionable feedback, and maintain review guidance and calibration materials. The role uses LLM evaluation, Discord, and Google Sheets. No project is active now; qualified experts may be contacted for future work. Selection includes an AI interview, a domain task, and a recruiter interview.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Up to $95/hr
  • medical quality assurance
  • medical review
  • clinical reasoning
Quality Assurance & TestingView job