AIWorkJobs
SME Careers logoSME CareersPlatform listing

Data Scientist Team Lead

As a Data Scientist Quality Assurance Lead, you will review AI-generated data science work and contributor submissions for statistical soundness, code accuracy, reproducibility, and rubric fit. You will guide trainers…

Remote · United States onlyContract
Work arrangement
Remote
Eligibility
United States only
Engagement
Contract
Compensation
Up to $110/hr
Specialty
Data Science & Analytics
Experience
Mid–senior level
Interview language
English

About the role

As a Data Scientist Quality Assurance Lead, you will review AI-generated data science work and contributor submissions for statistical soundness, code accuracy, reproducibility, and rubric fit. You will guide trainers and QAs, resolve technical questions, and maintain calibration and onboarding resources. This remote contract role has no immediate project; qualified experts may be contacted when relevant work becomes available.

What you would do

  • Review data science explanations, modeling workflows, statistical interpretations, experiment designs, dashboards, and code in Python, R, and SQL.
  • Check submissions against project rubrics, flagging data leakage, invalid metrics, weak assumptions, irreproducible code, and misleading conclusions.
  • Sample trainer and QA work, send specific feedback, and escalate repeated or high-impact quality problems.
  • Post guideline and workflow updates for trainers and QAs through Discord, and answer questions about modeling choices, validation, metrics, and rubric interpretation.
  • Contact inactive contributors, track follow-ups, and raise availability concerns.
  • Build and update style guides, FAQs, trackers, examples, honeypots, calibration tasks, and onboarding materials.
  • Lead contributor onboarding and training sessions on project workflows, review standards, and data science expectations.
  • Identify recurring quality gaps and contribute to scalable QA processes.

Requirements

  • Hold a bachelor’s, master’s, or doctoral degree in a quantitative field such as data science, statistics, computer science, mathematics, economics, engineering, or machine learning.
  • Bring at least three years of professional experience in data science, analytics, machine learning, statistical modeling, experimentation, data engineering, technical review, or data science education.
  • Apply probability, statistics, data cleaning, exploratory analysis, feature engineering, supervised and unsupervised learning, regression, classification, clustering, experimentation, and validation methods.
  • Assess technical work against detailed rubrics and identify flawed assumptions, data leakage, incorrect metrics, non-reproducible code, or unsupported conclusions.
  • Communicate in English with teams, follow detailed guidelines, and give clear technical feedback.
  • Use Discord, Google Docs, Google Sheets, trackers, dashboards, GitHub, and project management systems to coordinate work and maintain documentation.

Preferred qualifications

The source marks these as preferred, not required.

  • Experience with Python, pandas, NumPy, scikit-learn, SQL, Jupyter, matplotlib, R, Spark, Git, or MLflow.
  • Experience leading or supporting remote teams of trainers, annotators, analysts, data scientists, engineers, educators, or QA reviewers.
  • Background in AI training, data annotation, LLM evaluation, data science QA, or rubric-based technical review.

Who should apply

Data scientists and quantitative reviewers with at least three years of relevant professional experience can bring the statistical judgment and code-review skills this role needs. Team leads familiar with contributor documentation, calibration, and remote coordination may be a strong fit, especially if they have reviewed AI training or data science QA work.

How applying works on SME Careers

Create an account and submit the listing application with your CV. The official site does not publish the later screening steps.

  1. Sign up with LinkedIn or email.
  2. Open the listing and submit the application with your CV.
  3. Wait for the platform to contact you about any assessment or next step.

Paid steps: Not stated by the source

SME Careers does not publicly document its full screening process. Some roles may add an assessment; confirm with the platform.

Process checked Nov 19, 2026. AIWorkJobs does not submit applications or charge a fee. Read the full SME Careers process and its official source on the SME Careers page.

Skills mentioned by the source

  • data science
  • data science quality assurance
  • llm evaluation
  • machine learning
  • model evaluation
  • python
  • sql
  • statistics
  • probability
  • data cleaning
  • exploratory data analysis
  • feature engineering
  • supervised learning
  • unsupervised learning
  • regression
  • classification

Specialty areas

Specialties come from the source platform’s category taxonomy and are used to filter the job index.

Listing reference: data-scientist-team-lead-L25381. Source: SME Careers. If something here contradicts the source, the source controls. Report a correction.

Related roles

Other work on the index.

See more in this category

SME Careers

R Team Lead

Lead quality checks for R programming and data-analysis work used in AI training projects. You will assess generated code, statistical explanations, charts, and trainer reviews against project rubrics, then give specific feedback and maintain guidance for contributors. The role is a remote contract with no immediate project; qualified experts may be contacted when relevant work becomes available. Selection includes an AI interview, a domain task, and a recruiter interview.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
Up to $65/hr
  • r
  • tidyverse
  • base r
Quality Assurance & TestingView job

Turing

Data Scientist/Analyst

Analyze data and write Python code to enhance AI model performance.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
Pay not listed
  • python
  • data analysis
  • data science
Data Science & AnalyticsView job

Handshake AI

Data Scientist

Use your data science experience on flexible, project-based AI research work. You’ll create realistic problems grounded in modeling and experimentation, assess AI responses for technical accuracy and practical relevance, then write feedback that helps improve model performance. The work has no fixed schedule or minimum hour requirement and can fit alongside your current role. Applicants must live in the United States.

Location and eligibility
Remote · United States only
Engagement type
Part-time
Compensation
$120/hr
  • data science
  • machine learning
  • applied machine learning
Data Science & AnalyticsView job

Ethos

Data Scientist

Review and evaluate data science documents used to train a language model for a foundational AI lab. You’ll assess whether each document’s content and structure match the materials data scientists encounter in their day-to-day work. The role is fully remote and pays $100 per hour; task volume varies, hours are not guaranteed, and most experts work under 10 hours per week. There is no weekly cap on hours or earnings. Start date: ASAP.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Full-time
Compensation
$100/hr
  • data science
  • machine learning
  • python
Data Science & AnalyticsView job