AIWorkJobs
AfterQuery logoAfterQueryPlatform listing

Product Analytics and Experimentation Expert

Create product analytics challenges based on decisions you handle on a product team, then write reference solutions with clear reasoning. AI labs use these problems to assess model judgment. The work runs…

Remote · Eligibility not specifiedNot specified
Work arrangement
Remote
Eligibility
Eligibility not specified
Engagement
Not specified
Compensation
$115/hr

About the role

Create product analytics challenges based on decisions you handle on a product team, then write reference solutions with clear reasoning. AI labs use these problems to assess model judgment. The work runs asynchronously, with no set schedule, and requires at least 10 hours each week. You can adjust your hours from week to week, with no stated maximum.

What you would do

  • Write realistic problems about product experiments and A/B test decisions.
  • Develop challenges around product metrics, retention, and growth.
  • Solve each problem and document the reasoning behind every step in a reference answer.
  • Identify plausible analysis errors that require hands-on product analytics experience to recognize.

Requirements

  • At least 3 years of full-time experience as a data scientist or product analyst on a product team; internships and school experience do not count.
  • Hands-on experience designing or analyzing A/B tests.
  • Strong SQL and Python skills, plus applied statistics knowledge.
  • Availability for at least 10 hours of work per week.
  • Strong written English and the ability to explain analyses clearly.

Preferred qualifications

The source marks these as preferred, not required.

  • Master’s degree in a quantitative field.
  • Experience defining product metrics or modeling retention and lifetime value.

Who should apply

Data scientists and product analysts with at least three years of full-time product-team experience should consider the role. Candidates need hands-on A/B testing experience, strong SQL, Python, and applied statistics, and at least 10 hours per week to contribute.

How applying works on AfterQuery

Create an account, complete an interview and a domain assessment, then get matched to a project.

  1. Create an account and submit the short application.
  2. Complete a live or asynchronous video interview.
  3. Pass a short domain skills assessment.
  4. Get matched to a project and begin work.

Paid steps: Not stated by the source

Assessment requirements and payment setup can vary by project.

Process checked Nov 19, 2026. AIWorkJobs does not submit applications or charge a fee. Read the full AfterQuery process and its official source on the AfterQuery page.

Skills mentioned by the source

  • product analytics
  • a/b testing
  • experimentation
  • sql
  • python
  • applied statistics
  • product metrics
  • retention modeling
  • lifetime value modeling

Listing reference: product-analytics-and-experimentation-expert-023703. Source: AfterQuery. If something here contradicts the source, the source controls. Report a correction.

Related roles

Other work on the index.

See more in this category

Confidential employer · via Braintrust

Plant Reliability Expert - AI Training

Apply hands-on industrial process plant experience to assess a simulated facility, its synthetic sensor data, and proposed fault and maintenance scenarios. You’ll judge whether equipment behavior and operating conditions match real plant operations, examine evidence behind diagnoses, and give specific feedback on maintenance decisions, costs, and downtime tradeoffs.

Location and eligibility
Remote · Eligible in 26 countries
Engagement type
Contract
Compensation
$75–$90/hr
  • reliability engineering
  • mechanical engineering
  • condition monitoring
Energy & Power GenerationView job

micro1

Professional Photographer – Sony A1 II

Photographers with access to a Sony Alpha 1 II and an approved lens can take part in a remote, project-based photography assignment supporting AI development. You will photograph objects across indoor, outdoor, urban, and rural or natural settings, then submit a package of 20 unedited RAW images that meets the project's exact capture instructions. The project pays $500 once the client accepts the complete submission.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
Pay not listed
  • sony alpha 1 ii operation
  • digital photography
  • photo editing
AI trainingView job

SME Careers

Spanish Language Expert

Review and assess AI-generated Spanish content for accuracy, reasoning, and fit with Spain’s language conventions. You will compare model responses, check localized details against reliable sources, and write examples or explanations that show sound language choices. The work draws on MQM/LQA, CAT-tool workflows, and at least C1 English reading and writing. Only candidates based in Spain can apply.

Location and eligibility
Remote · Mexico, Spain, United States
Engagement type
Contract
Compensation
Up to $35/hr
  • spanish
  • english
  • localization
Language & LinguisticsView job

Mercor

CMC, Manufacturing & Quality Expert

Bring pharmaceutical or biotech expertise to AI training work focused on CMC, GMP manufacturing, and quality systems. You’ll create and assess technical examples, then give research and engineering teams feedback that can improve model performance. The role requires a 40-hour weekday commitment and offers W-2 employment through Cincinnatus LLC, with placement on a leading AI lab’s team.

Location and eligibility
Remote · United States only
Engagement type
Full-time
Compensation
$70–$100/hr
  • chemistry, manufacturing, and controls
  • gmp manufacturing
  • process development
Quality Control & InspectionView job