AIWorkJobs
Turing logoTuringPlatform listing

AI Quality Analyst - English

Evaluate AI personalization quality using your personal experiences and insights.

Remote · Eligibility not specifiedContract
Work arrangement
Remote
Eligibility
Eligibility not specified
Engagement
Contract
Compensation
Pay not listed
Specialty
AI Training

About the role

Assess Gemini’s personalization feature by testing how it draws on information from users’ past conversations and Google activity. You’ll create prompts grounded in your own experiences, judge response quality across grounding, integration, and helpfulness, and explain your comparisons. The role requires use of your primary Google account, at least 4 hours of work each day, and 4 hours of overlap with PST.

What you would do

  • Create and run multi-turn prompts, typically 1 to 5 turns, based on your personal context and experiences.
  • Check whether Gemini’s responses address the intent behind each starting prompt and use personal information appropriately.
  • Identify unsupported claims, flawed inferences, and hallucinations about the user.
  • Assess whether personal details fit the response without excessive narration.
  • Compare and rank two model responses for helpfulness, ease of use, and user experience.
  • Write clear rationales that cite specific conversation turns and explain the strengths or issues behind each ranking.
  • Review model debug information to confirm that chat summaries and data sources were used.
  • Delete evaluation conversations to keep them out of your future chat history.

Requirements

  • Strong English reading and writing skills.
  • Use your primary personal Google account, not a test account, and enable personal data sources for assessment.
  • Availability for at least 4 hours per day and up to 40 hours per week, with 4 hours of overlap with PST.
  • A desktop or laptop with a reliable internet connection.
  • Strong analytical judgment for evaluating nuanced responses and personalization quality.
  • Ability to design creative, multi-turn prompts based on personal context.
  • Ability to identify incorrect personalization, weak inferences, and forced connections.
  • Careful review of side-by-side responses for differences in naturalness and excessive narration.
  • Clear, concise writing for structured evaluation rationales that refer to specific turn numbers.
  • A BS or BA degree, or equivalent experience in a relevant field such as policy, law, ethics, linguistics, journalism, or computer science.

Preferred qualifications

The source marks these as preferred, not required.

  • Experience in data annotation, AI quality evaluation, content moderation, or a related role.

Who should apply

Candidates with strong English writing, careful analytical judgment, and experience creating prompts from personal context may suit this work. Applicants must be comfortable using their primary Google account and meeting the daily hours and PST overlap requirements.

How applying works on Turing

Create a profile, finish any required proctored assessments, then complete screening or a role interview.

  1. Apply through work.turing.com and complete your profile.
  2. Finish the required proctored assessments for the role.
  3. Complete shortlisting, screening, or a technical interview.
  4. Confirm rate, availability, and eligibility before an offer.

Typical timeline: Review takes 48 hours to six weeks after all required steps; consideration replies are usually within 12 hours.

Paid steps: Not stated by the source

Not every role requires tests. Turing does not review an application until required assessments are complete.

Process checked Nov 19, 2026. AIWorkJobs does not submit applications or charge a fee. Read the full Turing process and its official source on the Turing page.

Skills mentioned by the source

  • ai evaluation
  • personalization evaluation
  • prompt engineering
  • data annotation
  • side-by-side evaluation
  • analytical writing
  • gemini
  • gmail
  • google search
  • youtube
  • domain-specific languages

Specialty areas

Specialties come from the source platform’s category taxonomy and are used to filter the job index.

Listing reference: ai-quality-analyst-english-62130. Source: Turing. If something here contradicts the source, the source controls. Report a correction.

Related roles

Other work on the index.

See more in this category

Turing

AI Quality Analyst (Personalization) - German

Evaluate AI personalization by analyzing responses based on your experiences.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$15/hr
  • german
  • ai evaluation
  • data annotation
Quality Assurance & TestingView job

Turing · via Braintrust

AI Evaluator – Education (Experienced Gemini Users)

Help assess and improve AI responses through research, fact-checking, logic analysis, and educational evaluation. The role suits students and working professionals who use the Gemini App for learning. Work remotely from the United States for an expected 16-week project, with a possible extension. Plan for at least 20 hours per week, up to 40 as project needs change, and four hours of overlap with Pacific working hours.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$20/hr
  • gemini app
  • research
  • fact-checking
AI evaluationView job

SME Careers

English Language Expert

Review AI-generated English responses or create language examples that show sound reasoning and clear, correct writing. You will judge accuracy, prompt fit, and meaning, then explain edits or compare candidate responses. The work draws on English grammar, discourse analysis, and tools such as ChatGPT, Gemini, and Perplexity. This remote contract role requires at least C1 English proficiency and a relevant bachelor’s degree.

Location and eligibility
Remote · Eligible in 27 countries
Engagement type
Contract
Compensation
Up to $25/hr
  • english
  • copyediting
  • discourse analysis
Language & LinguisticsView job

micro1

Prompt & Response Evaluator

For about 7.5 hours between November 15 and November 18, you’ll test conversational AI assistants using your personal ChatGPT Free or Plus account. You’ll try everyday scenarios, compare the experiences, and submit ratings with brief written feedback. You’ll need a computer or smartphone and availability during the project window; the role is remote and open globally, with English required.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$40–$70/hr
  • ChatGPT
  • AI agents
  • Attention to Detail
AI evaluationView job