AIWorkJobs
Turing logoTuringPlatform listing

AI Quality Analyst (Personalization) - Hindi

Evaluate Hindi AI responses using personal context for relevance.

Remote · Eligibility not specifiedContract
Work arrangement
Remote
Eligibility
Eligibility not specified
Engagement
Contract
Compensation
$15/hr
Specialty
AI Training

About the role

Evaluate Gemini’s personalization feature by testing how it uses context from your conversations, Gmail, Google Search, and YouTube activity. You’ll create prompts based on your own experiences, compare model responses, and assess grounding, integration, and helpfulness. The project requires a personal Google account, Hindi fluency, and at least four hours of work per day with four hours of PST overlap.

What you would do

  • Create and run personal-context conversation prompts, typically spanning 1 to 5 turns.
  • Check whether each response follows the intent behind the starting prompt and uses personalization appropriately.
  • Review claims about the user for supporting evidence, flawed inferences, or hallucinations.
  • Assess whether personal details fit naturally into responses without excessive narration.
  • Compare and rank two model responses for helpfulness, ease of use, and enjoyment.
  • Write clear rationales for rankings, citing specific conversation turns and notable strengths or issues.
  • Retrieve and check model debug information to confirm proper use of chat summaries and data sources.
  • Delete evaluation conversations to keep them out of future chat history.
  • Add detailed annotations and constructive feedback.

Requirements

  • Read and write Hindi at a high level.
  • Use your primary personal Google account, rather than a test account, and enable personal data sources.
  • Commit at least 4 hours per day and up to 40 hours per week, with 4 hours of overlap with PST.
  • Have full-time availability in your local time zone for the global, 24-hour operation.
  • Show strong analytical judgment when reviewing nuanced or ambiguous AI responses.
  • Create creative, multi-turn prompts grounded in personal context.
  • Recognize incorrect personalization, weak inferences, and forced connections.
  • Write clear, concise evaluation rationales that refer to specific turn numbers.
  • Hold a BS or BA degree, or equivalent experience in a relevant field such as policy, law, ethics, linguistics, journalism, or computer science.
  • Have a desktop or laptop and a good internet connection.

Preferred qualifications

The source marks these as preferred, not required.

  • Experience in data annotation, AI quality evaluation, content moderation, or a related role.

Who should apply

Candidates with strong Hindi writing and reading skills, careful analytical judgment, and experience creating prompts from personal context may suit this project. Applicants must be comfortable using a primary Google account for evaluation and meeting the daily schedule and PST overlap requirements.

How applying works on Turing

Create a profile, finish any required proctored assessments, then complete screening or a role interview.

  1. Apply through work.turing.com and complete your profile.
  2. Finish the required proctored assessments for the role.
  3. Complete shortlisting, screening, or a technical interview.
  4. Confirm rate, availability, and eligibility before an offer.

Typical timeline: Review takes 48 hours to six weeks after all required steps; consideration replies are usually within 12 hours.

Paid steps: Not stated by the source

Not every role requires tests. Turing does not review an application until required assessments are complete.

Process checked Nov 19, 2026. AIWorkJobs does not submit applications or charge a fee. Read the full Turing process and its official source on the Turing page.

Skills mentioned by the source

  • hindi
  • prompt engineering
  • ai evaluation
  • data annotation
  • content moderation
  • personalization evaluation
  • response ranking
  • side-by-side evaluation
  • grounding analysis
  • conversation analysis
  • debug information review
  • written rationales
  • google account
  • gmail
  • google search
  • youtube

Listing reference: ai-quality-analyst-personalization-hindi-62139. Source: Turing. If something here contradicts the source, the source controls. Report a correction.

Related roles

Other work on the index.

See more in this category

Turing

AI Quality Analyst - English

Evaluate AI personalization quality using your personal experiences and insights.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
Pay not listed
  • ai evaluation
  • personalization evaluation
  • prompt engineering
Quality Assurance & TestingView job

Turing · via Braintrust

AI Evaluator – Education (Experienced Gemini Users)

Help assess and improve AI responses through research, fact-checking, logic analysis, and educational evaluation. The role suits students and working professionals who use the Gemini App for learning. Work remotely from the United States for an expected 16-week project, with a possible extension. Plan for at least 20 hours per week, up to 40 as project needs change, and four hours of overlap with Pacific working hours.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$20/hr
  • gemini app
  • research
  • fact-checking
AI evaluationView job

Mercor

Bilingual Hindi Generalist Expert — AI Safety

Help assess how AI models respond to sensitive topics in Hindi. You’ll write prompts, apply review guidelines, and explain your judgments about risky or adversarial language. The role calls for native or near-native Hindi and business-level written English. No AI or machine learning experience is needed; training covers the workflow. The project starts immediately.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Part-time
Compensation
$18–$22/hr
  • hindi
  • english
  • ai safety
AI evaluationView job

SME Careers

English Language Expert

Review AI-generated English responses or create language examples that show sound reasoning and clear, correct writing. You will judge accuracy, prompt fit, and meaning, then explain edits or compare candidate responses. The work draws on English grammar, discourse analysis, and tools such as ChatGPT, Gemini, and Perplexity. This remote contract role requires at least C1 English proficiency and a relevant bachelor’s degree.

Location and eligibility
Remote · Eligible in 27 countries
Engagement type
Contract
Compensation
Up to $25/hr
  • english
  • copyediting
  • discourse analysis
Language & LinguisticsView job