AIWorkJobs
Turing logoTuringPlatform listing

AI Quality Analyst (Personalization) - Russian

Evaluate personalized AI responses in Russian for relevance and grounding.

Remote · Eligibility not specifiedContract
Work arrangement
Remote
Eligibility
Eligibility not specified
Engagement
Contract
Compensation
$15/hr
Specialty
AI Training

About the role

Evaluate Gemini’s personalization feature in Russian by testing how it draws on your past conversations, Gmail, Google Search, and YouTube activity. You’ll create prompts based on your own experiences, compare model responses, and judge their grounding, integration, and helpfulness. The project requires a personal Google account with data sources enabled and at least four hours of work each day.

What you would do

  • Create and run multi-turn prompts, typically one to five turns, that test how Gemini uses personal context.
  • Judge whether each response addresses the intent behind the starting prompt and uses personalization well.
  • Check claims about the user for evidence, flawed inferences, and hallucinations.
  • Assess whether personal details fit naturally into responses or lead to robotic overnarration.
  • Rank two model responses side by side for helpfulness, ease of use, and enjoyment.
  • Write comparison rationales that cite specific conversation turns and explain strengths or issues.
  • Review model debug information to verify the use of chat summaries and data sources.
  • Delete evaluation conversations to keep them out of future chat history.

Requirements

  • Read and write Russian at a high level.
  • Use your primary personal Google account, not a testing account, and enable personal data sources.
  • Commit to at least four hours per day and up to 40 hours per week, with four hours of overlap with PST.
  • Bring strong analytical judgment to nuanced or ambiguous responses and assess personalization quality.
  • Design creative, multi-turn prompts grounded in personal context.
  • Identify incorrect personalization, weak inferences, and forced connections.
  • Compare side-by-side responses for naturalness and overnarration, and write concise, structured rationales that cite turn numbers.
  • Hold a BS or BA degree, or have equivalent experience in a relevant field such as policy, law, ethics, linguistics, journalism, or computer science.
  • Provide constructive feedback and detailed annotations; work independently in a remote setting.
  • Have a desktop or laptop and a good internet connection.

Preferred qualifications

The source marks these as preferred, not required.

  • Experience in data annotation, AI quality evaluation, content moderation, or a related role.

Who should apply

Candidates with strong Russian reading and writing skills, sound analytical judgment, and experience crafting prompts from personal context should consider this project. Applicants must be comfortable using a personal Google account with data sources enabled and meet the daily hours and PST overlap requirements.

How applying works on Turing

Create a profile, finish any required proctored assessments, then complete screening or a role interview.

  1. Apply through work.turing.com and complete your profile.
  2. Finish the required proctored assessments for the role.
  3. Complete shortlisting, screening, or a technical interview.
  4. Confirm rate, availability, and eligibility before an offer.

Typical timeline: Review takes 48 hours to six weeks after all required steps; consideration replies are usually within 12 hours.

Paid steps: Not stated by the source

Not every role requires tests. Turing does not review an application until required assessments are complete.

Process checked Nov 19, 2026. AIWorkJobs does not submit applications or charge a fee. Read the full Turing process and its official source on the Turing page.

Skills mentioned by the source

  • russian
  • ai evaluation
  • data annotation
  • prompt engineering
  • personalization
  • side-by-side evaluation
  • content moderation
  • google gemini
  • gmail
  • google search
  • youtube
  • domain-specific languages

Listing reference: ai-quality-analyst-personalization-russian-62142. Source: Turing. If something here contradicts the source, the source controls. Report a correction.

Related roles

Other work on the index.

See more in this category

Turing

AI Quality Analyst (Personalization) - Polish

Evaluate AI personalization effectiveness using your own experiences and data.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$20/hr
  • polish
  • gemini
  • prompt engineering
AI evaluationView job

Turing · via Braintrust

AI Evaluator – Education (Experienced Gemini Users)

Help assess and improve AI responses through research, fact-checking, logic analysis, and educational evaluation. The role suits students and working professionals who use the Gemini App for learning. Work remotely from the United States for an expected 16-week project, with a possible extension. Plan for at least 20 hours per week, up to 40 as project needs change, and four hours of overlap with Pacific working hours.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$20/hr
  • gemini app
  • research
  • fact-checking
AI evaluationView job

SME Careers

Russian Language Expert

Review Russian-language AI content and create reference answers that show accurate grammar, natural phrasing, and appropriate cultural context. You will compare model responses, explain language and reasoning issues in English, and check claims when needed. The remote contract role requires native or near-native Russian, English at C1 or above, and at least three years of relevant language-focused experience.

Location and eligibility
Remote · Kazakhstan only
Engagement type
Contract
Compensation
Up to $25/hr
  • russian
  • english
  • copyediting
Language & LinguisticsView job

micro1

Prompt & Response Evaluator

Compare different AI assistant experiences through everyday conversations and rate their quality, clarity, tone, helpfulness, and overall user satisfaction. This remote project runs from November 15 through November 18 and takes about 7.5 hours in total. You’ll need an active personal ChatGPT Free or Plus account, a computer or smartphone, and availability during the project window.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$40–$70/hr
  • ChatGPT
  • AI agents
  • Attention to Detail
AI evaluationView job