AIWorkJobs
Turing logoTuringPlatform listing

AI Quality Analyst (Personalization) - Arabic

Evaluate Arabic AI responses using personal context for relevance.

Remote · Eligibility not specifiedContract
Work arrangement
Remote
Eligibility
Eligibility not specified
Engagement
Contract
Compensation
$15/hr

About the role

Evaluate Arabic responses from Gemini’s personalization feature using context from your own conversations and activity across Gmail, Google Search, and YouTube. You will create multi-turn prompts, compare model responses, and explain how well each answer reflects the available personal information. The contract runs for three months and requires at least four hours of work per day, with four hours of overlap with PST.

What you would do

  • Create and run conversational prompts, typically one to five turns, that test how Gemini uses personal context.
  • Judge whether each response addresses the intent behind the opening prompt and applies personalization appropriately.
  • Check claims about the user for evidence, flawed inferences, and hallucinations.
  • Assess whether personal details fit the response without awkward or excessive narration.
  • Compare two model responses and rank them for helpfulness, ease of use, and user experience.
  • Write clear rationales that cite specific turns and explain the strengths or problems behind each ranking.
  • Review model debug information to confirm that chat summaries and data sources informed the response.
  • Delete evaluation conversations to keep them out of future chat history.

Requirements

  • Read and write Arabic with a high level of proficiency.
  • Use your primary personal Google account, rather than a test account, and enable personal data sources for evaluation.
  • Commit to at least four hours per day and up to 40 hours per week, including four hours of overlap with PST.
  • Show strong analytical judgment when reviewing nuanced or ambiguous AI responses.
  • Create creative, multi-turn prompts grounded in personal context.
  • Identify incorrect personalization, unsupported inferences, and forced connections.
  • Spot subtle differences in naturalness and excessive narration when comparing responses.
  • Write concise, structured rationales that cite specific conversation turns, and provide detailed annotations.
  • Hold a BS or BA degree, or have equivalent experience in a relevant field such as policy, law, ethics, linguistics, journalism, or computer science.
  • Have a desktop or laptop with a reliable internet connection.

Preferred qualifications

The source marks these as preferred, not required.

  • Experience in data annotation, AI quality evaluation, content moderation, or a related field.

Who should apply

Candidates who write Arabic with confidence and can assess how AI uses personal context will fit the work. The role suits someone with strong evaluation judgment, clear written communication, and availability for the stated daily hours and PST overlap.

How applying works on Turing

Create a profile, finish any required proctored assessments, then complete screening or a role interview.

  1. Apply through work.turing.com and complete your profile.
  2. Finish the required proctored assessments for the role.
  3. Complete shortlisting, screening, or a technical interview.
  4. Confirm rate, availability, and eligibility before an offer.

Typical timeline: Review takes 48 hours to six weeks after all required steps; consideration replies are usually within 12 hours.

Paid steps: Not stated by the source

Not every role requires tests. Turing does not review an application until required assessments are complete.

Process checked Nov 19, 2026. AIWorkJobs does not submit applications or charge a fee. Read the full Turing process and its official source on the Turing page.

Skills mentioned by the source

  • arabic
  • gemini
  • google account
  • gmail
  • google search
  • youtube
  • prompt engineering
  • ai evaluation
  • data annotation
  • content moderation
  • personalization
  • response ranking
  • side-by-side evaluation
  • conversation analysis
  • debug information
  • data hygiene

Listing reference: ai-quality-analyst-personalization-arabic-62132. Source: Turing. If something here contradicts the source, the source controls. Report a correction.

Related roles

Other work on the index.

See more in this category

Turing

AI Quality Analyst (Personalization) - Turkish

Evaluate Turkish Gemini responses using personal context for relevance.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$15/hr
  • turkish
  • gemini
  • prompt engineering
AI evaluationView job

Turing · via Braintrust

AI Evaluator – Education (Experienced Gemini Users)

Help assess and improve AI responses through research, fact-checking, logic analysis, and educational evaluation. The role suits students and working professionals who use the Gemini App for learning. Work remotely from the United States for an expected 16-week project, with a possible extension. Plan for at least 20 hours per week, up to 40 as project needs change, and four hours of overlap with Pacific working hours.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$20/hr
  • gemini app
  • research
  • fact-checking
AI evaluationView job

SME Careers

Arabic Language Expert

Review Arabic and English AI responses or create bilingual training examples, with a focus on reasoning, accuracy, and clear explanations. You will check claims, spot flawed methods, and compare candidate answers using task rubrics. The work is remote and contract-based; there is no immediate project, but qualified experts may hear about relevant work through the network.

Location and eligibility
Remote · Egypt, Saudi Arabia, South Africa
Engagement type
Contract
Compensation
Up to $15/hr
  • arabic
  • english
  • modern standard arabic
Language & LinguisticsView job

Turing

AI Quality Analyst - English

Evaluate AI personalization quality using your personal experiences and insights.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
Pay not listed
  • ai evaluation
  • personalization evaluation
  • prompt engineering
AI evaluationView job