AIWorkJobs
Turing logoTuringPlatform listing

AI Quality Analyst (Personalization) - Spanish

Evaluate personalized Gemini responses in Spanish for relevance and accuracy.

Remote · Eligibility not specifiedContract
Work arrangement
Remote
Eligibility
Eligibility not specified
Engagement
Contract
Compensation
$15/hr
Specialty
AI Training

About the role

Evaluate Gemini responses in Spanish to see whether the model uses personal context from past conversations, Gmail, Google Search, and YouTube in a relevant and helpful way. You will create multi-turn prompts from your own experiences, compare responses, and assess grounding, integration, and helpfulness. The project requires use of your primary Google account and at least four hours of work per day.

What you would do

  • Create and run multi-turn prompts, typically 1-5 turns, that draw on personal information and experiences.
  • Judge whether each response follows the intent of the starting prompt and applies personalization appropriately.
  • Check claims about the user for evidence, flawed inferences, and hallucinations.
  • Assess whether personal details fit the response without excessive narration.
  • Compare and rank two model responses for helpfulness, ease of use, and enjoyment.
  • Write clear rationales that cite specific turns and explain strengths or issues.
  • Review model debug information to verify use of chat summaries and data sources.
  • Delete evaluation conversations to keep them out of future chat history.

Requirements

  • Read and write Spanish at a high level; Spanish is the project's focus language.
  • Use your primary personal Google account, not a testing account, and enable personal data sources.
  • Have full-time availability in your local time zone for a global, 24-hour operation, with at least 4 hours per day and up to 40 hours per week.
  • Provide 4 hours of work-time overlap with PST.
  • Show strong analytical judgment when assessing nuanced or ambiguous AI responses and personalization quality.
  • Design creative, multi-turn prompts based on personal context.
  • Identify incorrect personalization, poor inferences, and forced connections.
  • Review side-by-side responses for subtle differences in naturalness and overnarration.
  • Write clear, concise rationales with specific turn references, and provide constructive feedback with detailed annotations.
  • Hold a BS/BA degree or equivalent experience in a relevant field, such as policy, law, ethics, linguistics, journalism, or computer science; have a desktop or laptop and a good internet connection.

Preferred qualifications

The source marks these as preferred, not required.

  • Experience in data annotation, AI quality evaluation, content moderation, or a related role.

Who should apply

Candidates with strong Spanish writing skills and experience assessing nuanced content can draw on their judgment to evaluate personalized AI responses. The role suits someone comfortable using a personal Google account for testing and meeting the daily schedule and PST overlap requirements.

How applying works on Turing

Create a profile, finish any required proctored assessments, then complete screening or a role interview.

  1. Apply through work.turing.com and complete your profile.
  2. Finish the required proctored assessments for the role.
  3. Complete shortlisting, screening, or a technical interview.
  4. Confirm rate, availability, and eligibility before an offer.

Typical timeline: Review takes 48 hours to six weeks after all required steps; consideration replies are usually within 12 hours.

Paid steps: Not stated by the source

Not every role requires tests. Turing does not review an application until required assessments are complete.

Process checked Nov 19, 2026. AIWorkJobs does not submit applications or charge a fee. Read the full Turing process and its official source on the Turing page.

Skills mentioned by the source

  • spanish
  • gemini
  • prompt engineering
  • ai evaluation
  • data annotation
  • content moderation
  • personalization
  • response ranking
  • quality assessment
  • google account
  • gmail
  • google search
  • youtube
  • domain-specific languages

Specialty areas

Specialties come from the source platform’s category taxonomy and are used to filter the job index.

Listing reference: ai-quality-analyst-personalization-spanish-62133. Source: Turing. If something here contradicts the source, the source controls. Report a correction.

Related roles

Other work on the index.

See more in this category

Turing

AI Quality Analyst (Personalization) - Polish

Evaluate AI personalization effectiveness using your own experiences and data.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$20/hr
  • polish
  • ai evaluation
  • personalization evaluation
AI evaluationView job

Handshake AI

Spanish AI Evaluation Specialist (Mexico)

Use your experience with ChatGPT and other AI assistants to compare Spanish-language responses and explain which answers better fit a user’s needs. You’ll complete project-based annotation work at your own pace, with no set schedule or minimum hours. Applicants must live in Mexico and agree to share their ChatGPT conversation history for research and product improvement; the company will handle that history confidentially.

Location and eligibility
Remote · Mexico only
Engagement type
Part-time
Compensation
$25/hr
  • spanish
  • english
  • chatgpt
AI evaluationView job

Turing · via Braintrust

AI Evaluator – Education (Experienced Gemini Users)

Help assess and improve AI responses through research, fact-checking, logic analysis, and educational evaluation. The role suits students and working professionals who use the Gemini App for learning. Work remotely from the United States for an expected 16-week project, with a possible extension. Plan for at least 20 hours per week, up to 40 as project needs change, and four hours of overlap with Pacific working hours.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$20/hr
  • gemini app
  • research
  • fact-checking
AI evaluationView job

SME Careers

English Language Expert

Review AI-generated English responses or create language examples that show sound reasoning and clear, correct writing. You will judge accuracy, prompt fit, and meaning, then explain edits or compare candidate responses. The work draws on English grammar, discourse analysis, and tools such as ChatGPT, Gemini, and Perplexity. This remote contract role requires at least C1 English proficiency and a relevant bachelor’s degree.

Location and eligibility
Remote · Eligible in 27 countries
Engagement type
Contract
Compensation
Up to $25/hr
  • english
  • copyediting
  • discourse analysis
Language & LinguisticsView job