AIWorkJobs
Turing logoTuringPlatform listing

AI Quality Analyst (Personalization) - Portuguese

Evaluate AI personalization quality using your personal experiences and insights.

Remote · Eligibility not specifiedContract
Work arrangement
Remote
Eligibility
Eligibility not specified
Engagement
Contract
Compensation
$15/hr
Specialty
AI Training

About the role

Assess Gemini’s personalization feature by testing whether it draws relevant, supported details from your past conversations and Google activity, including Gmail, Search, and YouTube. You’ll create multi-turn prompts from personal context, compare model answers, and explain which response best meets the prompt. The work calls for strong Portuguese, careful judgment, and access to your primary Google account with personal data sources enabled.

What you would do

  • Create and run multi-turn prompts, typically 1–5 turns, based on personal context and experiences.
  • Judge whether Gemini uses personal information in a way that matches the prompt’s intent.
  • Check claims about the user for evidence, unsupported inferences, and hallucinations.
  • Assess whether personal details fit the response without excessive narration or awkward connections.
  • Compare and rank two model responses for helpfulness, ease of use, and user experience.
  • Write clear rationales that cite specific turns and explain the strengths or problems in each response.
  • Review model debug information to confirm that chat summaries and data sources were used.
  • Delete evaluation conversations to keep them out of future chat history.

Requirements

  • Read and write Portuguese at a high level; Portuguese is the project’s focus language.
  • Use your primary personal Google account, not a test account, and enable personal data sources.
  • Be available at least 4 hours per day, up to 40 hours per week, with 4 hours of overlap with PST.
  • Assess nuanced or ambiguous responses, including personalization errors, weak inferences, and forced connections.
  • Design creative, multi-turn prompts that test use of personal context.
  • Compare responses and identify subtle differences in naturalness and overnarration.
  • Write concise, structured evaluation rationales that refer to specific conversation turns.
  • Provide detailed annotations and constructive feedback.
  • Hold a bachelor’s degree or equivalent experience in a relevant field, such as policy, law, ethics, linguistics, journalism, or computer science.
  • Have a desktop or laptop and a reliable internet connection.

Preferred qualifications

The source marks these as preferred, not required.

  • Experience in data annotation, AI quality evaluation, content moderation, or a related role.

Who should apply

Candidates with strong Portuguese skills, a relevant degree or equivalent experience, and sound judgment about how AI should use personal context may fit this work. Applicants must be comfortable evaluating responses through their primary Google account and meeting the stated daily schedule and PST overlap.

How applying works on Turing

Create a profile, finish any required proctored assessments, then complete screening or a role interview.

  1. Apply through work.turing.com and complete your profile.
  2. Finish the required proctored assessments for the role.
  3. Complete shortlisting, screening, or a technical interview.
  4. Confirm rate, availability, and eligibility before an offer.

Typical timeline: Review takes 48 hours to six weeks after all required steps; consideration replies are usually within 12 hours.

Paid steps: Not stated by the source

Not every role requires tests. Turing does not review an application until required assessments are complete.

Process checked Nov 19, 2026. AIWorkJobs does not submit applications or charge a fee. Read the full Turing process and its official source on the Turing page.

Skills mentioned by the source

  • portuguese
  • ai quality evaluation
  • personalization evaluation
  • prompt engineering
  • multi-turn prompting
  • data annotation
  • side-by-side evaluation
  • response ranking
  • grounding assessment
  • hallucination detection
  • content moderation
  • debug information review
  • google gemini
  • gmail
  • google search
  • youtube

Specialty areas

Specialties come from the source platform’s category taxonomy and are used to filter the job index.

Listing reference: ai-quality-analyst-personalization-portuguese-62131. Source: Turing. If something here contradicts the source, the source controls. Report a correction.

Related roles

Other work on the index.

See more in this category

Turing

AI Quality Analyst - Portuguese (Portugal)

Evaluate personalized AI responses using your own experiences and insights.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$15/hr
  • portuguese
  • gemini
  • gmail
AI evaluationView job

Handshake AI

Portuguese AI Evaluation Specialist (Brazil)

Based in Brazil, you’ll assess AI-generated answers in Portuguese and explain which responses better serve individual users. The work draws on your real-world experience with AI tools and your ability to judge subtle differences between answers. You can complete these ongoing, project-based tasks remotely at your own pace, with no set schedule or minimum hours.

Location and eligibility
Remote · Brazil only
Engagement type
Part-time
Compensation
$25/hr
  • portuguese
  • english
  • ai response evaluation
AI evaluationView job

SME Careers

Portuguese Quality Assurance Lead (QAL)

As a remote contractor, you will review Portuguese AI-training content and contributor work against project rubrics, with a focus on Brazil-specific language quality. You will give trainers and quality reviewers actionable feedback, resolve questions about grammar and cultural context, and maintain resources such as Portuguese style guides and Google Sheets trackers. This role has no immediate project; qualified candidates may be contacted when relevant work becomes available.

Location and eligibility
Remote · Brazil, Portugal
Engagement type
Contract
Compensation
Up to $35/hr
  • portuguese
  • english
  • localization qa
Language & LinguisticsView job

Turing · via Braintrust

AI Evaluator – Education (Experienced Gemini Users)

Help assess and improve AI responses through research, fact-checking, logic analysis, and educational evaluation. The role suits students and working professionals who use the Gemini App for learning. Work remotely from the United States for an expected 16-week project, with a possible extension. Plan for at least 20 hours per week, up to 40 as project needs change, and four hours of overlap with Pacific working hours.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$20/hr
  • gemini app
  • research
  • fact-checking
AI evaluationView job