AIWorkJobs
Turing logoTuringPlatform listing

AI Quality Analyst - Portuguese (Portugal)

Evaluate personalized AI responses using your own experiences and insights.

Remote · Eligibility not specifiedContract
Work arrangement
Remote
Eligibility
Eligibility not specified
Engagement
Contract
Compensation
$15/hr
Specialty
AI Training

About the role

Assess Gemini’s personalized responses using context from prior conversations, Gmail, Google Search, and YouTube activity. You will create multi-turn prompts based on your own experiences, compare model responses, and judge their grounding, integration, and helpfulness. The role requires use of your primary Google account, at least 4 hours of work per day, and 4 hours of overlap with PST.

What you would do

  • Create and run multi-turn prompts, usually 1-5 turns, that test how Gemini uses personal context.
  • Check whether responses match the intent behind each starting prompt and apply personalization appropriately.
  • Identify unsupported claims, flawed inferences, and hallucinations about the user.
  • Assess whether personal details fit naturally into responses without excessive narration.
  • Compare and rank two responses for helpfulness, ease of use, and enjoyment.
  • Write clear rationales that cite specific turns and explain strengths or issues.
  • Review model debug information to confirm use of chat summaries and data sources.
  • Delete evaluation conversations to keep them out of future chat history.

Requirements

  • Read and write Portuguese at a high level.
  • Use your primary personal Google account and enable personal data sources for evaluation.
  • Be available at least 4 hours per day and up to 40 hours per week, with 4 hours of overlap with PST.
  • Provide full-time availability in your local time zone for a global, 24-hour operations team.
  • Show strong analytical judgment when reviewing nuanced or ambiguous AI responses.
  • Create multi-turn prompts based on personal context to test model capabilities.
  • Recognize incorrect personalization, poor inferences, and forced connections.
  • Compare side-by-side responses and notice differences in naturalness and overnarration.
  • Write clear, concise rationales for rankings and reference specific conversation turns.
  • Have a desktop or laptop with a good internet connection.
  • Hold a BS/BA degree or equivalent experience in a relevant field such as policy, law, ethics, linguistics, journalism, or computer science.

Preferred qualifications

The source marks these as preferred, not required.

  • Experience in data annotation, AI quality evaluation, content moderation, or a related role.

Who should apply

Candidates with strong Portuguese writing skills and sound judgment about personalized AI responses should consider this role. Applicants must be comfortable using their primary Google account, creating prompts from personal context, and meeting the stated schedule and PST overlap.

How applying works on Turing

Create a profile, finish any required proctored assessments, then complete screening or a role interview.

  1. Apply through work.turing.com and complete your profile.
  2. Finish the required proctored assessments for the role.
  3. Complete shortlisting, screening, or a technical interview.
  4. Confirm rate, availability, and eligibility before an offer.

Typical timeline: Review takes 48 hours to six weeks after all required steps; consideration replies are usually within 12 hours.

Paid steps: Not stated by the source

Not every role requires tests. Turing does not review an application until required assessments are complete.

Process checked Nov 19, 2026. AIWorkJobs does not submit applications or charge a fee. Read the full Turing process and its official source on the Turing page.

Skills mentioned by the source

  • portuguese
  • gemini
  • gmail
  • google search
  • youtube
  • prompt design
  • ai evaluation
  • data annotation
  • content moderation
  • side-by-side evaluation
  • personalization assessment
  • conversation analysis
  • domain-specific languages

Listing reference: ai-quality-analyst-portuguese-portugal-79388. Source: Turing. If something here contradicts the source, the source controls. Report a correction.

Related roles

Other work on the index.

See more in this category

Turing

AI Quality Analyst (Personalization) - Portuguese

Evaluate AI personalization quality using your personal experiences and insights.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$15/hr
  • portuguese
  • ai quality evaluation
  • personalization evaluation
Language & LinguisticsView job

Turing · via Braintrust

AI Evaluator – Education (Experienced Gemini Users)

Help assess and improve AI responses through research, fact-checking, logic analysis, and educational evaluation. The role suits students and working professionals who use the Gemini App for learning. Work remotely from the United States for an expected 16-week project, with a possible extension. Plan for at least 20 hours per week, up to 40 as project needs change, and four hours of overlap with Pacific working hours.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$20/hr
  • gemini app
  • research
  • fact-checking
AI evaluationView job

Handshake AI

Portuguese AI Evaluation Specialist (Brazil)

Based in Brazil, you’ll assess AI-generated answers in Portuguese and explain which responses better serve individual users. The work draws on your real-world experience with AI tools and your ability to judge subtle differences between answers. You can complete these ongoing, project-based tasks remotely at your own pace, with no set schedule or minimum hours.

Location and eligibility
Remote · Brazil only
Engagement type
Part-time
Compensation
$25/hr
  • portuguese
  • english
  • ai response evaluation
AI evaluationView job

SME Careers

English Language Expert

Review AI-generated English responses or create language examples that show sound reasoning and clear, correct writing. You will judge accuracy, prompt fit, and meaning, then explain edits or compare candidate responses. The work draws on English grammar, discourse analysis, and tools such as ChatGPT, Gemini, and Perplexity. This remote contract role requires at least C1 English proficiency and a relevant bachelor’s degree.

Location and eligibility
Remote · Eligible in 27 countries
Engagement type
Contract
Compensation
Up to $25/hr
  • english
  • copyediting
  • discourse analysis
Language & LinguisticsView job