AIWorkJobs
Turing logoTuringPlatform listing

AI Quality Analyst (Personalization) - Korean

Evaluate personalized AI responses in Korean for relevance and grounding.

Remote · Eligibility not specifiedContract
Work arrangement
Remote
Eligibility
Eligibility not specified
Engagement
Contract
Compensation
$15/hr
Specialty
AI Training

About the role

Assess Gemini’s personalization feature by creating Korean prompts based on your own experiences and reviewing the responses they produce. You’ll judge grounding, integration, and helpfulness, compare model answers side by side, and explain your rankings with evidence from the conversation. The work requires a personal Google account with personal data sources enabled.

What you would do

  • Create and run multi-turn prompts, usually 1 to 5 turns, that test how Gemini uses personal context.
  • Check whether responses match the intent behind each starting prompt and apply personalization in a suitable way.
  • Review claims about the user for grounding, and flag unsupported details, faulty inferences, or hallucinations.
  • Assess whether personal information fits the response without excessive narration or robotic wording.
  • Compare and rank two model responses based on helpfulness, ease of use, and enjoyment.
  • Write evidence-based rationales that cite specific turns and explain strengths or issues.
  • Review model debug information to confirm that chat summaries and data sources were used.
  • Delete evaluation conversations to keep them out of future chat history.

Requirements

  • Read and write Korean at a high level.
  • Have a bachelor’s degree or equivalent experience in a relevant field, such as policy, law, ethics, linguistics, journalism, or computer science.
  • Be available for at least 4 hours per day and up to 40 hours per week, with 4 hours of overlap with PST.
  • Use a primary personal Google account, not a test account, and enable personal data sources.
  • Assess nuanced and ambiguous AI responses, including personalization errors and forced connections.
  • Design creative, multi-turn prompts based on personal context.
  • Compare side-by-side responses and identify subtle differences in naturalness and overnarration.
  • Write concise, structured rationales that refer to specific conversation turns, and provide detailed annotations.
  • Have a desktop or laptop and a reliable internet connection.

Preferred qualifications

The source marks these as preferred, not required.

  • Experience in data annotation, AI quality evaluation, content moderation, or a related role.

Who should apply

Candidates with strong Korean reading and writing skills, sound judgment about personalized AI responses, and experience creating multi-turn prompts should consider this contract. Applicants need a personal Google account and the schedule flexibility to meet the daily commitment and PST overlap.

How applying works on Turing

Create a profile, finish any required proctored assessments, then complete screening or a role interview.

  1. Apply through work.turing.com and complete your profile.
  2. Finish the required proctored assessments for the role.
  3. Complete shortlisting, screening, or a technical interview.
  4. Confirm rate, availability, and eligibility before an offer.

Typical timeline: Review takes 48 hours to six weeks after all required steps; consideration replies are usually within 12 hours.

Paid steps: Not stated by the source

Not every role requires tests. Turing does not review an application until required assessments are complete.

Process checked Nov 19, 2026. AIWorkJobs does not submit applications or charge a fee. Read the full Turing process and its official source on the Turing page.

Skills mentioned by the source

  • korean
  • prompt engineering
  • ai evaluation
  • data annotation
  • content moderation
  • personalization evaluation
  • side-by-side evaluation
  • grounding assessment
  • conversation analysis
  • quality assurance
  • domain-specific languages

Listing reference: ai-quality-analyst-personalization-korean-62135. Source: Turing. If something here contradicts the source, the source controls. Report a correction.

Related roles

Other work on the index.

See more in this category

Turing

AI Quality Analyst (Personalization) - Thai

Evaluate Thai AI responses using personal context for relevance.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$15/hr
  • thai
  • prompt engineering
  • ai evaluation
AI evaluationView job

Handshake AI

Korean AI Evaluation Specialist (South Korea)

Use your experience with ChatGPT and other AI chat assistants to help assess how well responses fit individual users. You’ll compare answers, explain your preferences in Korean, and submit feedback through Handshake’s annotation platform. The ongoing, project-based work has no set schedule or minimum hours, so you can fit tasks around your current role.

Location and eligibility
Remote · South Korea only
Engagement type
Part-time
Compensation
$30/hr
  • korean
  • english
  • chatgpt
AI evaluationView job

Turing · via Braintrust

AI Evaluator – Education (Experienced Gemini Users)

Help assess and improve AI responses through research, fact-checking, logic analysis, and educational evaluation. The role suits students and working professionals who use the Gemini App for learning. Work remotely from the United States for an expected 16-week project, with a possible extension. Plan for at least 20 hours per week, up to 40 as project needs change, and four hours of overlap with Pacific working hours.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$20/hr
  • gemini app
  • research
  • fact-checking
AI evaluationView job

SME Careers

Korean Language Expert

Review AI-generated answers and create Korean-language content that demonstrates sound reasoning, accurate facts, and clear explanations. You will apply South Korean localization judgment to assess terminology, tone, cultural nuance, and prompt fit, using MQM/LQA concepts to classify quality issues. This remote contract role considers candidates based in South Korea who have at least five years of localization or translation experience.

Location and eligibility
Remote · Eligible in 6 countries
Engagement type
Contract
Compensation
Up to $40/hr
  • korean
  • english
  • translation
Language & LinguisticsView job