Create and assess benchmarks that test AI systems against real creative and technical workflows in music, audio, speech, linguistics, visual media, or design. The work includes Linux-based tasks and domain-focused review of AI results. The project pays $1,350 per task and expects a commitment of 20 hours per week for 1–6 months.
Mercor seeks experienced engineers at companies that serve retail investors for a paid, one-time interview with a leading AI company building financial intelligence products. In a 45–60 minute remote conversation, you’ll explain how your team evaluates and selects third-party APIs or AI vendors, then share what shaped the integration and vendor experience. The interview covers your own views, not confidential employer information.
Review three AI-generated answers to realistic chemical safety questions, classify each request as benign, dual-use, or adversarial, and assess the answers for safety and technical accuracy. You’ll rank the responses, explain your judgments, and draft a better answer, using expertise in chemical hazards and GHS hazard communication. Applicants must be US, UK, Canadian, Australian, New Zealand, or EU citizens or permanent residents.
Use scientific or clinical expertise to assess how AI systems handle domain-specific work. You will create Linux-terminal benchmarks, set standards for verifiable results, and review the accuracy and reasoning behind proposed solutions. The project expects 20 hours per week for 1–6 months and pays $1,350 per task.
Review and assess AI-generated legal responses, or create expert legal examples that show sound analysis and precise writing. You will check legal reasoning, authority, citations, procedural steps, and risk assumptions, then provide clear feedback or compare candidate answers. This remote contract role has no immediate project; qualified experts may be contacted when relevant work becomes available.
Create realistic finance and operations challenges that help benchmark AI systems. You’ll build scenarios from professional workflows, set clear criteria for correct results, and assess proposed answers for accuracy and sound reasoning. The project expects 20 hours of work per week for 1–6 months and pays $1,350 per task.
Review AI-generated explanations and build reference answers across enzyme kinetics, metabolism, protein structure, molecular biology, and laboratory methods. You will check scientific claims, calculations, experimental context, and safety, then compare model responses and provide specific written feedback. The role is remote and contract-based, with work conducted in English.
Use your systems or hardware engineering experience to create difficult, clearly specified challenges for AI agents to solve in a Linux terminal. The project is task-based and expected to last a few weeks. Tasks average six to seven hours, with early submissions potentially taking longer. Earn up to $1,350 per task, with higher rates possible based on task quality and submission volume. Onboarding requires two courses, a graded assessment of about 90 minutes, and a live webinar.
Review and assess AI-generated Spanish content for accuracy, reasoning, and fit with Spain’s language conventions. You will compare model responses, check localized details against reliable sources, and write examples or explanations that show sound language choices. The work draws on MQM/LQA, CAT-tool workflows, and at least C1 English reading and writing. Only candidates based in Spain can apply.
Create difficult benchmark tasks from your professional experience in coding, machine learning, or cybersecurity. Each task must run in a Linux terminal and challenge advanced AI agents: three leading models get three attempts each, and they should fail most attempts. The project should run for the next few weeks. Onboarding requires two courses, a graded assessment of about 90 minutes, and a live webinar before tasking. Pay reaches $1,350 per task, with higher rates possible based on task quality and submission volume; tasks average six to seven hours, and your first tasks may take longer.
Assess AI responses to nuclear science and radiation questions by labeling requests as benign, dual-use, or adversarial, then judging and ranking three model answers. You will explain safety decisions and draft a better response, while recognizing both hazardous guidance and legitimate professional questions models should answer. Applicants must be citizens or residents of the US, UK, Canada, Australia, New Zealand, or the European Union.
Create evaluation tasks that ask a model to design and refine passive on-chip RF components against electrical and area targets. For each task, provide the specification, a reference layout, and a check that runs an EM simulation and compares its results with the target. The work starts with five pilot tasks, followed by a review before the project scales. Applicants must be based in Europe, Canada, or the US.
Review AI-generated accounting answers or create reference content such as journal entries, reconciliations, close checklists, and scenario analyses. You will check accounting logic, written explanations, and financial statement presentation against GAAP or IFRS guidance. This hourly remote contract has no immediate project; qualified experts may be contacted when relevant work becomes available.
Bring 3–5 years of QA or quality engineering experience to web and mobile testing for a Web3 product. You’ll combine manual and automated checks, maintain regression coverage, and test wallet, smart contract, and exchange integration flows. The role calls for working-level scripting skills and clear bug reports, with collaboration across US, Europe, and India time zones.
Guide quality across Catalan AI training projects by reviewing language data and contributor work against project rubrics. You will coach trainers and QA reviewers, resolve questions on Catalan usage and regional standards, and keep style guides and onboarding resources current. Strong Catalan writing skills and clear English communication are central to the role.
Bring hands-on software engineering judgment to the evaluation of large language models. You’ll create coding benchmarks, assess model responses, and investigate security-related tasks and reasoning failures. The contract starts at six months, with potential for a longer engagement. Paris or London candidates are preferred; strong candidates elsewhere in Europe may work remotely.
Review AI-generated Catalan and create reference answers that model accurate, natural writing. You will judge grammar, meaning, tone, regional fit, and cultural context, then explain errors and compare response quality. Strong Catalan writing and C1 English are essential for following evaluation guidance and delivering detailed feedback in a remote contract workflow.
Lead Spanish quality checks across AI training projects by reviewing generated content and contributor work against project rubrics. You will coach trainers and QA reviewers, answer language questions, and maintain Spanish-specific guides and trackers. This remote contract has no immediate project; qualified candidates may hear about future assignments. The selection process includes an AI interview, a domain task, and a recruiter interview.
Location and eligibility
Remote · Mexico, Spain, United States
Engagement type
Contract
Compensation
Up to $40/hr
spanish
english
ai training
Language & LinguisticsView job
Showing 18 active roles of 38. Dates reflect what the source published, not when AIWorkJobs last synced.
Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.