Use your systems or hardware engineering experience to create difficult, clearly specified challenges for AI agents to solve in a Linux terminal. The project is task-based and expected to last a few weeks. Tasks average six to seven hours, with early submissions potentially taking longer. Earn up to $1,350 per task, with higher rates possible based on task quality and submission volume. Onboarding requires two courses, a graded assessment of about 90 minutes, and a live webinar.
Build realistic engineering and design exercises in Bentley MicroStation, then document and record your workflow in SuperAnnotate. You will prepare DGN project assets, demonstrate 2D drafting or 3D modeling, and verify that drawings, references, levels, and deliverables meet technical standards. Applicants need at least three years of professional MicroStation experience and a portfolio of relevant work.
Create difficult benchmark tasks from your professional experience in coding, machine learning, or cybersecurity. Each task must run in a Linux terminal and challenge advanced AI agents: three leading models get three attempts each, and they should fail most attempts. The project should run for the next few weeks. Onboarding requires two courses, a graded assessment of about 90 minutes, and a live webinar before tasking. Pay reaches $1,350 per task, with higher rates possible based on task quality and submission volume; tasks average six to seven hours, and your first tasks may take longer.
As a remote, hourly contractor, you will create paralegal examples and assess AI-generated legal support for sound reasoning, accurate authorities, and useful procedures. Your work may span legal research, document drafting, and litigation or transactional workflows. The role has no immediate project; qualified experts may receive invitations when relevant work becomes available.
Review and create Mandarin content for AI training, judging response quality, reasoning, and fidelity to the prompt. Apply China-specific localization expertise and MQM/LQA methods to identify language and factual issues, compare model answers, and write sound reference explanations. The work calls for native or near-native Mandarin, C1 or higher English, and at least five years of localization or translation experience.
Shape how AI models handle brand strategy and go-to-market work by reviewing generated responses or creating expert examples such as positioning statements, messaging frameworks, and briefs. You will assess strategic logic, customer insight, brand fit, and factual support, then provide clear written feedback. This hourly remote contract has no immediate project; qualified experts may be contacted when suitable work becomes available.
Review AI-generated answers to C# and .NET engineering problems, then create prompts and model solutions that show sound reasoning. You will check code and explanations for correctness, clarity, and prompt alignment, and compare responses for technical quality. The work draws on C#, ASP.NET Core, Web APIs, and relational database practices. This is a remote, hourly contract role with no immediate project; qualified experts may be contacted when relevant work becomes available.
Assess AI-generated electrical engineering content across circuit analysis, power systems, controls, and related specialties. You will test model reasoning with realistic engineering scenarios, check calculations and safety considerations, and give structured feedback on technical accuracy, assumptions, and real-world feasibility.
Review pharmacy-focused AI responses or create expert content that demonstrates sound clinical reasoning. You will assess pharmacotherapy, dosing, interactions, contraindications, monitoring, and patient counseling, then explain errors and compare answers for accuracy and safety. This hourly remote contract has no immediate project; qualified pharmacists may be contacted for future assignments.
Use your biology expertise to assess AI-generated explanations, compare proposed solutions, and write accurate model answers across biological topics. You will check scientific claims against public sources and flag errors in reasoning, methods, or prompt adherence. This contract role has no immediate project; qualified experts may hear about relevant work through the expert network.
Use your PR judgment to shape and assess AI-generated communications, from press releases and media pitches to crisis statements and FAQs. You will compare model responses for accuracy, tone, audience fit, message discipline, and reputational risk, then provide clear feedback or write benchmark examples. This remote contract has no immediate project; qualified experts may hear about relevant work through the expert network.
Review AI-generated mechanical engineering work or create expert training material across thermodynamics, fluid mechanics, mechanics, and system modeling. Check calculations, assumptions, units, and physical plausibility, then write clear corrections or model solutions. This hourly remote contract requires at least C1 English and a relevant engineering degree.
Review or create clinical research content for AI training, with a focus on study methods, statistical interpretation, and evidence quality. You will fact-check claims, assess model reasoning, and explain sound research decisions in writing. This is a remote contract role with no immediate project; qualified experts may receive invitations to relevant future work.
Review AI-generated compliance and risk guidance or write reference content such as policies, control descriptions, and regulatory summaries. You will judge regulatory interpretation, monitoring logic, reporting requirements, and risk reasoning, then give precise written feedback. The work draws on GRC, regulatory compliance, and control testing experience. This is a contract role with no immediate project; qualified experts may be contacted for future assignments.
Review and compare AI-generated Kotlin solutions for correctness, sound reasoning, and fit with each prompt. You will also write model answers and explanations, check technical claims, and flag errors in code or architecture. This remote contract role has no immediate project; qualified engineers may be contacted when relevant work opens through the expert network.
Review AI-generated medical responses or create healthcare content that demonstrates sound clinical reasoning. You will check evidence, test interpretation, timelines, dosing logic, and care-setting choices, then explain errors and compare answers with clear written feedback. This remote, hourly contract has no immediate project; qualified experts may hear about future work through the network.
Use a personal Ubuntu/Linux computer to complete structured tasks that support AI training data quality. You will install project software, follow written procedures, review your work, and flag unclear instructions or technical problems. The work calls for about 15 hours per week; prior AI experience is not required.
Assess AI-generated astronomy and space science content for sound physics, accurate calculations, and clear limits on what the evidence supports. You will test model reasoning, review prompts and solutions, and give structured feedback on errors in areas such as orbital mechanics and astrophysics. No project is active now; qualified experts may receive invitations when relevant work becomes available.
Review AI-generated answers to R and data analysis questions, checking statistical reasoning, code, and results against each prompt. You will also write model solutions and explanations that show sound analytical practice. The role requires at least two years of R experience and C1 English proficiency. No project is active now; qualified experts may be contacted when matching work becomes available.
Review AI-generated Ruby and Rails code, write model solutions, and explain whether each answer follows sound reasoning and idiomatic practices. You will assess application structure, readability, and correctness, then compare responses for quality. The role is remote and contract-based, with no immediate project; qualified engineers may be contacted when relevant work becomes available.
Location and eligibility
Remote · Eligible in 17 countries
Engagement type
Contract
Compensation
Up to $55/hr
ruby
ruby on rails
mvc
Machine Learning & AIView job
Showing 20 active roles of 77. Dates reflect what the source published, not when AIWorkJobs last synced.
Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.