Create advanced questions in your technical discipline, assess AI-generated solutions, and build scoring criteria that capture sound reasoning as well as correct results. The work centers on rubric design, partial-credit standards, and close review of technical details such as assumptions, formulas, units, and edge cases. Applicants need a relevant degree, at least three years of domain experience, and C1-level English.
Bring your experience shipping search systems into a 25-minute conversation about search quality, evaluation, and the tradeoffs behind real implementations. The interview has no coding or take-home exercise. Candidates whose interviews stand out may be invited to a paid, 30-minute live conversation with the team; payment follows completion of the call.
A contractor will review 3D scan-based first-article inspection reports for a project developing AI systems. The work covers scan-to-CAD comparisons, datum setups, profile and position callouts, and CMM measurement with uncertainty analysis. You will assess whether deviations reflect the part or result from fixturing and alignment, then provide input for FAI sign-off decisions. Prior AI experience is not required.
Create and evaluate clinical scenarios that help frontier AI labs assess model judgment and safety. You will write realistic vignettes and reference responses, then review model answers for clinical accuracy, ethics, and risk handling. The role suits a licensed psychologist with at least two years of post-licensure practice and a commitment of 10 or more hours per week. Work is remote, asynchronous, and contractor-based, with no caseload.
Lead quality reviews for Malay AI training work by checking generated content and contributor output against project rubrics. You will give trainers and QAs specific feedback, clarify language questions, and maintain guidance for regional usage, tone, and terminology. The role requires professional Malay language experience and strong English; no immediate project is available, but qualified candidates may be contacted for future work.
Use your production software experience to help assess AI models through engineering problems and code reviews. Work may cover frontend, backend, full-stack, mobile, embedded, DevOps, systems, QA, or security engineering. This ongoing candidate pool stays open between projects; after background verification, matching candidates may receive project invitations on timelines that range from a week to several months.
Contribute elevator trade expertise to a customer project that helps train AI systems. You’ll review controller and safety-circuit troubleshooting cases, assess diagnostic reasoning and code references, and provide written and verbal feedback on hydraulic and traction equipment. No previous AI experience is needed; the work calls for practical elevator knowledge.
Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
$20–$60/hr
Controller troubleshooting from straight-line wiring diagrams
Review AI-generated actuarial work for technical accuracy, develop examples of pricing, reserving, and risk modeling, and assess model answers against actuarial standards of practice. The role suits actuaries with a professional credential or substantial exam progress and at least two years of relevant experience. Work takes place remotely on an asynchronous schedule.
Lead quality checks for legal AI training work by reviewing model responses and contributor submissions against project rubrics. You will guide trainers and QAs, flag legal reasoning and safety issues, and maintain resources such as calibration tasks and style guides. This remote contract has no immediate project; qualified candidates may be contacted when relevant work becomes available. Selection includes an AI interview, a domain task, and a recruiter interview.
Review AWS serverless and infrastructure-as-code tasks that help train and evaluate a frontier AI lab’s models. You’ll check multi-service designs, confirm that IaC matches the intended architecture, and assess how services integrate. Your reviews should address cloud architecture and technical correctness, with clear written feedback tied to a rubric. The role is open to candidates in the United States.
Shape how frontier coding agents are tested and improved. You will create evaluation methods, datasets, and tools, then study model performance across software engineering tasks. The work combines Python and software engineering, LLM and agent systems, benchmark design, and model failure analysis. You will also share research findings with technical and client audiences.
Create and assess technical challenges that test how AI models handle real-world audiovisual production. You will draw on experience with equipment operation, troubleshooting, and production workflows to check model answers against technical standards and established practices. The work centers on audio and video production topics, from signal flow and microphone use to camera operation and live streaming.
Guide quality across HTML/CSS AI training work by reviewing generated code and contributor evaluations against project rubrics. You will assess semantics, accessibility, responsive behavior, browser support, and CSS structure, then give actionable feedback and maintain resources for remote contributors. The role requires at least three years of relevant frontend experience and strong English communication.
Listen to AI-generated audiobooks in US and North American English and assess whether the narration sounds natural, accurate, and enjoyable. You’ll mark speech and audio issues in review tools, identify where the listening experience falters, and rate listener satisfaction. The role calls for native or near-native English fluency, regular audiobook listening, and availability for about 20 hours each week.
Lead the delivery of coding data pipelines that support training frontier AI models. You’ll work with AI Lab clients, software engineering experts, reviewers, MTS, and internal teams to set quality standards, manage delivery, and improve workflows. The role calls for software engineering knowledge, experience leading technical projects or complex data workflows, and confidence translating client needs into clear specifications.
Take on project-based engineering work over the next 2–3 weeks, with an expected 10–20 hours per week for projects you accept. You’ll develop and debug software, review code, and handle technical implementation across varied stacks and applications. The work suits engineers with 1–3 years of professional experience who can scope and deliver features independently.
Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$75/hr
software engineering
data structures
algorithms
Software EngineeringView job
Showing 20 active roles of 210. Dates reflect what the source published, not when AIWorkJobs last synced.
Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.