Review Medicare enrollment questions and AI-generated answers for accuracy, relevance, and usefulness to beneficiaries. You’ll draw on Social Security or employer benefits experience to write evaluation rubrics and give written feedback to the project team. The remote, short-term contractor project calls for 20–30 hours per week and does not require prior AI experience.
Bring hands-on software engineering judgment to the evaluation of large language models. You’ll create coding benchmarks, assess model responses, and investigate security-related tasks and reasoning failures. The contract starts at six months, with potential for a longer engagement. Paris or London candidates are preferred; strong candidates elsewhere in Europe may work remotely.
Use your background in B2B wholesale and manufacturing sales to assess AI-generated sales content and workflows. The project starts immediately and runs about 4–6 weeks. You can work remotely and must commit at least 20 hours per week. Payment starts on a task basis after approval of your first task; completing that task within the required timeline qualifies you for hourly pay for the rest of the project.
Use your CAD expertise on an ongoing, project-based AI research effort. You’ll create tasks based on professional workflows such as 2D drafting, parametric 3D modeling, technical drawings, and design for fabrication, then assess AI responses and provide written feedback. Set your own pace with no fixed schedule or minimum hour requirement, and take on the work alongside your current role.
As a Hindi Quality Assurance Lead, you will review Hindi AI-training content and contributor work against project rubrics. You will assess language accuracy, tone, cultural fit, and instruction-following, then give clear feedback and maintain resources such as Hindi style guides and Devanagari examples. The role also covers contributor onboarding, guideline updates, and recurring quality issues across Hindi projects.
Create and assess forensic accounting challenges that help train AI models on fraud investigations and litigation support. You will build scenarios around investigative methods, financial analysis, and evidence, then judge model answers against professional standards. A degree in accounting, finance, or a related field and experience in forensic accounting, fraud examination, or litigation support are required.
Evaluate AI-generated videos for a project focused on video data annotation and AI training. You’ll compare outputs, judge their editing and visual quality, and explain your choices in written feedback. The work draws on video editing, motion graphics, visual effects, and storytelling expertise; prior AI experience is not required.
Contribute personal financial-app records to an AI training project by exporting account activity from accounts you own, removing identifiers with a local redaction tool, and submitting the cleaned files through a secure project platform. You need qualifying accounts across six categories and recent history that generally spans at least a year. The client estimates 60–90 minutes for the full workflow, depending on your accounts and available records.
Bring deep ownership of a mature open-source project to AI model training work focused on software engineering, code review, and maintenance. You’ll create repository-based tasks, assess AI-generated code and tests, and explain your technical judgments. The commitment is 30–40 hours each week as your primary work focus, with flexible scheduling, mostly asynchronous work, and occasional researcher meetings. Cincinnatus LLC engages you and may place you with a leading AI lab.
Bring your energy-sector experience to project-based AI research. You’ll create expert training examples and assess AI responses for accuracy and relevance, drawing on the tools and workflows you use at work. The work runs remotely on a flexible, asynchronous schedule with no minimum hours; contributors often work 5–20 hours per week during active projects. Project access depends on current needs, with possible consideration for future work.
Lead Norwegian-language quality work for AI training projects by reviewing model content and contributor work against project rubrics. You’ll coach trainers and QA reviewers, answer questions on language standards, and maintain resources such as style guides and onboarding materials. The role is a remote contract with no immediate project; qualified candidates may be contacted when a suitable project becomes available.
AfterQuery seeks experienced EMTs to create and assess prehospital scenarios for AI model evaluations. You will write cases from dispatch through handoff, explain the field reasoning behind protocol choices, and judge model responses for clinical accuracy and scene safety. The role is remote and asynchronous, with ongoing contractor work and a minimum commitment of 10 hours per week.
A leading customer is seeking a US-based senior video trainer to assess AI-generated videos and help improve AI models. You will compare clips, explain your choices in writing, and use annotation tools to flag specific strengths and weaknesses. Your feedback will also help shape video evaluation standards and guidelines.
JAB Institutional is building a wealth management platform for households with $500,000 to $2 million in investable assets, with an initial market launch planned for late 2026 and its first advisors expected in 2027. As the platform’s first dedicated product hire, you will guide its build with technology partners and shape the client and advisor experience, product roadmap, and data and AI foundation.
A biotech and pharma research team needs a practising physician to assess commercial drugs and development programs in a paid pilot. You’ll build and review evaluation rubrics, interpret clinical trial endpoints, and judge whether trial results could change prescribing or affect real-world uptake in your therapeutic area. The pilot runs remotely for about 10–20 hours over one to two weeks, with potential for recurring work as the project grows.
Physicians use clinical expertise to create challenging medical tasks and assess AI-generated responses for accuracy, patient safety, and consistency with current practice and guidelines. The work spans acute care, medicine, and surgery. Projects open throughout the year, and contributors can work remotely on a flexible, part-time basis alongside another role, with no set schedule or minimum hours.
Create practical computer-based tasks that show how developers use NetBeans for Java projects, debugging, builds, tests, and GUI work. You will prepare the project environment, record each workflow, and document its goal and steps in SuperAnnotate. The role requires English at B2 level or higher and hands-on NetBeans experience.
AfterQuery seeks commissioned notaries to create notarization and document execution scenarios for AI model evaluations. You will write answers grounded in statutory reasoning and assess model responses against state notary law. The work is remote and asynchronous, with a minimum commitment of 10 hours per week as an independent contractor.
Location and eligibility
Remote · United States only
Engagement type
Not specified
Compensation
$48/hr
notary public
notarial practice
acknowledgments
AI evaluationView job
Showing 20 active roles of 1,907. Dates reflect what the source published, not when AIWorkJobs last synced.
Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.