Create and assess forensic accounting challenges that help train AI models on fraud investigations and litigation support. You will build scenarios around investigative methods, financial analysis, and evidence, then judge model answers against professional standards. A degree in accounting, finance, or a related field and experience in forensic accounting, fraud examination, or litigation support are required.
Join a network that connects legal experts with future AI projects. After you complete your profile and pass an AI interview, Mercor may match you with work based on your background and project needs. Projects cover AI training and evaluation in law, with typical commitments of 15–30 hours per week; scope and duration vary.
Review coding agents on real engineering tickets, run their code, and assess the results as you would a teammate’s pull request. You’ll also work through a problem in a codebase you know, noting where the model falters. The contract provides 40 hours of work each week, with flexible scheduling, and requires at least four years of professional software engineering experience.
Lead quality review across Odia AI training projects by checking contributor work and model-generated text against project rubrics. You will guide trainers and reviewers on grammar, meaning, tone, and cultural fit, while maintaining Odia style guides and project records in tools such as Discord and Google Sheets. The role requires professional Odia language experience and clear written communication in English.
Contribute intelligence expertise to an AI training and evaluation project centered on intelligence operations and national security. You will judge AI-generated scenarios and related materials for accuracy, realism, and operational relevance. The project especially seeks people with experience at civilian intelligence agencies such as the CIA, NSA, MI6/SIS, GCHQ, or equivalent organizations.
AfterQuery seeks experienced EMTs to create and assess prehospital scenarios for AI model evaluations. You will write cases from dispatch through handoff, explain the field reasoning behind protocol choices, and judge model responses for clinical accuracy and scene safety. The role is remote and asynchronous, with ongoing contractor work and a minimum commitment of 10 hours per week.
Review GPU and accelerator kernel-development tasks that support training and evaluation of a frontier AI lab’s models. Judge numerical correctness, benchmark fairness, task scope, and compilation and runtime validity across varied kernel work. You’ll also write rubric-based feedback that explains your findings.
Use your retail logistics or transportation experience to assess AI-generated material and help models reflect real freight and supply chain workflows. You’ll write training questions and scenarios, review model responses, and submit structured feedback. The work runs on an ongoing, project-based basis, with hourly contract tasks you can complete at your own pace and no set schedule or minimum hours.
Lead quality checks for Croatian-language AI training work by reviewing generated content and contributor submissions against project rubrics. You’ll coach trainers and QA reviewers, resolve language questions, and maintain resources such as style guides, FAQs, and trackers. The role calls for native or near-native Croatian, strong English, and at least three years of relevant language or quality experience.
Contribute senior intelligence expertise to an AI training and evaluation project covering national security, intelligence analysis, and government decision-making. You will assess AI-generated reports and scenarios for accuracy, realism, and analytical quality, drawing on skills in intelligence analysis, threat assessment, source evaluation, and critical thinking.
AfterQuery seeks commissioned notaries to create notarization and document execution scenarios for AI model evaluations. You will write answers grounded in statutory reasoning and assess model responses against state notary law. The work is remote and asynchronous, with a minimum commitment of 10 hours per week as an independent contractor.
Join Mercor’s physician network for potential contract projects with AI labs and companies. After you complete a profile and pass an AI interview, Mercor may match you with projects as they become available. Work can include medical model training and evaluation, with commitments that typically range from 15 to 30 hours per week. Project scope and duration vary.
Use your renewable energy experience on remote, hourly contract projects that help AI research teams assess and improve model responses. You’ll create expert training data and review AI answers about renewable generation, REC trading, and portfolio management. The schedule is flexible, with no minimum hours; contributors often work 5–20 hours per week during active projects. Project placement depends on current needs, with future projects possible.
Review three AI-generated answers to realistic explosives and energetic-materials questions. You will classify each request, assess safety and technical accuracy, rank the responses, and draft a suitable answer. For dual-use requests, explain the legitimate context and access considerations. The role draws on professional explosives or hazardous-materials expertise, with eligibility limited to citizens or permanent residents of the US, UK, Canada, Australia, New Zealand, or the European Union.
Work on an AI safety initiative by testing models for ethical jailbreaks, prompt injection, and tool-use abuse. You’ll develop adversarial evaluation methods, probe multi-turn weaknesses, maintain regression tests, and share findings with technical and non-technical audiences. AI experience is not required; relevant domain knowledge matters.
Apply your background in property management, real estate operations, or community administration to projects that test and improve AI. You will create property and concierge scenarios, write structured solutions, and assess AI responses. No AI experience is needed. The work is fully remote, with freelance projects expected to last about one month and possible extensions.
Create and assess legal scenarios that test how AI models handle paralegal work, from legal research and citation formats to document drafting, discovery, and case management. You will judge model answers against paralegal best practices and legal standards, then work with legal and technical specialists to shape content that teaches practical, real-world skills.
Review repository-level software engineering benchmarks used to train and evaluate a frontier AI lab’s models. You’ll examine task quality, reference patches, test harnesses, Docker isolation, and grading integrity, then write clear feedback against a rubric. The role calls for professional software engineering experience and open-source contribution or maintainer work. The listing is limited to the United States.
Location and eligibility
Remote · United States only
Engagement type
Hourly
Compensation
$70–$90/hr
python
java
go
Quality Assurance & TestingView job
Showing 20 active roles of 782. Dates reflect what the source published, not when AIWorkJobs last synced.
Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.