Create and assess evaluation prompts that test whether AI models distinguish safe from unsafe requests in radiology and radiation science. You will explain the technical basis for each judgment and revise your work in response to structured reviewer feedback. Applicants must hold a relevant graduate degree, be citizens of a Five Eyes country, and work from within one of those countries.
Use your nuclear science or engineering expertise to assess how AI models handle safety-sensitive requests. You’ll create evaluation prompts, review work from other experts, and explain the technical basis for each safe-or-unsafe judgment. Applicants need an advanced degree, citizenship in a Five Eyes country, and physical presence in one of those countries while working.
Help assess how AI models respond to safety-critical questions about radioactive materials and health physics. You will create evaluation prompts, judge work from other experts, and explain the technical basis for each safety decision. The work is remote and task-based, and you must be a citizen of and work from a Five Eyes country.
Use your energy-sector experience to help test and train AI models on realistic work from utilities, oil and gas, and power production. You’ll build practical scenarios, examine operational data, and spot errors in AI responses that require professional judgment. The project is remote and part time, with flexible hours and hourly pay.
Use your professional agriculture experience to help test and train AI models on farm and agribusiness work. You will create practical problems, examine yield, input cost, settlement, and budget data, then flag errors in AI responses. The project offers remote, part-time work with flexible hours. Applicants need at least five years of relevant experience and a bachelor's degree or higher; it is not intended for students or early-career candidates.
Use your government or public agency experience to help train and assess AI models on practical public sector work. You’ll create realistic work problems, examine budget, grant and program reporting data, and catch errors in AI responses. The project offers remote, part-time work with flexible hours and hourly pay. Applicants need at least five years of relevant experience, so the role does not suit students or early-career professionals.
Apply your expertise in explosives or energetic materials to assess how AI models handle safety-sensitive questions. You will create and review prompts that test the line between acceptable and unsafe requests, then document the technical basis for each decision. Applicants must hold a relevant master's degree or higher, be citizens of a Five Eyes country, and live in one of those countries while doing the work.
Help assess how AI models handle safety-sensitive questions in materials science. You will create evaluation prompts, review work from other experts, and explain the technical basis for each safe or unsafe classification. The role requires a graduate degree in a relevant discipline and citizenship and residence in a Five Eyes country while you complete the work.
AfterQuery needs experienced software engineers to create realistic, multi-step coding challenges for advanced AI coding agents. You will draw on a substantial private codebase you own, frame problems that require investigation across modules, and create Docker-based environments with tests that assess solutions and catch regressions.
Turn computational work from your physics research into evaluation tasks that test AI models on expert-level scientific problems. You will build each task around work you have run and debugged, such as a simulation, numerical solver, data-reduction pipeline, or model fit, then provide a Python reference solution and tests. The role covers several physics fields and follows a flexible, task-based schedule.
AfterQuery engages experienced classroom teachers as independent contractors to create and review teaching scenarios used to evaluate AI models. You will build examples from lesson planning through assessment, explain the reasoning behind instructional choices, and judge whether model responses suit the instructional goal and students’ ages. Work is remote and async, with ongoing projects and a minimum commitment of 10 hours per week.
Help train and assess AI systems that answer questions about biological sciences. You may write challenging biology prompts, judge whether model responses use accurate facts and sound reasoning, catch issues such as invented citations or outdated nomenclature, draft reference answers with explanations, and build rubrics for scoring response quality.
Help evaluate how well AI models handle real systems-engineering challenges in LLM inference, GPU performance, and model serving. You will create technical scenarios, prepare reference solutions, and assess model responses rather than build production software. The role suits senior engineers with hands-on expertise in inference or GPU systems and strong technical writing skills. The listing describes remote, contract, part-time work with a flexible schedule.
Work on project-based data science and machine learning tasks similar to those found in analytics, AI research, and machine learning engineering. Projects run over the next 2–3 weeks, with asynchronous work and an expected commitment of 10–20 hours per week for each project you accept. You’ll help develop and assess models for business applications.
Create and assess behavioral science scenarios that AI labs use to evaluate model judgment. You will draw on research methods to build realistic study questions, explain the reasoning behind sound answers, and identify conclusions that go beyond the evidence. The work suits researchers with an advanced degree and at least two years of experience with human subjects or behavioral data. Contractors set their hours, with a commitment of at least 10 hours each week.
Medical experts help train and assess AI systems that handle clinical and healthcare questions. The work can include creating challenging prompts, checking answers for accuracy and sound medical reasoning, and catching errors in lab interpretation or differential diagnoses. Topics span diagnosis, treatment planning, pharmacology, patient safety, and nursing care.
Use your nursing experience to assess and create clinical material for AI training and evaluation. You will review AI-generated patient education, triage guidance, and clinical documentation for accuracy and safety, then provide examples grounded in real nursing practice. The work is remote, asynchronous, and paid hourly, so you choose when and how much to work.
Turn engineering computations you have implemented and tested into research-grade tasks for AI model evaluation. Each task centers on a real calculation from your research, with a main problem, related subproblems, a Python reference solution, and tests. You can work around your own schedule, submit tasks for review, and choose whether to assess submissions from other experts.
AfterQuery seeks licensed clinical social workers to create and assess scenarios that test how AI models handle mental health and social services. As an independent contractor, you will write clinical scenarios and reference responses, then evaluate model answers for accuracy, ethics, and risk. The work is remote and asynchronous, with no caseload, no fixed hours, and a minimum commitment of 10 hours per week.
AfterQuery engages board-certified nurse practitioners as independent contractors to create and assess clinical evaluation data for frontier AI labs. You’ll write patient cases from presentation through disposition, document the reasoning behind reference answers, and judge model responses for diagnostic accuracy and patient safety. Work runs remotely on an async schedule, with a minimum commitment of 10 hours per week and no set maximum.
Location and eligibility
Remote · Eligibility not specified
Engagement type
Not specified
Compensation
$103/hr
nurse practitioner
clinical reasoning
patient scenario writing
Healthcare & MedicalView job
Showing 20 active roles of 157. Dates reflect what the source published, not when AIWorkJobs last synced.
Source: AfterQuery. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.