Work on project-based data science and machine learning tasks similar to those found in analytics, AI research, and machine learning engineering. Projects run over the next 2–3 weeks, with asynchronous work and an expected commitment of 10–20 hours per week for each project you accept. You’ll help develop and assess models for business applications.
Assess how well a large language model handles Russian, then help strengthen its language skills with carefully reviewed data. You will evaluate and refine text across translation, summarization, dialogue, and grammar correction, annotate linguistic features, and share findings with AI researchers on a project with a leading research lab.
Use your retail operations experience on ongoing, project-based AI research work. You’ll write training questions grounded in store workflows, assess AI responses about store performance and inventory, and give structured feedback. Work remotely at your own pace, with no set schedule or minimum hour requirement, alongside your current work.
Lead quality checks for computer science and IT AI training work, reviewing technical answers, code, and troubleshooting guidance against project rubrics. You will coach trainers and QA contributors, document standards, and flag inaccurate or unsafe recommendations. The role calls for at least three years of relevant technical experience, strong English communication, and native Punjabi fluency.
Shape how frontier coding agents are tested and improved. You will create evaluation methods, datasets, and tools, then study model performance across software engineering tasks. The work combines Python and software engineering, LLM and agent systems, benchmark design, and model failure analysis. You will also share research findings with technical and client audiences.
Create, assess, and refine documents, spreadsheets, and slide decks that help train a foundational AI model. Work across real estate, hospitality, and events workflows, including property listings, lease summaries, event schedules, venue proposals, guest service standards, and banquet orders. The role is fully remote, with a flexible schedule and task volume that varies. Most experts work under 10 hours per week, with no weekly cap; work can start as soon as possible.
Medical experts help train and assess AI systems that handle clinical and healthcare questions. The work can include creating challenging prompts, checking answers for accuracy and sound medical reasoning, and catching errors in lab interpretation or differential diagnoses. Topics span diagnosis, treatment planning, pharmacology, patient safety, and nursing care.
Assess how well a large language model handles Armenian across translation, summarization, dialogue, and grammar correction. You will refine Armenian text, annotate linguistic features, and share analysis that helps AI researchers address language gaps and improve model training. The work calls for expert knowledge of Armenian grammar, style, regional variation, and cultural context.
Apply your environmental science expertise to an AI research project focused on how models interpret professional work and language. Project assignments may involve writing industry-specific prompts and assessing large language model responses. The program runs year-round, with projects opening at intervals; placement depends on available work. Contributors work remotely on a flexible schedule with no minimum hour commitment.
Use your Tamil language expertise and mathematics degree to shape AI training content and assess model responses. You will write prompts and reference answers, compare outputs for accuracy, fluency, tone, and cultural fit, and explain language or reasoning issues in English. The role requires native or near-native written Tamil, C1 English, and at least three years of relevant professional experience.
Develop and assess LLM-powered agents and AI systems used in enterprise workflows. The role combines applied research with hands-on engineering: you will design evaluations, investigate failures, run experiments, and help improve system performance. You will also build research tools and infrastructure while working with researchers, engineers, domain experts, and enterprise customers.
Help train a foundational AI lab’s language model by creating, assessing, and refining professional policy presentations. You’ll draw on experience producing policymaker-facing briefs and slides across policy briefings, data exhibits, testimony support, report launches, and stakeholder updates. The role is remote with a flexible schedule; task volume varies, and most experts work under 10 hours per week, with no weekly cap.
Turn engineering computations you have implemented and tested into research-grade tasks for AI model evaluation. Each task centers on a real calculation from your research, with a main problem, related subproblems, a Python reference solution, and tests. You can work around your own schedule, submit tasks for review, and choose whether to assess submissions from other experts.
Assess how well an LLM handles Japanese across translation, summaries, dialogue, and grammar correction. You will also edit and annotate Japanese text, flag language and cultural issues, and share detailed feedback with AI researchers. The work calls for native or near-native Japanese fluency, professional English, and experience with Japanese language work such as translation, editing, or annotation.
Use your biology expertise on remote, project-based work that helps improve AI responses. You’ll create questions grounded in the field and assess model answers for accuracy, scientific reasoning, experimental design, and technical problem-solving. The schedule is flexible, with no minimum hours; contributors often work about 5–20 hours per week during active projects. Project placement depends on current needs, with future projects also possible.
Review AI-generated data science reasoning, code, and model results, then create reference solutions that show sound quantitative methods. You will check statistical claims, modeling decisions, and prompt compliance, and compare answers for correctness and clarity. The work draws on Python, scikit-learn, and SQL expertise. This contract has no immediate project; qualified candidates may hear about future assignments.
Realm Lab needs a Member of Technical Staff to evaluate and improve frontier AI systems. You’ll work across machine learning, data research, and evaluation engineering, building benchmarks, reinforcement learning environments, and datasets. The role calls for hands-on experience with LLM evaluation, Python, and experimental methods, plus the ability to turn real-world workflows into structured tests of model capabilities.
Location and eligibility
Remote · Eligibility not specified
Engagement type
Full-time
Compensation
$100–$130/hr
LLM Evaluation & Benchmark Design
Python & ML Engineering
Reinforcement Learning & Agentic Systems
Machine Learning & AIView job
Showing 20 active roles of 323. Dates reflect what the source published, not when AIWorkJobs last synced.
Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.