Create difficult benchmark tasks from your professional experience in coding, machine learning, or cybersecurity. Each task must run in a Linux terminal and challenge advanced AI agents: three leading models get three attempts each, and they should fail most attempts. The project should run for the next few weeks. Onboarding requires two courses, a graded assessment of about 90 minutes, and a live webinar before tasking. Pay reaches $1,350 per task, with higher rates possible based on task quality and submission volume; tasks average six to seven hours, and your first tasks may take longer.
Help shape AI training data by creating and reviewing realistic DevOps and infrastructure challenges for a leading AI lab. You’ll draw on production experience with cloud platforms, Kubernetes, infrastructure as code, and CI/CD to assess technical solutions and explain operational tradeoffs. Cincinnatus LLC employs you on a W-2 basis and may place you within the lab’s extended workforce.
Contribute engineering expertise to an AI research project focused on how models interpret professional tasks and language. Project work may include writing industry-specific prompts and reviewing LLM responses. The program runs year-round, but project placement depends on availability. Work remotely on a flexible schedule, with no minimum hour commitment.
Use your PR judgment to shape and assess AI-generated communications, from press releases and media pitches to crisis statements and FAQs. You will compare model responses for accuracy, tone, audience fit, message discipline, and reputational risk, then provide clear feedback or write benchmark examples. This remote contract has no immediate project; qualified experts may hear about relevant work through the expert network.
Apply your employment and labor law knowledge to legal data annotation for an initiative that supports AI training. You will review workplace disputes, wage and hour compliance, investigations, agreements, and related statutory topics, helping keep annotations accurate and relevant. The work draws on knowledge of U.S. workplace regulations; prior AI experience is not required.
Help a foundational AI lab train its latest language model by creating, evaluating, and refining AI-generated business documents, spreadsheets, and slide decks. You’ll review materials for executive or client delivery across financial models, board decks, memos, proposals, and brand templates. Work remotely on your own schedule; hours depend on client task volume, most experts work under 10 hours a week, and weekly hours and earnings have no cap or guarantee. Start date: ASAP.
Create and assess technical challenges that test how AI models handle real-world audiovisual production. You will draw on experience with equipment operation, troubleshooting, and production workflows to check model answers against technical standards and established practices. The work centers on audio and video production topics, from signal flow and microphone use to camera operation and live streaming.
Create brand identity references and advertising assets, then assess visual designs generated by AI models for training and evaluation projects. The work draws on studio or agency art direction, with a focus on consistent brand systems, multi-format campaigns, and clear design standards. Shortlisted candidates complete a 15-minute AI interview, followed by a 45-minute technical interview with the team.
Score, mix and master commercial music and audio post for broadcast and digital ads while helping a leading AI lab improve its models and training data. You will assess generated music, voice-over and sound design, build practical evaluation tasks, and create rights-cleared reference files. The remote, full-time W-2 role requires 40 hours per week on weekdays and employs you through Cincinnatus LLC.
Use your chemistry expertise on flexible, project-based work that supports AI research. You’ll create chemistry problems grounded in real research, laboratory, or analytical work, assess AI responses for accuracy and reproducibility, and write feedback that helps models reflect how chemists work. You can complete tasks at your own pace, with no set schedule or minimum hours.
Review AI-generated mechanical engineering work or create expert training material across thermodynamics, fluid mechanics, mechanics, and system modeling. Check calculations, assumptions, units, and physical plausibility, then write clear corrections or model solutions. This hourly remote contract requires at least C1 English and a relevant engineering degree.
Contribute environmental law expertise to a project that uses legal work to train AI systems. You will create and assess annotation tasks, analyze legal materials, and explain legal reasoning with precision. The work covers federal and state environmental law, including compliance, permitting, pollution control, remediation, and litigation. No previous AI experience is needed.
Help a leading foundational AI lab train its language model on professional presentations and slide decks. You’ll create, assess, and refine materials across core investment banking workflows. The role is remote, with flexible scheduling; task volume determines available hours, and most experts work under 10 hours per week.
AfterQuery engages licensed dentists as independent contractors to create and assess clinical dentistry examples for AI model evaluation. You’ll write cases with radiographic findings and treatment plans, explain your clinical decisions, and judge model responses against diagnostic accuracy and standard of care. The work runs remotely and asynchronously, with a commitment of at least 10 hours per week.
Create professional audio examples and reference material for AI training and evaluation. The work covers rights-cleared, multi-stem music, commercial video mixes, voiceover cleanup, Foley, and sound effects, along with loudness and synchronization checks. The contract expects 39 hours per week and requires a United States base, a live portfolio, and participation in a 15-minute AI interview followed by a 45-minute technical interview for candidates who advance.
Create architectural and interior design tasks and reference materials that help an AI lab improve its models. The role suits an architect or senior ArchViz artist who can produce complete drawing sets, editable 3D files, and photorealistic interior and exterior renders, then assess AI outputs against real design, construction, and code standards. Cincinnatus LLC employs this full-time, 40-hour-per-week W-2 role and places you with a leading AI lab.
Use your experience with ChatGPT and other AI chat assistants to help assess how well responses fit individual users. You’ll compare answers, explain your preferences in Korean, and submit feedback through Handshake’s annotation platform. The ongoing, project-based work has no set schedule or minimum hours, so you can fit tasks around your current role.
Location and eligibility
Remote · South Korea only
Engagement type
Part-time
Compensation
$30/hr
korean
english
chatgpt
AI evaluationView job
Showing 20 active roles of 1,328. Dates reflect what the source published, not when AIWorkJobs last synced.
Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.