Based in Germany, you will assess AI-generated German content and create language examples that help improve model responses. Apply MQM/LQA methods to judge accuracy, reasoning, tone, and cultural fit, then document findings and compare candidate answers. The hourly contract has no immediate project; qualified experts may receive invitations when suitable work becomes available.
Use your systems or hardware engineering experience to create difficult, clearly specified challenges for AI agents to solve in a Linux terminal. The project is task-based and expected to last a few weeks. Tasks average six to seven hours, with early submissions potentially taking longer. Earn up to $1,350 per task, with higher rates possible based on task quality and submission volume. Onboarding requires two courses, a graded assessment of about 90 minutes, and a live webinar.
Create difficult benchmark tasks from your professional experience in coding, machine learning, or cybersecurity. Each task must run in a Linux terminal and challenge advanced AI agents: three leading models get three attempts each, and they should fail most attempts. The project should run for the next few weeks. Onboarding requires two courses, a graded assessment of about 90 minutes, and a live webinar before tasking. Pay reaches $1,350 per task, with higher rates possible based on task quality and submission volume; tasks average six to seven hours, and your first tasks may take longer.
Bring hands-on software engineering judgment to the evaluation of large language models. You’ll create coding benchmarks, assess model responses, and investigate security-related tasks and reasoning failures. The contract starts at six months, with potential for a longer engagement. Paris or London candidates are preferred; strong candidates elsewhere in Europe may work remotely.
Location and eligibility
On-site · Eligible in 10 countries
Engagement type
Contract
Compensation
$75–$90/hr
software engineering
python
data annotation
Machine Learning & AIView job
Showing 4 active roles of 24. Dates reflect what the source published, not when AIWorkJobs last synced.
Sources: ten specialist AI work platforms. AIWorkJobs does not verify every claim made by a source. Report a listing that looks wrong through the contact page.