AIWorkJobs
Braintrust logoSureHostListed on Braintrust

AI Model Benchmarking Intern Iowa-Based

SureHost is a Des Moines hospitality technology company that uses documented property standards, photos, video, AI-assisted review, and human judgment to check short-term rentals after cleaning. You will work with the…

Remote · United States onlyContract
Work arrangement
Remote
Eligibility
United States only
Engagement
Contract
Compensation
$22–$28/hr
Specialty
AI Training
Experience
Under 3 years

About the role

SureHost is a Des Moines hospitality technology company that uses documented property standards, photos, video, AI-assisted review, and human judgment to check short-term rentals after cleaning. You will work with the AI Chief Architect to benchmark language and vision models against real product needs and share findings that guide model choices and the roadmap. The six-month internship is remote for Iowa residents, runs 15–20 hours per week with flexible scheduling, and pays $22–$28 per hour based on experience and independence. Start timing can accommodate school schedules; the team holds a monthly in-person check-in in Des Moines.

What you would do

  • Research and compare changing LLM and VLM options for SureHost product use cases.
  • Build representative evaluation datasets, test cases, scoring criteria, and repeatable benchmark workflows.
  • Assess model accuracy, reliability, latency, cost, and other factors that matter to the product.
  • Study failure patterns and trade-offs, including false positives and false negatives on issues that matter to property operators.
  • Present findings and recommendations that inform model strategy and the product roadmap.
  • Keep benchmark results and documentation current as models, APIs, and requirements change.

Requirements

  • Live in Iowa.
  • Show interest in applied AI and familiarity with LLMs, VLMs, generative AI tools, or model APIs through coursework or projects.
  • Bring basic Python or data-analysis skills.
  • Work with structured data and evaluation criteria using logical, evidence-based reasoning.
  • Document methods and results in a clear way.
  • Run repeatable experiments with patience, investigate edge cases, and distinguish demo performance from dependable results.
  • Communicate clearly, ask questions early, and handle customer, property, and company information responsibly.

Who should apply

Iowa-based students or early-career candidates with coursework or project experience in applied AI, model APIs, Python, or data analysis should consider applying. The role suits someone interested in testing model performance against practical hospitality product needs.

How applying works on Braintrust

Create a Braintrust profile, complete the AI skills interview, then browse and accept tasks from the dashboard.

  1. Create and complete a Braintrust profile.
  2. Complete the AI skills interview used for expertise and pay-level matching.
  3. Browse the dashboard for available tasks.
  4. Accept a task and complete the work.

Typical timeline: A new member profile takes about 20 minutes.

Paid steps: Not stated by the source

Individual client projects can add their own interview, assessment, or identity check.

Process checked Nov 19, 2026. AIWorkJobs does not submit applications or charge a fee. Read the full Braintrust process and its official source on the Braintrust page.

Skills mentioned by the source

  • python
  • data analysis
  • machine learning
  • large language models
  • vision-language models
  • generative ai
  • model evaluation
  • benchmarking
  • evaluation datasets
  • scoring criteria
  • false positive analysis
  • false negative analysis
  • machine learning engineering
  • cloud engineering
  • ai product management
  • communication

Specialty areas

Specialties come from the source platform’s category taxonomy and are used to filter the job index.

Listing reference: ai-model-benchmarking-intern-iowa-based-18147. Source: Braintrust. If something here contradicts the source, the source controls. Report a correction.

Related roles

Other work on the index.

See more in this category

SureHost · via Braintrust

AI Software Development Intern, Iowa-Based

SureHost is hiring an Iowa-based intern for a 3–6 month, part-time role building AI features for a hospitality product that checks whether short-term rentals meet property standards after cleaning. You’ll develop Python services and pipelines for LLM- and VLM-based reviews, working with the AI Chief Architect and senior engineers in Pune. The role offers 15–20 hours per week, remote work, and a full-time conversion review at the end of the term.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$22–$35/hr
  • python
  • large language models
  • vision-language models
Machine Learning & AIView job

Turing

AI Benchmark & Red-Teaming Specialist

Research and build benchmark tasks to expose AI model weaknesses.

Location and eligibility
Remote · Eligibility not specified
Engagement type
Contract
Compensation
Pay not listed
  • ai benchmarking
  • red teaming
  • large language models
Machine Learning & AIView job

SureHost · via Braintrust

Mobile Development Intern, Iowa

Build and improve mobile and web features for a hospitality product that helps short-term rental teams document completed cleanings and confirm properties are guest-ready. You’ll work with the Product Manager, design, and backend teammates for 15–20 hours per week during a 3–6 month internship. SureHost will consider full-time conversion at the end of the term based on performance, business need, and role availability.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$22–$30/hr
  • mobile development
  • front-end development
  • flutter
AI trainingView job

SureHost · via Braintrust

Property Media & Data Collection Intern (Des Moines Metro)

Capture video at short-term rental properties across the Des Moines metro and prepare the footage for onboarding, audits, and product work. You’ll help create the visual dataset that supports SureHost’s AI-assisted property reviews. The six-month internship runs 15–20 hours per week, with property visits and remote footage organization. Drive time between assigned properties is paid at your hourly rate; no separate mileage reimbursement applies.

Location and eligibility
Remote · United States only
Engagement type
Contract
Compensation
$15–$22/hr
  • property data collection
  • smartphone videography
  • video capture
Data annotationView job