LLM Model Response Evaluation

Lifted, an Upwork Company™ · Remote · US only

US only3+ years requiredPublished 6 August 2026Check carefully

Apply on Lifted, an Upwork Company™'s site✨ Tailor my resume for this jobPrepare with the Apply kit

First recorded by Psst: 3 November 2026. Sign in with Google to continue to the employer. A free account is enough.

The 20-second read

Experience
3+ years required
Where you can live
US only
Degree or licence
Mentioned (bachelor's)
Job type
Contract or freelance

Read from the ad by Psst's rules. Check the full ad below before applying.

Job details

Where you can work
United States
Employment type
Contract
Advertised pay
Not stated by the employer
Experience
3+ years required
Employer publication date
6 August 2026
First recorded by Psst
3 November 2026
Last checked at the source
4 November 2026

About the job

Experience level: not applicable.

  • Evaluating UI widgets, infographics, image factuality, side-by-side comparisons, and similar AI evaluation activities.
  • The work may involve text, images, audio, video, HTML widgets, PDFs, or combinations of these modalities.
  • The work is domain-agnostic and may cover topics across arts, culture, history, science, engineering, and more.
  • Resources will be expected to independently research unfamiliar topics using trusted sources before making evaluation decisions.
  • Each task will include detailed project guidelines within the evaluation platform.
  • 3+ years of hands-on experience in LLM / GenAI data evaluation.
  • Bachelor's Degree required
  • Ability to research unfamiliar topics using trusted sources and make well-supported judgments.
  • Comfortable evaluating content across multiple modalities

Flexible and remote work

Variable workload:  Accept or decline tasks based on your availability

No guaranteed hours:  Workload may vary weekly

Our client, a global technology company that helps businesses build, train, and manage AI systems is looking for experts to evaluate model-generated content against defined quality rubrics such as factuality, consistency, aesthetics, and other evaluation criteria.

Apply on Lifted, an Upwork Company™'s site✨ Tailor my resume for this jobMore remote machine learning and AI engineer jobs →

Find my dream remote job →
Ghost Job Detector: Check carefully
  • Open 3 months
  • No pay listed
Signals, not proof. Check the company's page before you spend time on it.
Free with job alerts

A resume that gets past the first 6 seconds

Recruiters skim. The Psst resume coach fixes what makes them skip you, line by line. Premium then shapes it for the exact job you're applying to.

  • 1Every line checkedWeak starts, clichés and AI-sounding phrases flagged, with a 3-question fix.
  • 2Tailored to the jobSee which skills and tools from the ad your resume is missing. Try it free on one of your matches.
  • 3Ready for remoteTime zone, tools and proof you work on your own, the things remote teams look for.
  • 4Looks the partOne page and an ATS-safe PDF, free. Premium adds 6 designs, 8 colours and a matching cover letter.
Try the resume coach →Compare Premium

Set up your job alert