LLM Model Response Evaluation
Lifted, an Upwork Company™ · Remote · US only
Apply on Lifted, an Upwork Company™'s site✨ Tailor my resume for this jobPrepare with the Apply kit
First recorded by Psst: 3 November 2026. Sign in with Google to continue to the employer. A free account is enough.
The 20-second read
- Experience
- 3+ years required
- Where you can live
- US only
- Degree or licence
- Mentioned (bachelor's)
- Job type
- Contract or freelance
Read from the ad by Psst's rules. Check the full ad below before applying.
Job details
- Where you can work
- United States
- Employment type
- Contract
- Advertised pay
- Not stated by the employer
- Experience
- 3+ years required
- Employer publication date
- 6 August 2026
- First recorded by Psst
- 3 November 2026
- Last checked at the source
- 4 November 2026
About the job
Experience level: not applicable.
- Evaluating UI widgets, infographics, image factuality, side-by-side comparisons, and similar AI evaluation activities.
- The work may involve text, images, audio, video, HTML widgets, PDFs, or combinations of these modalities.
- The work is domain-agnostic and may cover topics across arts, culture, history, science, engineering, and more.
- Resources will be expected to independently research unfamiliar topics using trusted sources before making evaluation decisions.
- Each task will include detailed project guidelines within the evaluation platform.
- 3+ years of hands-on experience in LLM / GenAI data evaluation.
- Bachelor's Degree required
- Ability to research unfamiliar topics using trusted sources and make well-supported judgments.
- Comfortable evaluating content across multiple modalities
Flexible and remote work
Variable workload: Accept or decline tasks based on your availability
No guaranteed hours: Workload may vary weekly
Our client, a global technology company that helps businesses build, train, and manage AI systems is looking for experts to evaluate model-generated content against defined quality rubrics such as factuality, consistency, aesthetics, and other evaluation criteria.
Apply on Lifted, an Upwork Company™'s site✨ Tailor my resume for this jobMore remote machine learning and AI engineer jobs →
- Open 3 months
- No pay listed
A resume that gets past the first 6 seconds
Recruiters skim. The Psst resume coach fixes what makes them skip you, line by line. Premium then shapes it for the exact job you're applying to.
- 1Every line checkedWeak starts, clichés and AI-sounding phrases flagged, with a 3-question fix.
- 2Tailored to the jobSee which skills and tools from the ad your resume is missing. Try it free on one of your matches.
- 3Ready for remoteTime zone, tools and proof you work on your own, the things remote teams look for.
- 4Looks the partOne page and an ATS-safe PDF, free. Premium adds 6 designs, 8 colours and a matching cover letter.
Example with made-up details. The score is the builder's own check, not an ATS rating or a promise of an interview.