Evaluators for AI training (English language)

Company shown to members 🔒 · Remote · Location not stated

Location not statedEntry-level (years not stated)Published 23 May 2024Ghost risk: high

🔒 See the company and apply✨ Tailor my resume for this job🎤 Practise the interview question, free

✓ Straight from the company's own careers page. No middlemen, no “we'll send you a check for equipment”. How we check jobs

✓ Sent 100 applications and heard nothing? Make this one count: tailor your resume to this ad in one tap, free.

✨ Not sure this is the one? Get your remote job matches in 30 seconds →

First recorded by Psst: 9 November 2026. The company's name and the apply link are for Psst members, from $4.99 for 7 days.

Free interview practice

Practise the first interview question for this job

If the company replies, the first call usually starts with a question like this. Vague answers are the easiest to reject. Write yours and get an AI score in under a minute.

The 20-second read

Experience
Entry-level (years not stated)
Where you can live
Location not stated
Languages
English
Job type
Contract or freelance

Read from the ad by Psst's rules. Check the full ad below before applying.

Job details

Where you can work
Location not stated
Employment type
Contract
Advertised pay
Not stated by the employer
Experience
Entry-level (years not stated)
Employer publication date
23 May 2024
First recorded by Psst
9 November 2026
Last checked at the source
10 November 2026

About the job

We are seeking a meticulous and detail-oriented Evaluator to join our team focused on training one AI agent. In this role, you will be reviewing and evaluating replies of the AI agent (the training is provided).

The end goal is to prevent AI agent from sharing any harmful, offensive, dangerous or toxic content to the end users and make it safer.

Full online training is provided.

The role is fully remote with the possibility of having a flexible schedule.

We are open to both full-time and part-time candidates.

Requirements

  • at least B2+ level of English (needed mainly for reading and a bit for writing, no significant speaking is planned)
  • attention to detail
  • time-management skills
  • proactive approach
  • curious mind

Responsibilities

  • evaluate replies of the AI agent according to the provided guidelines
  • recognize and evaluate differences between two possible responses to a request
  • compare the responses overall by determining which response is better in general, by how much, and then giving each response an absolute overall rating

🔒 See the company and apply✨ Tailor my resume for this jobPrepare with the Apply kit

Find my remote job matches →
Ghost Job Detector: Ghost risk: high
  • Open over a year (901 days)
  • No pay listed
Signals, not proof. Check the company's page before you spend time on it.
Free to build · no sign-up

A resume that gets past the first 6 seconds

Recruiters skim. The Psst resume coach fixes what makes them skip you, line by line, and one tap tailors it to the exact job you're applying to.

  • 1Every line checkedWeak starts, clichés and AI-sounding phrases flagged, with a 3-question fix.
  • 2Tailored to the jobSee which skills and tools from the ad your resume is missing. Try it free on one of your matches.
  • 3Ready for remoteTime zone, tools and proof you work on your own, the things remote teams look for.
  • 4Looks the partOne page, 6 designs, 8 colours and a matching cover letter, free to build. Premium downloads the PDF and Word files.
Try the resume coach →Compare Premium

Set up your job alert