LATAM Software Engineers: Coding Tasks for AI Evaluation
Company shown to members 🔒 · Remote · Argentina only
Apply free: 3 jobs are on us✨ Tailor my resume for this job🎤 Practise the interview question, free
✓ Straight from the company's own careers page. No middlemen, no “we'll send you a check for equipment”. How we check jobs
✓ Sent 100 applications and heard nothing? Make this one count: tailor your resume to this ad in one tap, free.
✨ Not sure this is the one? Get your remote job matches in 30 seconds →
First recorded by Psst: 12 October 2026. Your first 3 jobs are free to apply to (the first right away, 2 more with your email). After that, the company and the apply link are for Psst members, from $4.99 for 7 days.
Practise the first interview question for this job
If the company replies, the first call usually starts with a question like this. Vague answers are the easiest to reject. Write yours and get an AI score in under a minute.
The 20-second read
- Experience
- Experience not stated
- Where you can live
- Argentina only
- Skills and tools
- quality assurance
- Job type
- Contract or freelance
Read from the ad by Psst's rules. Check the full ad below before applying.
Job details
- Where you can work
- Argentina
- Employment type
- Contract
- Advertised pay
- $40/hr
- Experience
- Experience not stated
- Employer publication date
- 1 October 2026
- First recorded by Psst
- 12 October 2026
- Last checked at the source
- 11 November 2026
About the job
WHAT WE'RE RESEARCHING
We're running a paid study on the effectiveness of coding tasks used to evaluate AI agents. Our team is building a comprehensive suite of programming environments designed to test complex software capabilities. We want to ensure these evaluation frameworks are realistic, accurate, and properly calibrated.
HOW IT WORKS
You will review a series of proposed coding tasks and assess their suitability for testing AI agents. We will ask you to verify the logic of the evaluation harnesses and provide feedback on their realistic application. You will share your screen to walk through the environments and point out potential flaws or improvements. The session involves a mix of code review, technical discussion, and direct feedback on the task structures.
WHO THIS IS FOR
We are looking for software engineers based in Brazil and Argentina with strong technical backgrounds. You should have direct experience building, reviewing, or testing evaluation harnesses and programming tasks. We welcome backend developers, full-stack engineers, and quality assurance automation specialists.
WHAT YOU'LL DO
- Review realistic programming tasks designed for AI evaluation
- Assess the accuracy and structure of various evaluation harnesses
- Walk us through your thought process while checking code validity
- Provide actionable feedback on how to improve task complexity and realism
WHO SHOULD APPLY
- Professional experience as a software engineer or developer
- Located in Brazil or Argentina
- Familiarity with building or verifying coding tasks and test environments
- Comfortable discussing technical architectures and evaluation frameworks
COMPENSATION
$40 per hour
READY TO PARTICIPATE?
Start your paid interview now [link for members]
ABOUT the company
The company is building the world's largest pool of vetted human experts for AI. Researchers, AI labs, and product teams use the company to recruit, screen, and pay study participants across industries, languages, and skill sets.
Learn more at the company [link for members] or on YouTube at @jointerac [link for members]
Apply free: 3 jobs are on us✨ Tailor my resume for this jobPrepare with the Apply kitMore remote software engineer jobs →
Posted recently with nothing unusual.
Signals, not proof. Check the company's page before you spend time on it.Similar remote jobs
- Software Engineering AI Trainer (Germany)Brazil, Argentina, Chile only
- TypeScript Coding Specialist - Freelance AI Trainer ProjectWork from anywhere
- Rust Coding Specialist - Freelance AI Trainer ProjectWork from anywhere
- CAD Engineer - AI TrainerUS, Canada, Argentina only
- CFD Engineer - AI TrainerUS, Canada, Argentina only
Explore more jobs
A resume that gets past the first 6 seconds
Recruiters skim. The Psst resume coach fixes what makes them skip you, line by line, and one tap tailors it to the exact job you're applying to.
- 1Every line checkedWeak starts, clichés and AI-sounding phrases flagged, with a 3-question fix.
- 2Tailored to the jobSee which skills and tools from the ad your resume is missing. Try it free on one of your matches.
- 3Ready for remoteTime zone, tools and proof you work on your own, the things remote teams look for.
- 4Looks the partOne page, 6 designs, 8 colours and a matching cover letter, free to build. Premium downloads the PDF and Word files.
Example with made-up details. The score is the builder's own check, not an ATS rating or a promise of an interview.