Quality Assurance Engineer – Conversational AI & Voice Testing
Company shown to members 🔒 · Remote · US, Canada only
Apply free: 3 jobs are on us✨ Tailor my resume for this job🎤 Practise the interview question, free
✓ Straight from the company's own careers page. No middlemen, no “we'll send you a check for equipment”. How we check jobs
✓ Sent 100 applications and heard nothing? Make this one count: tailor your resume to this ad in one tap, free.
✨ Not sure this is the one? Get your remote job matches in 30 seconds →
First recorded by Psst: 29 October 2026. Your first 3 jobs are free to apply to (the first right away, 2 more with your email). After that, the company and the apply link are for Psst members, from $4.99 for 7 days.
Practise the first interview question for this job
If the company replies, the first call usually starts with a question like this. Vague answers are the easiest to reject. Write yours and get an AI score in under a minute.
The 20-second read
- Experience
- 5+ years required
- Where you can live
- US, Canada only
- Skills and tools
- aws, ci/cd, documentation, quality assurance, qa, troubleshooting
- Job type
- Full-time
Read from the ad by Psst's rules. Check the full ad below before applying.
Job details
- Where you can work
- United States, Canada
- Employment type
- Full-time
- Advertised pay
- Not stated by the employer
- Experience
- 5+ years required
- Employer publication date
- 28 October 2026
- First recorded by Psst
- 29 October 2026
- Last checked at the source
- 10 November 2026
About the job
Join our team as a Quality Assurance Engineer focused on validating next-generation conversational and voice-based customer experience solutions. In this role, you will ensure the quality, reliability, and accuracy of intelligent virtual assistants, voice applications, and customer engagement platforms by testing conversational flows, integrations, automation, and end-to-end customer journeys. This is an exciting opportunity to work with cutting-edge AI technologies, collaborate with cross-functional teams, and help deliver seamless, high-quality customer experiences at scale.
Responsibilities
- Design, develop, and execute functional, regression, integration, and end-to-end test scenarios for conversational AI, voice, and customer interaction solutions.
- Validate conversational flows, intent recognition, entities, utterances, response accuracy, escalation paths, and exception handling.
- Create and maintain automated test suites to improve testing coverage, efficiency, and release quality.
- Test voice and telephony interactions, including speech recognition, touch-tone inputs, call routing, transfers, and customer journey workflows.
- Validate integrations between conversational platforms, backend systems, APIs, and third-party services.
- Perform system-level and user journey testing to ensure seamless customer experiences across multiple channels.
- Identify, document, track, and verify defects while collaborating closely with developers, solution architects, business analysts, and product teams.
- Develop comprehensive test plans, test cases, execution reports, and quality metrics.
- Participate in requirements reviews and provide quality-focused feedback early in the development lifecycle.
- Ensure applications meet established quality standards, functional requirements, performance expectations, and customer experience goals.
- Contribute to test process improvements, automation strategies, and continuous quality initiatives.
- 5+ years of experience in Quality Assurance, with hands-on experience testing conversational AI, IVR, voice applications, or customer engagement platforms.
- 3+ years of hands-on experience with Cyara Cruncher, Cyara Velocity, and Cyara Virtual Agent for test design, execution, automation, and reporting.
- Experience testing conversational AI solutions using AWS Lex and/or Google Dialogflow CX/ES, including intent recognition, conversation flows, and response validation.
- Strong knowledge of functional, regression, integration, system, and end-to-end testing methodologies.
- Deep understanding of conversational AI concepts, including NLU, intents, entities, utterances, context management, fallback handling, and escalation workflows.
- Hands-on experience validating IVR and voice interactions, including speech recognition, DTMF inputs, call routing, transfers, and call termination scenarios.
- Experience testing APIs, backend integrations, data exchanges, and contact center workflows across enterprise applications.
- Strong experience in test planning, test case design, defect management, execution reporting, and quality assurance best practices.
- Excellent analytical, troubleshooting, communication, stakeholder collaboration, and documentation skills.
Nice To Have
- Experience with performance, load, stress, and scalability testing of conversational AI and voice applications.
- Familiarity with SIP, telephony protocols, speech recognition technologies, DTMF, and call-routing concepts.
- Experience with test automation frameworks, API testing tools, and CI/CD-enabled QA practices.
- Exposure to Amazon Connect, Genesys Cloud, or other contact center platforms.
- Knowledge of conversational analytics, customer experience monitoring, and AI-driven customer engagement solutions.
We offer
- Culture of Relentless Performance : join an unstoppable technology development team with a 99% project success rate and more than 30% year-over-year revenue growth.
- Competitive Pay and Benefits : enjoy a comprehensive compensation and benefits package, including health insurance, language courses, and a relocation program.
- Work From Anywhere Culture : make the most of the flexibility that comes with remote work.
- Growth Mindset : reap the benefits of a range of professional development opportunities, including certification programs, mentorship and talent investment programs, internal mobility and internship opportunities.
- Global Impact : collaborate on impactful projects for top global clients and shape the future of industries.
- Welcoming Multicultural Environment : be a part of a dynamic, global team and thrive in an inclusive and supportive work environment with open communication and regular team-building company social events.
- Social Sustainability Values : join our sustainable business practices focused on five pillars, including IT education, community empowerment, fair operating practices, environmental sustainability, and gender equality.
All your information will be kept confidential according to EEO guidelines.
The company helps visionaries change the world. We are a global IT services and consulting company that brings together enterprise and start-up innovation. Today, we support digital transformation for some of the world's largest enterprises. By partnering with both large and small players, we stay at the leading edge of technology, remain nimble even as a global leader, and create technology that helps our clients further enhance their business. We are a values-driven organization and our culture of Relentless Performance has enabled over 99% of the company's engagements to succeed by meeting or exceeding scope, schedule, and budget objectives since our inception in 1989.
The company has coverage across five continents and operates in 25 countries worldwide. With nearly 1,000 full-time professionals and an annual growth rate exceeding 25%, we continue to deliver innovative technology solutions to global enterprises.
Apply free: 3 jobs are on us✨ Tailor my resume for this jobPrepare with the Apply kitMore remote QA tester jobs →
- No pay listed
A resume that gets past the first 6 seconds
Recruiters skim. The Psst resume coach fixes what makes them skip you, line by line, and one tap tailors it to the exact job you're applying to.
- 1Every line checkedWeak starts, clichés and AI-sounding phrases flagged, with a 3-question fix.
- 2Tailored to the jobSee which skills and tools from the ad your resume is missing. Try it free on one of your matches.
- 3Ready for remoteTime zone, tools and proof you work on your own, the things remote teams look for.
- 4Looks the partOne page, 6 designs, 8 colours and a matching cover letter, free to build. Premium downloads the PDF and Word files.
Example with made-up details. The score is the builder's own check, not an ATS rating or a promise of an interview.