Quality Assurance Engineer – Conversational AI & Voice Testing

Company shown to members 🔒 · Remote · US, Canada only

US, Canada only5+ years requiredPublished 28 October 2026Looks fresh

Apply free: 3 jobs are on us✨ Tailor my resume for this job🎤 Practise the interview question, free

✓ Straight from the company's own careers page. No middlemen, no “we'll send you a check for equipment”. How we check jobs

✓ Sent 100 applications and heard nothing? Make this one count: tailor your resume to this ad in one tap, free.

✨ Not sure this is the one? Get your remote job matches in 30 seconds →

First recorded by Psst: 29 October 2026. Your first 3 jobs are free to apply to (the first right away, 2 more with your email). After that, the company and the apply link are for Psst members, from $4.99 for 7 days.

Free interview practice

Practise the first interview question for this job

If the company replies, the first call usually starts with a question like this. Vague answers are the easiest to reject. Write yours and get an AI score in under a minute.

The 20-second read

Experience
5+ years required
Where you can live
US, Canada only
Skills and tools
aws, ci/cd, documentation, quality assurance, qa, troubleshooting
Job type
Full-time

Read from the ad by Psst's rules. Check the full ad below before applying.

Job details

Where you can work
United States, Canada
Employment type
Full-time
Advertised pay
Not stated by the employer
Experience
5+ years required
Employer publication date
28 October 2026
First recorded by Psst
29 October 2026
Last checked at the source
10 November 2026

About the job

Join our team as a Quality Assurance Engineer focused on validating next-generation conversational and voice-based customer experience solutions. In this role, you will ensure the quality, reliability, and accuracy of intelligent virtual assistants, voice applications, and customer engagement platforms by testing conversational flows, integrations, automation, and end-to-end customer journeys. This is an exciting opportunity to work with cutting-edge AI technologies, collaborate with cross-functional teams, and help deliver seamless, high-quality customer experiences at scale.

Responsibilities

  • Design, develop, and execute functional, regression, integration, and end-to-end test scenarios for conversational AI, voice, and customer interaction solutions.
  • Validate conversational flows, intent recognition, entities, utterances, response accuracy, escalation paths, and exception handling.
  • Create and maintain automated test suites to improve testing coverage, efficiency, and release quality.
  • Test voice and telephony interactions, including speech recognition, touch-tone inputs, call routing, transfers, and customer journey workflows.
  • Validate integrations between conversational platforms, backend systems, APIs, and third-party services.
  • Perform system-level and user journey testing to ensure seamless customer experiences across multiple channels.
  • Identify, document, track, and verify defects while collaborating closely with developers, solution architects, business analysts, and product teams.
  • Develop comprehensive test plans, test cases, execution reports, and quality metrics.
  • Participate in requirements reviews and provide quality-focused feedback early in the development lifecycle.
  • Ensure applications meet established quality standards, functional requirements, performance expectations, and customer experience goals.
  • Contribute to test process improvements, automation strategies, and continuous quality initiatives.
  • 5+ years of experience in Quality Assurance, with hands-on experience testing conversational AI, IVR, voice applications, or customer engagement platforms.
  • 3+ years of hands-on experience with Cyara Cruncher, Cyara Velocity, and Cyara Virtual Agent for test design, execution, automation, and reporting.
  • Experience testing conversational AI solutions using AWS Lex and/or Google Dialogflow CX/ES, including intent recognition, conversation flows, and response validation.
  • Strong knowledge of functional, regression, integration, system, and end-to-end testing methodologies.
  • Deep understanding of conversational AI concepts, including NLU, intents, entities, utterances, context management, fallback handling, and escalation workflows.
  • Hands-on experience validating IVR and voice interactions, including speech recognition, DTMF inputs, call routing, transfers, and call termination scenarios.
  • Experience testing APIs, backend integrations, data exchanges, and contact center workflows across enterprise applications.
  • Strong experience in test planning, test case design, defect management, execution reporting, and quality assurance best practices.
  • Excellent analytical, troubleshooting, communication, stakeholder collaboration, and documentation skills.

Nice To Have

  • Experience with performance, load, stress, and scalability testing of conversational AI and voice applications.
  • Familiarity with SIP, telephony protocols, speech recognition technologies, DTMF, and call-routing concepts.
  • Experience with test automation frameworks, API testing tools, and CI/CD-enabled QA practices.
  • Exposure to Amazon Connect, Genesys Cloud, or other contact center platforms.
  • Knowledge of conversational analytics, customer experience monitoring, and AI-driven customer engagement solutions.

We offer

  • Culture of Relentless Performance : join an unstoppable technology development team with a 99% project success rate and more than 30% year-over-year revenue growth.
  • Competitive Pay and Benefits : enjoy a comprehensive compensation and benefits package, including health insurance, language courses, and a relocation program.
  • Work From Anywhere Culture : make the most of the flexibility that comes with remote work.
  • Growth Mindset : reap the benefits of a range of professional development opportunities, including certification programs, mentorship and talent investment programs, internal mobility and internship opportunities.
  • Global Impact : collaborate on impactful projects for top global clients and shape the future of industries.
  • Welcoming Multicultural Environment : be a part of a dynamic, global team and thrive in an inclusive and supportive work environment with open communication and regular team-building company social events.
  • Social Sustainability Values : join our sustainable business practices focused on five pillars, including IT education, community empowerment, fair operating practices, environmental sustainability, and gender equality.

All your information will be kept confidential according to EEO guidelines.

The company helps visionaries change the world. We are a global IT services and consulting company that brings together enterprise and start-up innovation. Today, we support digital transformation for some of the world's largest enterprises. By partnering with both large and small players, we stay at the leading edge of technology, remain nimble even as a global leader, and create technology that helps our clients further enhance their business. We are a values-driven organization and our culture of Relentless Performance has enabled over 99% of the company's engagements to succeed by meeting or exceeding scope, schedule, and budget objectives since our inception in 1989.

The company has coverage across five continents and operates in 25 countries worldwide. With nearly 1,000 full-time professionals and an annual growth rate exceeding 25%, we continue to deliver innovative technology solutions to global enterprises.

Apply free: 3 jobs are on us✨ Tailor my resume for this jobPrepare with the Apply kitMore remote QA tester jobs →

Find my remote job matches →
Ghost Job Detector: Looks fresh
  • No pay listed
Signals, not proof. Check the company's page before you spend time on it.
Free to build · no sign-up

A resume that gets past the first 6 seconds

Recruiters skim. The Psst resume coach fixes what makes them skip you, line by line, and one tap tailors it to the exact job you're applying to.

  • 1Every line checkedWeak starts, clichés and AI-sounding phrases flagged, with a 3-question fix.
  • 2Tailored to the jobSee which skills and tools from the ad your resume is missing. Try it free on one of your matches.
  • 3Ready for remoteTime zone, tools and proof you work on your own, the things remote teams look for.
  • 4Looks the partOne page, 6 designs, 8 colours and a matching cover letter, free to build. Premium downloads the PDF and Word files.
Try the resume coach →Compare Premium

Set up your job alert