QA Analyst - LOIS for Word
Company shown to members 🔒 · Remote · Location not stated
Apply free: 3 jobs are on us✨ Tailor my resume for this job🎤 Practise the interview question, free
✓ Straight from the company's own careers page. No middlemen, no “we'll send you a check for equipment”. How we check jobs
✓ Sent 100 applications and heard nothing? Make this one count: tailor your resume to this ad in one tap, free.
✨ Not sure this is the one? Get your remote job matches in 30 seconds →
First recorded by Psst: 2 November 2026. Your first 3 jobs are free to apply to (the first right away, 2 more with your email). After that, the company and the apply link are for Psst members, from $4.99 for 7 days.
Practise the first interview question for this job
If the company replies, the first call usually starts with a question like this. Vague answers are the easiest to reject. Write yours and get an AI score in under a minute.
The 20-second read
- Experience
- 2+ years required
- Where you can live
- Location not stated
- Skills and tools
- ci/cd, qa, written communication
- Job type
- Full-time
Read from the ad by Psst's rules. Check the full ad below before applying.
Job details
- Where you can work
- Location not stated
- Employment type
- Full-time
- Advertised pay
- $105K–150K/yr
- Experience
- 2+ years required
- Employer publication date
- 1 June 2026
- First recorded by Psst
- 2 November 2026
- Last checked at the source
- 10 November 2026
About the job
The company is a Legal AI company delivering Legal Operating Intelligence for the future of legal work. Grounded in a singular system of truth, the company brings together data, documents, workflows, and teams into one unified platform—where modern legal work happens with clarity and consistency.
Powered by LOIS, the Legal Operating Intelligence System, the company connects context across every matter to transform legal operations from reactive to proactive. LOIS reads, understands, and reasons across your data to surface insight, automate complexity, and give professionals the clarity and confidence to see more, know more, and do more. Fueled by a team of exceptional collaborators and innovators, the company’s rapid growth has earned AI awards and recognition from Deloitte and Inc. as one of the most innovative and fastest-growing technology companies in the country.
Role Summary
This role owns quality for LOIS for Word, the company's AI-powered legal drafting product. You'll help build and own the QA function: the test strategy, the process, and the automation. You'll work at the intersection of legal AI and product quality, evaluating everything from AI output accuracy to UI behavior across the product. A big part of this role is moving quality upstream, so it's built into how features are planned and shipped from the start.
The ideal candidate has 2+ years of QA experience, brings a sharp eye for both functional bugs and AI quality issues, is comfortable building from scratch in ambiguity, and gets genuinely uncomfortable shipping something they haven't tried to break.
What You'll Do
•
Define and own the test strategy, process, and QA playbook for the product
•
Move QA upstream by partnering with product and engineering early, so test plans are ready before features ship
•
Evaluate AI output quality across dimensions like accuracy, citation reliability, and appropriately scoped reasoning
•
Design and maintain evaluation sets that account for non-deterministic output and catch regressions over time
•
Test how AI-generated edits apply to documents, including accuracy and formatting fidelity across document structures
•
Build automated guardrails integrated into CI/CD that cover critical flows
•
Write structured, reproducible bug reports
•
Partner with legal domain experts to understand how different customer types use the product, and translate that into test coverage
•
Approach QA with a product and design mindset. If something works but could be better, we want to hear it
•
Compare behavior across product surfaces and document discrepancies
What You'll Need
•
2+ years of QA experience, including ownership of test strategy for a product or major feature area
•
Track record of building QA process and automation from scratch in a fast-moving environment
•
Comfort operating in high ambiguity, where features ship quickly and you figure out how to test them fast
•
Strong analytical and problem-solving skills, with attention to both functional correctness and AI output quality
•
Ability to reason about non-deterministic systems and define what "correct" means when there's no single right answer
•
Excellent written communication, with the ability to write clear, concise, actionable bug reports backed by evidence
•
Experience with bug tracking tools and test management workflows
Nice To Have
•
Experience testing AI or LLM-based products, especially for output accuracy and eval design
•
CI/CD experience setting up pipelines and release gates for automated tests
•
A design or UX sensibility, with an eye for where product workflows could be smoother
•
Prior experience in legal technology or comfort reading legal contracts
•
Programming experience beyond test automation
Compensation Information: $105,000 - $150,000
The salary range represents the low and high end of the salary range for this position. The total compensation package for this position will be determined by each individual’s location, qualifications, education, work experience, skills and performance.
An individual’s final offer will be weighted by their primary work location and expertise.
Cool Company Benefits
- A dynamic, rapidly growing company, focused on helping organizations thrive
- Medical, Dental, & Vision Insurance (for full-time employees)
- Competitive & Fair Pay
- Maternity & paternity leave (for full-time employees)
- Short & long-term disability
- Opportunity to learn from a dedicated leadership team
- Top-of-the-line company swag
Privacy Policy Notice
The company will handle your personal information according to what’s outlined in our Privacy Policy.
Communication about this opportunity, or any open role at the company, will only come from representatives with email addresses using "the company". Other addresses reaching out are not affiliated with the company and should not be responded to.
Apply free: 3 jobs are on us✨ Tailor my resume for this jobPrepare with the Apply kitMore remote QA tester jobs →
- Open 5 months
A resume that gets past the first 6 seconds
Recruiters skim. The Psst resume coach fixes what makes them skip you, line by line, and one tap tailors it to the exact job you're applying to.
- 1Every line checkedWeak starts, clichés and AI-sounding phrases flagged, with a 3-question fix.
- 2Tailored to the jobSee which skills and tools from the ad your resume is missing. Try it free on one of your matches.
- 3Ready for remoteTime zone, tools and proof you work on your own, the things remote teams look for.
- 4Looks the partOne page, 6 designs, 8 colours and a matching cover letter, free to build. Premium downloads the PDF and Word files.
Example with made-up details. The score is the builder's own check, not an ATS rating or a promise of an interview.