Sr QA Engineer - Voice AI

Description

Job Summary: We are looking for a QA Engineer with an ownership mindset to build and optimize the QA process from scratch on an AI agent platform, ensuring the quality of customer interactions. Key Highlights: 1. Owner of the QA process, building it from scratch 2. Direct impact on thousands of calls per day 3. Autonomy and ownership over structure and bureaucracy About Kleva Kleva is an AI-powered agent platform that automates collections management. We build intelligent systems capable of deciding when and how to contact customers, as well as holding real conversations with them. We do not build simple automated bots. https://youtu.be/PtoAX02XuO8 About the Role We are seeking the person who will own the QA process at Kleva, building it from scratch on BlueJay. This is not a dev role that performs tests on the side — it is someone who lives and breathes quality, who will define what gets tested, how it gets tested, and ensure nothing reaches production without passing through their process. You will be responsible for ensuring our voice agents function flawlessly before contacting a real debtor: that the call flow is correct, that negotiation follows the client’s logic, that integrations do not break, and that the system handles volume. Responsibilities * Optimize and scale the full QA process on BlueJay * End-to-end testing of voice agents: call flow, speech recognition, negotiation logic, payment promises * Automate regression tests for the voice pipeline (VAD, AMD, TTS, turn detection) * Validate multi-tenant configurations (each client has distinct scripts and rules) * API and integration testing with client systems (portfolio loading, payment confirmation) * Load testing before major releases to ensure stability under volume * Bug tracking and QA process management across releases * Define quality metrics and report the status of each release Consider applying if... * You are obsessive about quality. * You want direct impact: what you test affects thousands of calls per day. * You prefer autonomy and ownership over structure and bureaucracy. We are not a good fit if... * You need someone to tell you exactly what to test each day. * You are looking for a role where QA is secondary to development. * You are uncomfortable working with ambiguity. In early-stage environments, things change rapidly. **Requirements** * 2–4 years of QA experience, ideally in SaaS or fintech * Hands-on experience with automation tools (Playwright, Selenium, Postman, or similar) * Comfort with APIs, logs, and debugging * Ability to design testing processes, not just execute them * Ownership mindset Desirable * Experience with voice products, telephony, or AI * Knowledge of voice pipelines (TTS, STT, VAD, AMD) * Experience with BlueJay or other QA platforms for voice/conversational AI * Background in collections or fintech * Experience in early-stage startups **Benefits** * Competitive USD salary * Three weeks of paid vacation per year * Hubs in Buenos Aires and Mexico City for those opting for a hybrid model, with fully remote options available * In every interaction, we value results over egos or hierarchies