Quality Assurance Lead
CirrusLabs
Job Description
We are CirrusLabs . Our vision is to become the world's most sought-after niche digital transformation company that helps customers realize value through innovation. Our mission is to co-create success with our customers, partners and community.
Our goal is to enable employees to dream, grow and make things happen. We are committed to excellence. We are a dependable partner organization that delivers on commitments.
We strive to maintain integrity with our employees and customers. Every action we take is driven by value. The core of who we are is through our well-knit teams and employees.
You are the core of a values driven organization. You have an entrepreneurial spirit. You enjoy working as a part of well-knit teams.
You value the team over the individual. You welcome diversity at work and within the greater community. You aren't afraid to take risks.
You appreciate a growth path with your leadership team that journeys how you can grow inside and outside of the organization. You thrive upon continuing education programs that your company sponsors to strengthen your skills and for you to become a thought leader ahead of the industry curve. You are excited about creating change because your skills can help the greater good of every customer, industry and community.
We are hiring a talented to join our team. If you're excited to be part of a winning team, CirrusLabs ( http://www.cirruslabs.io ) is a great place to grow your career. QA Lead – AI Assurance Platform Exp: 5+ years Location: Bangalore Shift Time: 12 -9 PM IST Role Summary We are looking for a QA Lead (5–8 years experience) to drive quality engineering for RAIA, our AI Assurance and Evaluation platform.
The ideal candidate should have strong experience in test strategy, test planning, test automation, and modern web application testing, along with exposure to AI/LLM-based applications. This role will be responsible for establishing QA processes, building automation frameworks, and ensuring the reliability, security, and performance of both traditional application features and AI-driven capabilities. Key Responsibilities Define and own the overall QA Strategy, Test Plan, and Automation Roadmap for the platform.
Establish testing processes across the SDLC including functional, integration, regression, performance, security, and UAT testing. Design and implement automated test suites using Playwright . Create and maintain test cases, test scenarios, and test data for UI, API, and backend services.
Collaborate closely with Product Managers, Developers, and Architects to ensure quality is built into the development lifecycle. Lead release validation activities and drive defect triage and resolution. Define quality metrics, test coverage goals, and release readiness criteria.
Mentor QA engineers and promote QA best practices across the team. Evaluate and recommend testing tools, frameworks, and CI/CD quality gates. AI Testing Responsibilities Design and execute test strategies for AI-powered features, agentic workflows, and LLM integrations.
Validate AI evaluation outputs for quality, consistency, safety, and reliability. Define test datasets, evaluation scenarios, and acceptance criteria for AI use cases. Perform prompt, workflow, and integration testing for AI agents and evaluation pipelines.
Collaborate with engineering teams to establish repeatable AI testing and regression validation processes. Required Skills 5–8 years of experience in Software Quality Assurance and Test Automation. Strong hands-on experience with Playwright for UI automation.
Experience testing REST APIs using tools such as Postman, Swagger, or equivalent frameworks. Experience creating Test Strategy , Test Plan , and Automation Strategy documents. Strong understanding of SDLC, STLC, Agile, and CI/CD practices.
Experience with test management and defect tracking tools (e.g., Jira, Azure DevOps). Good understanding of database testing and SQL. Experience defining quality metrics and release readiness criteria.
Preferred Skills Hands-on experience using AI-assisted development tools such as Claude, GitHub Copilot, Cursor, or equivalent AI coding assistants to accelerate test case creation, automation scripting, test data generation, and QA productivity. Ability to effectively leverage AI tools for generating and reviewing automation scripts while ensuring code quality, maintainability, and accuracy through human validation. Experience testing AI/LLM, Agentic AI, ML, or GenAI applications.
Exposure to AI evaluation concepts such as quality, safety, performance, hallucination, and response validation. Experience with performance and load testing tools. Familiarity with AWS cloud environments and modern SaaS applications.
Experience testing event-driven and microservices-based architectures. What Success Looks Like Established QA strategy and automation roadmap within the first 90 days. High automation coverage for critical user journeys and APIs.
Consistent release quality with reduced production defects. Repeatable testing framework for both platform and AI evaluation capabilities. Clear quality metrics and test reporting adopted across engineering teams.