QA Automation Engineer - AI

📋 Description Develop and execute end-to-end automated test coverage across evaluations, APIs, UIs, and Implement testing strategies for GenAI features, including conversational AI, agentic systems, and Run and maintain automated test suites for prompt testing, including regression tests designed to Support and maintain evaluation frameworks to measure GenAI performance across accuracy, relevance Contribute to curating high-quality test datasets and "golden examples" that represent diverse user Assist with adversarial testing to identify potential model hallucinations or biases, and support 🎯 Requirements Solid QA or test engineering experience, with exposure to or a keen interest in AI/ML systems. Hands-on Python coding experience. Good understanding of GenAI technologies including LLMs, prompt engineering, and AI application Solid experience with test automation frameworks and scripting (Python, Pytest, API, and UI Practical knowledge of software testing methodologies (functional, integration, regression Ability to execute test cases and evaluate criteria for non-deterministic systems.