Jobs · justjoinit

QA Engineer – Agentic Memory Testing
Intellias · Poland · Posted 14d ago
About the role
We are looking for a QA Engineer to validate agent memory capabilities within an enterprise AI Agent Platform being built from the ground up. The role will focus on ensuring that AI agents reliably retain, retrieve, and manage contextual information across both individual conversations and multiple sessions.You will test stateful and personalized agent behaviors, memory extraction and retrieval, lifecycle controls, and regression scenarios to ensure that memory improves agent performance without introducing incorrect or irrelevant context.About the ClientOur client is a large global enterprise operating across multiple markets, with a complex technology landscape and a strong focus on digital transformation and innovation. The organization is actively investing in modern cloud, data, and AI capabilities to enable scalable, secure, and highly automated solutions across its business.About the ProjectThe project is focused on building an enterprise-grade AI Agent Platform from the ground up. The platform will provide a standardized foundation for developing, deploying, orchestrating, securing, and observing AI agents across multiple teams and use cases.The initiative covers the full agent lifecycle and brings together agent orchestration, observability, security, governance, integrations, evaluation, and platform engineering. Engineers joining the project will have an opportunity to influence key architectural and technical decisions and contribute to a new platform rather than maintaining an existing solution.ResponsibilitiesDesign and execute functional tests for short-term and long-term agent memory.Validate in-session context continuity and cross-session memory recall.Test memory extraction strategies to ensure that summaries, facts, and preferences are captured correctly.Validate memory retrieval to ensure agents retrieve relevant context while filtering irrelevant information.Test memory lifecycle behaviors, including TTL expiration, deletion, and namespace isolation.Develop Python-based automated tests for agent memory workflows and API-driven services.Perform regression testing to ensure memory changes do not negatively affect agent response quality.Validate stateful agent behaviors including context retention and personalization.Test memory isolation to prevent inappropriate context sharing between users, sessions, or agents.Validate user deletion and privacy-related memory workflows.Integrate memory testing into broader agent quality and regression suites.Collaborate with AI and platform engineers to identify memory-related defects and improve agent reliability.QualificationsSkills:Agent memory functional testing — short-term memory (in-session continuity), long-term memory (cross-session recall)Memory extraction validation — verify Summary and Semantic strategies extract correct facts/preferencesMemory retrieval testing — validate agents retrieve relevant context, filter irrelevant memoriesMemory lifecycle testing — TTL expiration, user deletion, namespace isolationAgent regression testing — verify memory does not degrade agent response qualityPython test automation for memory workflowsExperience:4+ years QA engineering for AI/ML or conversational AI systemsTesting stateful agent behaviors (context retention, personalization)Functional test automation for API-driven servicesRegression testing methodologiesNice to have:Agent memory framework testing (LangChain, LangGraph)Conversational AI evaluationAWS AgentCore Memory testingGDPR compliance testing (user deletion validation)Perks and Benefits:Flexible work schedule.Fixed financial bonus issued upfront on a quarterly basis, covering the average market price of private medical care and sport card - B2B contract.Present on the occasion of birthday, wedding, child birth.E-learning accounts for Coursera, O'Relly, Udemy.Corporate language school.
Read the full posting on justjoinit →
FAQ
Is the QA Engineer – Agentic Memory Testing role at Intellias remote?+
This QA Engineer – Agentic Memory Testing position is listed as remote (Poland).
What seniority level is this QA Engineer – Agentic Memory Testing role?+
This is a unknown level position.
How do I apply for the QA Engineer – Agentic Memory Testing role at Intellias?+
Use the "Apply on justjoinit" button to open the original posting on justjoinit, where you can submit your application directly to Intellias.