TestCon Europe 2026
October 20-23
Vilnius & Online
Michal Ocios
About
Michal Ocios is a software quality expert with over 13 years of experience in software testing and quality engineering. Having started his career as a Java developer, he built a strong technical foundation that continues to shape his approach to quality today. He is currently a Cloud Quality Lead at Pegasystems, where he drives quality across backend and frontend systems, with a growing focus on AI-powered solutions. Michal has also taught automated testing at local universities and shared his experience at various conferences. Outside the tech world, he enjoys running tabletop RPGs as a game master and staying active through sports
Michal Ocios | A Deterministic Tester in a Non-Deterministic World
Traditional software testing assumes predictability. AI-powered systems challenge that assumption.
In this talk, Michal Ocios explores how QA needs to evolve when working with LLMs and AI agents - systems where outputs depend on context, behavior is less predictable, and quality is no longer just about expected versus actual results. Drawing on practical experience with AI-based solutions, he shows where traditional testing still applies, where it falls short, and how testers can build a more realistic approach to quality in non-deterministic systems.
The session focuses on the mindset shift required to test AI-powered features effectively: how to think about relevance, safety, consistency, usefulness, and risk when there is no single correct answer. Attendees will leave with practical hints for approaching AI quality and a clearer understanding of how the tester’s role changes when software stops behaving in fully predictable ways.