TestCon Europe 2020


October 13-15

Vilnius and Online

Jeroen Rosink

Software Testing Professional

Squerist, The Netherlands


Jeroen is a passionate test professional with about 21 years of experience in testing, test management and executing, coordinating, coaching and advising roles. Driven by his passion he always search for those things which makes testing valuable and interesting. Also he made his contributions to an anniversary book of TestNet “Set your course: Future and trends in testing” (translated from Dutch) and the book “How to reduce cost of software testing”.


Low Level Approaches for Testing AI/ML

AI and ML are new technologies that will be applied at a rapid pace. The impact of this on testing will be large. For a large part, well-known approaches will still be sustainable. Organizations as well as testers will also have to adjust to keep up with the times. Sometimes it is hard to keep up and still need to start with testing. The 2 approaches helps to provide initial insights.

In this presentation, two low-level approaches are discussed that are suitable for use in organizations where knowledge and resources are still limited and yet can be integrated into existing test approaches. The Auditors approach and the Black hole approach to be introduced here.

Why not apply an approach to learn what is really needed. Why not gain insight into the operation and the basic quality. The following two approaches will not cover everything. They can be used immediately to learn what is needed to guarantee optimum quality.

This presentation deals with
– The basis of AI and ML: what is this and does this mean for us testers
– The Auditors approach is based on random sampling over a large unknown population.
– Based on own experience it is explained how the auditors approach is applied to ML and what lessons learned are.
– The black hole approach is based on the idea that you know that black holes exist, just like bugs, but you don’t know how to find them specifically. You then look at other patterns and deviations. it is just like the puzzle “Where is Waldo!” This approach is explained on the basis of examples that it may help to do the initial test.
– Create awareness not to wait until everything is known and arranged, but to start.

These two approaches can help testers to gain new knowledge in a simple and wild way in the short term. And soon better to understand the all-embracing approaches that are yet to be developed.  

Session Keywords

🔑 Auditor and Black Hole Approaches

« Back