Survivor bias in software testing, observability and monitoring

Drop out from college to become a millionaire! This is an example of a Survivor Bias which is a logical error in our understanding of the world, the assumption that success tells us the whole story about the process. Real world examples help us see how prone we are to it. During this presentation I want to talk about it with respect to testing, observability and monitoring. We will learn the techniques on dealing with it to make tools that are more reliable and exhibit our internal biases to lower extent.

OBJECTIVES:

Bring the phenomenon of survivor bias closer to the audience. Help realise how it can impact our judgement and what we can do about it.

AUDIENCE:

Developers of all shapes and sizes.