There were two steps we had to take to get this software to work. We started by creating an AI that would be able to recognize a person. This required, “Realtime Person Detection” whilst in the browser. Afterwards we made it so that the background behind this person would be blurred using a technique called “Smart Pixel Selection”.
In order to recognize the person we used a so-called “person segmentation model”. This is a model that had been developed before. The function of the person segmentation is to recognize a person. For it to work properly we had to make certain changes to how it was trained. After some tweaking we managed to make it work and got a clear outline of a person.
The second step in the process was to blur away the background. To do this we used a so-called “Gaussian blur”, which is a fancy way of saying: mixing the color of a few pixels, in order to make them vague. After this step, we could also change the background into a video or a photo. Another addition to the software was that the person presenting could see themselves while giving a presentation, which proved to be quite useful in practice.