TECH

Google teaches AI how to change funds to real-time videos

"Show a photo, or it did not happen!" This is the expression you should most listen to when talking about having already been to one of the most unbelievable places. You'll soon be able to make friends or family games by shooting videos or photos in "places you've visited." A new background modification system will be added to the YouTube Stories app, Google's version of sharing small moments similar to Instagram and Facebook from smartphones.
The technology allows to clearly identify the two levels of plans of the videos, that is, it can identify the subject and the scenario behind. In this way, it is possible to swap the background to exotic locations or those that you can only dream of this feature.
In the conventional mode, you can do the trick by using neutral backgrounds, or chroma keying, quickly manipulated with any video editor. The Google system is much more practical for the user, although based on technology that is complex enough to turn the scene in real time directly from the smartphone. At this time the application is in beta, available only to selected users.

Google technology uses machine learning through a neural network powered by tens of thousands of images captured in different subject poses and distinct background conditions. AI was trained to distinguish the skin tones, hair, glass, lips, among many other elements from the scenes at the pixel's detail. The cross-over comparisons of the data gave results in 98% of human annotation quality.

Depending on the quality of the device, the faster the process, starting at the usual 30 frames per second on the common devices, the Google Pixel 2 debits 40 FPS and more than 100 FPS on an iPhone 7. This means that the present generation of smartphones will not have problems in dealing with this technology.

Sapo