This is awesome! Google researcher Kevin P Murphy unveiled Im2Calories which uses sophisticated deep learning algorithms to analyze a still photo of food and estimate how many calories are on the plate. In one example, the system looked at an image and counted ‘two eggs, two pancakes and three strips of bacon.’ Even though these food stuffs are not universal units of measurement, the system gauges the size of each piece of food in relation to the plate, along with any condiments. The project was announced at the Rework Deep Learning Summit. Read more below.
During the presentation, Murphy stated that, “We semi-automate. If it only works 30 percent of the time, it’s enough that people will start using it, we’ll collect data, and it’ll get better over time”. Users can correct the software as well if they go wrong identifying certain foods for example, if it confuses fried eggs for poached eggs.
In conversation with CNET, Google spokesman Jason Freidenfelds said that Im2Calories and the algorithms that run it are still at the research stage and that there are ‘no actual product plans at this stage.’