Jarvis, Mark Zuckerberg’s home AI

15385486_10103347842598391_7920602455375761429_o

In December 2016, Mark Zuckerberg wrote that his personal challenge for 2016 was to build a simple AI to run his home — like Jarvis in Iron Man.

One aspect that was much more complicated than he expected was simply connecting and communicating with all of the different systems in his home.

Before he could build any AI, he first needed to write code to connect these systems, which all speak different languages and protocols. He used a Crestron system with his lights, thermostat and doors, a Sonos system with Spotify for music, a Samsung TV, a Nest cam for his daughter, and of course his work is connected to Facebook’s systems.

15419743_10103347287954901_2744013366467623932_oPosted on Facebook December 19, 2016

Using several artificial intelligence techniques, including natural language processing, speech recognition, face recognition, and reinforcement learning, Jarvis learns Mark’s tastes and patterns, and can learn new words and concepts.