Machine Learning Algorithm Learns to Play Games by Watching You Play Them

Recommended Videos

Dr. Łukasz Kaiser of Universite Paris Diderot is working on an algorithm that can learn how pretty much anything works by just processing videos of said thing. Object recognition technology and high-level machine learning may sound like old news by now, but interestingly, there had been relatively few papers combining the two (and by few, I mean five). This one strives to create something that can watch you and learn your ways. Lofty, so lofty.

And of course, all lofty endeavors have to start small. In this case, before Dr. Kaiser can input the entire YouTube into a supercomputer and have it learn how to be an impossibly cute cat, he has to have the algorithm learn how to play Connect4 and Gomoku.

His paper explains why he went with games to develop the algorithm:

This domain is chosen because the number of visual objects is manageably small while there is still a lot of complexity in the interactions. Moreover, games are a natural model of many real-world interaction scenarios, making the results significant in a broader context.

I know, it sounds a little underwhelming considering we’ve had Deep Blue for more than a decade now. But, Deep Blue was built to play chess, and had all the rules programmed into it; it didn’t have to learn. On top of that, it cannot play anything else, not even checkers.

Dr. Kaiser’s algorithm was built to learn the rules by itself, and then figure out how to win at it. A simple enough concept, but you can imagine how much work needs to be done to go from watching and learning Connect4 to watching and learning StarCraft. Not to mention Dwarf Fortress.

For a concise but detailed explanation of the algorithm, watch this video of Dr. Kaiser’s presentation at the Third Conference on Artificial General Intelligence:

(via Wired)

Relevant to your interests


The Mary Sue is supported by our audience. When you purchase through links on our site, we may earn a small affiliate commission. Learn more
related content
Read Article The Best ‘Fallout 4’ Perks, Ranked
The male player and Dogmeat in Fallout 4
Read Article ‘Assassin’s Creed Shadows’ Is Taking Heat for All the Wrong Reasons
Yasuke from Assassin's Creed Shadows
Read Article ‘Assassin’s Creed Shadows’ Ups Our Excitement With a Stunning Trailer
Oda Nobunaga commanding his troops in Assassin's Creed Shadows
Read Article Will ‘V Rising’ Get a PS5 Release? Here’s What We Know
Two vampires of "V Rising" brandish weapons against a moonlit night sky.
Read Article We’re Counting the Days to the ‘Vecna: Eve Of Ruin’ Release
Artwork featuring the villain Vecna from 'Vecna: Eve of Ruin,' a new 'Dungeons & Dragons' campaign
Related Content
Read Article The Best ‘Fallout 4’ Perks, Ranked
The male player and Dogmeat in Fallout 4
Read Article ‘Assassin’s Creed Shadows’ Is Taking Heat for All the Wrong Reasons
Yasuke from Assassin's Creed Shadows
Read Article ‘Assassin’s Creed Shadows’ Ups Our Excitement With a Stunning Trailer
Oda Nobunaga commanding his troops in Assassin's Creed Shadows
Read Article Will ‘V Rising’ Get a PS5 Release? Here’s What We Know
Two vampires of "V Rising" brandish weapons against a moonlit night sky.
Read Article We’re Counting the Days to the ‘Vecna: Eve Of Ruin’ Release
Artwork featuring the villain Vecna from 'Vecna: Eve of Ruin,' a new 'Dungeons & Dragons' campaign