Publication Date:
2016-01-29
Description:
The game of Go has long been viewed as the most challenging of classic games for artificial intelligence owing to its enormous search space and the difficulty of evaluating board positions and moves. Here we introduce a new approach to computer Go that uses 'value networks' to evaluate board positions and 'policy networks' to select moves. These deep neural networks are trained by a novel combination of supervised learning from human expert games, and reinforcement learning from games of self-play. Without any lookahead search, the neural networks play Go at the level of state-of-the-art Monte Carlo tree search programs that simulate thousands of random games of self-play. We also introduce a new search algorithm that combines Monte Carlo simulation with value and policy networks. Using this search algorithm, our program AlphaGo achieved a 99.8% winning rate against other Go programs, and defeated the human European Go champion by 5 games to 0. This is the first time that a computer program has defeated a human professional player in the full-sized game of Go, a feat previously thought to be at least a decade away.〈br /〉〈span class="detail_caption"〉Notes: 〈/span〉Silver, David -- Huang, Aja -- Maddison, Chris J -- Guez, Arthur -- Sifre, Laurent -- van den Driessche, George -- Schrittwieser, Julian -- Antonoglou, Ioannis -- Panneershelvam, Veda -- Lanctot, Marc -- Dieleman, Sander -- Grewe, Dominik -- Nham, John -- Kalchbrenner, Nal -- Sutskever, Ilya -- Lillicrap, Timothy -- Leach, Madeleine -- Kavukcuoglu, Koray -- Graepel, Thore -- Hassabis, Demis -- England -- Nature. 2016 Jan 28;529(7587):484-9. doi: 10.1038/nature16961.〈br /〉〈span class="detail_caption"〉Author address: 〈/span〉Google DeepMind, 5 New Street Square, London EC4A 3TW, UK. ; Google, 1600 Amphitheatre Parkway, Mountain View, California 94043, USA.〈br /〉〈span class="detail_caption"〉Record origin:〈/span〉 〈a href="http://www.ncbi.nlm.nih.gov/pubmed/26819042" target="_blank"〉PubMed〈/a〉
Keywords:
Computers
;
Europe
;
*Games, Recreational
;
Humans
;
Monte Carlo Method
;
*Neural Networks (Computer)
;
Reinforcement (Psychology)
;
*Software
;
*Supervised Machine Learning
Print ISSN:
0028-0836
Electronic ISSN:
1476-4687
Topics:
Biology
,
Chemistry and Pharmacology
,
Medicine
,
Natural Sciences in General
,
Physics
Permalink
