AlphaGo – The Movie | Full Documentary


[heartbeat thumping] [stones rattling] [stones clacking] [tense music] [stones rattling] [Frank]It’s intensely contemplative.It is almost hypnotic.[rattling]It’s like putting your hand
on the third rail of the universe.
If you play Go seriously, there is a chance
that you will get exposed to this experience that…is kind of like nothing else
on the planet.
[Frank]Go is putting you in a placewhere you’re always
at the very farthest reaches
of your capacity.There’s a reason
that people have been playing Go
for thousands and thousands
of years, right?
It’s not just that they want
to understand Go.
They want to understand
what understanding is.
And maybe that is truly
what it means to be human.
[Demis]When I was a kid,
I loved playing games.
I started off with board games like chess.And then I bought my first computer
when I was eight
with winnings from a chess tournament.Ever since then,I felt that computers
were this sort of magical device
that could extend the power of your mind.Virtual environments and games,we think they’re the perfect platform
for developing and testing AI algorithms.
Games are very convenient,
in that a lot of them have scores, so it’s very easy
to measure incremental progress. So I’m going to show you a few videos
of the agent system, the AI. So let’s start off withBreakout.So here you control the bat and ball, and you’re trying to break
through this rainbow-colored wall. The agent system has to learn
everything for itself, just from the raw pixels. It doesn’t know what it’s controlling. It doesn’t even know
what the object of the game is. Now, at the beginning, after 100 games, you can see the agent is not very good. It’s missing the ball most of the time. But it’s starting to get
the hang of the idea that the bat should go towards the ball. [game beeping] Now, after 300 games, it’s about as good
as any human can play this, and pretty much gets
the ball back every time. We thought, “Well, that’s pretty cool.” But we left the system playing
for another 200 games, and it did this amazing thing. It found the optimal strategy was to dig a tunnel around the side,
[audience laughing] and put the ball
round the back of the wall. [beeping] The researchers working on this,
the amazing AI developers, well, they’re not so good atBreakout,
and they didn’t know about that strategy. So, they learned something
from their own system, which is, uh, you know,
pretty funny and quite instructive, I think, about the potential
for general AI. So, for us, what’s the next step now? Go is the most complex game,
pretty much, ever devised by man. Beating a professional player at Go is a long-standing, grand challenge
of AI research. [inspiring music] [church bells ringing] [man yelling in French] [church bells clanging] Wow. [in French]
You really want to kill me, eh? No, I don’t want to,
but I’m trying to survive. Yes, that’s it. That’s it. [in English]
[Fan]I am Go professional player.I am also European Champion.[in French]
With that move, you’re going to lose for sure.
[chuckles] You were happy to defeat me
but then you panicked. You’re afraid that victory
will escape you. In general, when you’re afraid,
victory always escapes you. [in English]
[Fan]I’m born in China.When I was 18, I wanted to change my life.This is why I go to France.I want to try to forget Go.But it’s impossible.Because all the things I learned
in my life is with Go.
It looks like a mirror.I see Go, I also see myself.For me, Go is real life.[bicycle bell ringing] [Demis]Dear Mr. Fan,My name is Demis Hassabis.I run an artificial intelligence company
based in London called DeepMind.
As the strongest Go player in Europe,we would like to invite you
to our offices in London,
both to meet you in person
and to share with you
an exciting Go project
that we are working on.
If you would be interested
in coming to visit us,
please let us know.Many thanks.Kind regards, Demis.[Fan]When I see this e-mail,I don’t know if it’s true or not.I will accept about this. Why not?For me, everything’s an adventure.I want to go visit DeepMind to knowwhat is this Go project.The first visit,
I think maybe they want me
sit in the special room,push many, many wiresin my head and also my body,let me play to scan my brain. I don’t know,
[chuckles] to make some research. [Demis]We needed to get Fan Hui
to DeepMind
to see we were a serious operation, and we were serious people… doing proper research. [indistinct chatter] [David] And the search time
is getting better and better as we go from, for example,
one to eight, in any one of these, it always goes up. [Demis]We think of DeepMind as…kind of like an Apollo program effort
for AI.
Our mission is to fundamentally
understand intelligence,
and recreate it artificially.And then, once we’ve done that,we feel that we can use
that technology to help societysolve all sorts of other problems.[Julian] If you step through
the actual game, we can see, kind of, how AlphaGo thinks, what’s the most likely variation
that it thinks will happen. [Demis]We’ve been working on AlphaGo,our program to play Go,
for just under two years now.
All the little patterns cascade together, layer after layer, after layer,
after layer. [indistinct chatter] I started talking about the game of Go
with Demis more than 20 years ago. [David]And so, this has been
a really long journey.
The game of Go is the holy grail
of artificial intelligence.
For many years,
people have looked at this game
and they have thought,
“Wow, this is just too hard.”
Everything we have ever tried in AI,it just falls over
when you try the game of Go.
And so that’s why it feels like
a real litmus test of progress.
If we can crack Go,
we know we’ve done something special.
[keyboard clacking] [Demis]So with Fan Hui,
we started talking around
what the real purpose of the visit was.It wasn’t just a Go project
we wanted him to help with,
that actually, we wanted to play him, and we had a very strong program. Oh, it’s okay, just a program. It’s so easy.
[laughs] So, it will be easy to play. [Shane]A lot of people have thought
that it was decades away.
Some people thought it would be never. Because they felt that to succeed at Go,
you needed human intuition. Go is the world’s oldest
continuously played board game.And, in some sense,it is one of the simplest
and also most abstract.
[Frank]There’s only one type of piece.There’s only one type of move. You just place that piece on the board.And then, your goal is to create
a linked group of your stones
that surrounds some empty territory.And when you surround enemy stones,you capture them,
and remove them from the board.
You earn points by surrounding territory.And, at the end of the game,
the person with the most territory wins.
It seems really simple.
[chuckles]But, then you sit down to play,
and you realize right away,
it’s like, “Well, I technically know
what I’m allowed to do, but I have no clue what I should do.” [Demis]Go is incredibly challenging
for computers to tackle
because compared to, say, chess,the number of possible moves
in a position is much larger.
In chess, it’s about 20.In Go, it’s about 200.And the number of possible
configurations of the board
is more than the number
of atoms in the universe.
So even if you took all
the computers in the world,
and ran them for a million years, that wouldn’t be enough compute power
to calculate all the possible variations. [Demis]If you ask a great Go player
why they played a particular move,
sometimes, they will just tell you
it felt right.
So, we have to come up
with some kind of clever algorithm
to mimic what people do
with their intuition.
-[Maddy]Nice to meet you.
-[Fan] Oh, hello. Nice to meet you, too. [Demis]So with Fan Hui, we agreed
a best-of-five match.
And we agreed it would be filmed.You know, we would treat it
as a serious match.
[tense music] [Fan]I play with AlphaGo.Aja Huang push the stones for AlphaGo.And, of course, I think I will win
the game with AlphaGo
because it’s just a program.[Fan] Good game. [Aja] Have a nice game. [tranquil music] [Fan]The first game, I make some mistake,and I lose the game.Oh. Strange. Very strange game. [David]In that first match,
I think something clicked for him
that this wasn’t an ordinary Go program. We weren’t just doing
the same as everyone else, that something new was happening. [Fan]The second game,
I tried to change my style.
But the problem is,
also, I lose the second game.
And also for a third game,the fourth game,even the last game.I lose five-zero.[whining]AlphaGo wins all the games.After losing, losing, losing,you can feel his pressure
is getting heavier and heavier. [Aja]And several times after the game,he said he wanted to go out for fresh air.
[chuckles] I said, “Oh, I can go with you
and have a chat.” He said, “No, I want to go by myself.” [Fan]I feel something very…strange.I lose with a program.And I don’t understand myself anymore.[somber music] [Maddy]I worried whether
he would even come back.
[chuckles]
You know, he seemed very low,
and he spent about an hour away
from the office. He came back completely changed. [Fan]I told Maddy,
“This is the first time in the history
the human professional Go player
loses with a program.
She told me, “Yes, we know.
[chuckles] But for you…
[stuttering] Are you okay?” I told her… “Not, and yes.” I am not happy to lose the game, but I will be happy for play
in the history. Artificial intelligence researchers
have solved the game of Go a decade earlier than expected. [Errol]The computer named AlphaGo,was able to beat
the European human champion.
[male reporter #1]
Artificial intelligence researchers
have made a significant breakthrough.[Martin]It really is a big leap forward.There’s a big difference between
the way the IBM computer beat Kasparov,which was programmed
by expert chess players,
and the way the Go-playing computer,
more or less, learned itself.
The way we start off training AlphaGo is by showing it 100,000 games
that strong amateurs have played, that we have downloaded from the internet. And we first initially get AlphaGo
to mimic the human player. And then, through self-playing,
reinforcement learning, it plays against different versions
of itself many millions of times, and learns from its errors. The specific ideas
that are driving AlphaGo are going to drive our future. [Cade]The technologies
at the heart of AlphaGo,
they are what are called
deep neural networks
which essentially mimicthe web of neurons in the human brain.It’s a very old idea.But recently, due to increases
in computing power,
these neural networks
have become extremely powerful,
almost overnight.Big neural networks
that operate on big data can achieve surprising things. [John]AlphaGo found a way to learn
how to play Go.
Learning is the key thing here.It is a machine learning.[Demis]The whole beauty
of these types of algorithms
is that because they are learning
for themselves,they can go beyond
what we, as the programmers,
know how to do,and allow us to make new breakthroughs
in areas of science and medicine.
So, AlphaGo is one significant step
towards that ultimate goal.
[uplifting music] [bicycle rattles] [Fan]My wife called me.She told me, “Don’t see internet.Don’t connect internet,because people talk terrible thingsabout your match with AlphaGo.”“Fan Hui is living so long time in Europe, he is not real professional,
he’s just an amateur player.”This is so hard for me, so hard.[Demis]The Go world was skepticalabout how strong really was AlphaGo, and how much further did it need to getto beat the top professionals.So our program is improving over time,and we want to push
the AI algorithm to the limit,
and see how far this kind
of self-improving process can go.
So, we needed to look
for an even greater challenge.
[camera shutters clicking] [female reporter #1]A match like no other
is about to get underway in South Korea.
[male reporter #2]Lee Sedol,
the long-reigning global champ…
[male reporter #3]This guy is a genius…[male reporter #4]…who will take on
artificial intelligence program AlphaGo
in the ultimate
human versus machine smackdown.
This is a huge moment for both
the world of artificial intelligence
and I think, the world of Go.So far, AlphaGo has beaten
every challenge we have given it.
[Demis]But we won’t know
its true strength until we play somebody
who is at the top of the world,
like Lee Sedol.
We chose Lee Sedolbecause we wanted
a legendary, historic player.Somebody who has been acknowledged
as the greatest player of the last decade.
[in Korean]
I don’t want to sound too arrogant, but, still, I think I have the advantage. [translator]“I will not be too arrogant,but I don’t think
that it will be a very close match.
The level of the player that AlphaGo
went against in October is not the same level as me. So, given that a couple of months
has only passed, I don’t think that it is enough for it
to be able to catch up with me.My hope is that it will be either
five-zero for me, or maybe four to one.
So the critical point for me
is to make sure I do not lose one.”
[in Korean]
[female host] High five, please. [Demis]We don’t know how wellour system will play against someoneas creative as Lee Sedol.Also, he’s very famous -for very creative fighting play.
-Yeah, yeah. Yeah. So, this could be difficult for us,
but we’ll see. Maybe, in some ways, he’s the most difficult opponent
we could pick. [man #1]Yeah.[Cade]There was still so much
of a question
about whether or not they could beatsomeone like Lee Sedol.Fan Hui is a good player,but he’s nothing
like the very top players.
[Andrew]Lee Sedol
is a 9-dan professional.
Nine-dan professional is the highest rank
that you can achieve in Go.The ranking system.Fan Hui, who is the European Champion,
is just a 2-dan professional.
On the other hand, at the very top,Lee Sedol is a 9-dan professional.Lee Sedol is to Go
what Roger Federer is to tennis. He is playing in Wimbledon
to win the Grand Slam.And it’s not just this year.He’ll be there next year,and the year after that,
and the year after that. Of course, the internet
and all the Go community, everyone, maybe not 100%, maybe 99.999% think Lee Sedol
will win very easily. [in Korean]
[student] Teacher, I got stuck. How do I go from here? [stones rattling] [Master Kwon] Good.
Hold the stone properly. Place the stone nicely, not like that. And hold it nicely, like this. [Janice]Go is taken seriously in Korea.It’s so much part of the culture,
like breathing, or, you know,like taking swimming lessons,
or something.
[Yuan]On the surface, it’s a game,but inside, it has a very deep philosophy.The Go board reflects
the individual who’s playing.The truth is gonna show itself
on the board.
You won’t be able to hide it.[Chihyung]In ancient China, Japan, Korea,Go is one of the four noble things,like four accomplishments for literati,with music, poetry, and painting.So, people think the Go players are very smart and very noble. [in Korean]
It’s okay to lose, as long as you played your best. Bow to your opponent. [Joseph]Master Kwon started this school,so that he could produce great players in Korea.Lee Sedol, when he was age of eight,he came in here, attending class,9:00 a.m. until 9:00 p.m. for seven days.And then, he stayed with Master Kwon.[in Korean]
I remember his round face and dark brown eyes. [Master Kwon]Since he came
from an island, he easily drew attention.
But unlike the other children,his eyes shone brightly.7TH WORLD GO CHAMPIONSHIP [Janice]Lee Sedol was a little boythat I remember when I was a student
studying Go.
He was very young and rural enough
to think that pizza grew on trees. [in Korean]
[Sedol]When I was young,I started playing Go
because I thought it was fun to beat guys who were older than me.Since then, it has become
a type of creation of mine.
I want my style of Go
to be something different, something new, my own thing. Something that no one
has thought of before. [Janice] Lee Sedol plays things
that are interesting, where you felt like
he is beyond winning and losing. [Janice]He wants to do something
that’s innovative
or takes things to the next level.So every Go player
studies his game for sure. [Aja]Roughly ten years, he dominated
the professional Go world.
He won 18 World Championships.[in Korean]
[Master Kwon]Lee Sedolis a genius of the century.Even when I look back now,
I am proud of him.
And I’m proud of myself, too. [Joseph]Definitely, Lee Sedol
is going to win the game, five-all.
Yeah, all games. He’s going to win all games. [David]We had our evaluation match
last week.
We won a game, and we lost a game. And we lost a game in a way that would have made us look
extremely foolish if that happened publicly. It means that we still have work to do, and we need to take this really seriously. There’s just too much risk that, actually, we could lose, overall. Not only that, but we could lose in a way
that makes us look rather silly. -Yeah.
-So, I guess, um… Yeah, Aja, did you want to say anything
about what you’re trying? I’m working hard. [laughter] [Demis]So, we’re working round the clock
at the moment,
training our algorithms further,trying to incrementally keep on improvingright up to the moment
where we have the match.
We have collected togetherpeople with different skill sets
onto the same team. [David]So we have researchers,
engineers, valuation guys.
But you mean what happens
if it creates something new -which wasn’t in heavy node?
-[Aja] Yeah. Then we don’t see it. [Aja] You’ll see it. -Okay.
-[David] The first thing to know… I was thinking
we have the perfect solution, -but it’s not perfect.
-[David] Yeah. [David]Aja is the lead programmer,
and built the original search engine.
[Demis]So Aja’s responsibility
is quite a big one.
He’ll be the one sitting
opposite Lee Sedol
and actually playing
the moves AlphaGo makes.
-[Aja]I’m feeling excited.
-[man #2]Yeah?[laughs] Lee Sedol is a great player, and I feel honored to play with him. [Aja]Many of my friends,
they are very excited about the match.
They keep telling me
that the whole world is watching.
“Just prepare AlphaGo.”
[chuckles] [Hajin]Hello.Hello, Demis. Can you hear us?[Demis] Yes, I can hear you, guys. Can you hear me okay? [Hajin]Yes. Perfect.“I was curious to meet you,such an amazing developerwho made AlphaGo.
[Demis chuckling]It’s very nice to meet you.”[Demis] Thank you, thank you. Likewise. It’s a real pleasure to meet you. I love the game of Go. I’m not very good, but I don’t know if you know, but we actually have something in common. I actually also trained at a game
at a young age. I used to be, when I was young,
a professional chess player. [in Korean]
[Hajin]He said that he was oncea professional chess player.I used to play for the England team, [Demis]and then I stopped playing
when I was about 14.
I was…When I was 13, I was the second
highest-rated player in the world.
[Hajin]“After the match,I would like to propose
that I give you one teaching game of Go,
and you give me
one teaching game of chess.”
[laughs]
[Hajin]“How does that sound?”That sounds very good.
I would be very honored to do that. [Hajin]“I’m not sure if it’s okay
to ask you this question,
but I saw the games against Fan Hui,and I didn’t think it was quite
at the level to play with me,
but I heard
that it is getting really stronger.
Can I ask how much
it got stronger since then?”
[Demis chuckling] Yeah. I can’t say too much, of course, but it’s definitely got
significantly stronger. [people chattering] [David]With more time, I think,a logical approach would be
to follow up on Aja’s local search, -run that in fast AlphaGo,
-Right. -generate a whole new data set,
-Exactly. -and iterate with more time.
-Yeah. But we’re just out of time for that,
so we have to be realistic. [Demis]We realized that
if we wanted to prepare
for a mammoth task
like taking on Lee Sedol,
there would be nothing better
than talking to a professional.
And we couldn’t have picked
a better person than Fan Hui.
[tranquil music] [Aja]We invited him as an advisorbecause during the match,
we found he is a man of good spirit.
-[Maddy] Welcome back.
-[Fan] Thank you very much. [Aja]It’s very precious
that we have Fan Hui with us.
[Maddy] Let’s go down this way. He was crushed by AlphaGo, but then, he became very positiveand a big help to us.[Fan]When Demis tell me,“Can you come back to help us
make AlphaGo more stronger?”
I feel this respect.Of course, I accept about this.I play with AlphaGoto understand
where are the strong points about AlphaGo
and where is maybe the weakness.I play in the morning,afternoon,all the time.And I find something.I find big weakness about AlphaGo.The big one.[Shane]The superheroes always havea hidden vulnerability, right?And the same is true for AlphaGo.It’s unbelievably superhuman, in general,but it has some particular weaknesses
in some situations. [David]We can think of there
being this space of all the things
it knows about,and it knows about most of it
extremely well.
Then there will be these tricky lumps
of knowledge, that it just understands very poorly. [David]And it’s really hard for us
to characterize
when it is going to enter
into one of these lumps.
But if it does,
it can be completely delusional,
thinking that it is alive
on one part of the board
when, in fact, it’s dead or vice versa.So, there is a real risk
that we could lose the match. [Fan]Everybody in the teamtried to work more and more
to fix the problem,
but I think it’s difficultto fix this very quickly. [Maddy] We’ve got version 18
in the pipeline, haven’t we? Well, we will only go
for version 18 if it makes -a significant improvement which…
-[Maddy] If it… Yes. We’re having to rerun all the tests
because they went wrong, unfortunately. So we’re basically a day behind
in our evaluation because of that. [David]Well, maybe we just need
to be realistic.
That we’ve tried a bunch of things, and we’ve come to the point
where we said we would actually start freezing the code, and saying, “Look, it’s… not… actually, not panning out.” These delusions are still
a realistic possibility for the match. We have some weaknesses that we… I don’t think we are going
to fix fully before the match. So that’s causing us
a little bit of anxiety. [upbeat music] [male reporter #5]
Lee Sedol is getting ready to rumble.
On Wednesday, live across the internet,this professional South Korean Go playerwill take on artificial intelligence
program AlphaGo.
[in Korean] I am confident
that I will win five to zero. [David]Tomorrow, Julian and George,
they pack up version 18,
they stick it on a laptop,
and they fly out to Seoul.
[exciting music] -[Julian] See you all in Korea.
-Safe trip. -Have a safe trip.
-See you, too. [upbeat music] [male reporter #6] Is everything all set
for the victory against Lee Sedol? Everything is set, I think. But when I get to the hotel,
I’m going to catch up with the team. [George]What we should do
in the time remaining
is list things that could go wrong
in the solidity of the system. We need somewhere
to put AlphaGo under here. [Maddy] All right, rehearsal.
Let’s go, please, folks! [Aja]Have you arranged the placefor Lee Sedol to smoke? When he’s in a difficult situation,
he likes to smoke. Yes, there is a terrace,
and we will have security,so he will be able to go up there
and be by himself.
[in Chinese]
[journalist #1] Which one do you support, Lee Sedol or AlphaGo? I am in an awkward position. -As you can see, I am a referee.
-I see. [Fan] I am a referee. [Cade]When I got here,I didn’t expect
the attention on the match.
It was literally front-page news.About eight million Koreans
play the game of Go,
and, even those who don’t,
you know, recognize Lee Sedol.
He is a national figure.And so, there’s that. Right? [Cade]
There’s some national pride involved.
But it’s more than that.Just the very thought of a machine
playing a human in something like this,
I think, is inherently intriguing
to people.
-[woman #1] We can bring him in?
-[woman #2] Yeah. [Demis] Let’s go in? Yes. [camera shutters clicking] [in Korean]
[Sedol] I am confident about the match. I believe that human intuition
is still too advanced… for AI to have caught up. I’m going to do my best
to protect human intelligence. [Fan]All the world gave the pressure
to Lee Sedol.
Before this, he played the tournament
for country, for himself.
But this time, he played for the human.[David]I just really hope we win
this first game.
If you lose the first game,you literally have to win
three out of four. [Demis] Yeah, that’s right. -[David] Which is hard work.
-[Demis] Yeah. Where are you going to be? -I’ll start in the match room.
-Okay. Then, I’m gonna come in here,
make sure everything’s fine. -Yeah, you should probably be in here.
-Or something like that. [chuckles] -I know you’re nervous.
-Yeah, I’m nervous. I’m nervous. How are you? You’re not nervous? -[Aja] A bit.
-[Demis] Little bit, yeah? It’s good to have a little bit of nerves. It should be fine.
[Aja sighs] Be fine. Be fine. [Chris]Hello, and welcome
to the DeepMind Challenge,
Game One, Round One,live from the Four Seasons
here in Seoul, Korea.
I’m Chris Garlock
ofThe American Go E-Journal.I’m here with Michael Redmond,
9-dan professional. Welcome, Michael. Want to give a shout-out to all the folks
watching around the world? [Michael]Well, the excitement
is pretty palpable here in the hotel.
I’ve never seen a crush of interest
of reporters from around the world.
The cameras…
-[Chris]The media is overwhelming.[in Korean]
I am not sure how much AlphaGo has changed in the last five months. [Chris]All right, folks. You’re here,
you’re gonna see history made.
Stay with us.[Julian] Five minutes, guys.
[chuckles] Five minutes. [camera shutters clicking] [indistinct chatter] [in Korean]
[escort] Please don’t push. [David] I just thought we should
take a moment together and just think
about what is about to happen. I’m extremely excited to be here. Extremely proud of every one of you
and what we have done. And, win or loss, I think
it is just amazing that we’re here. [in Korean]
[journalist #2] Isn’t it strange your dad is fighting against a machine? I would like it if the machine did not beat a human in Go yet. [laughter] One minute left. [camera shutters clicking] [tense music] [tense music continues] [camera shutters clicking] Five, four, three, two, one. [grand music] [in Korean]
[Cheolgyun] The match will be in Chinese rules, 7.5 points komi. The time limit is two hours,
and 60 seconds times three. [exciting music] [exciting music continues] Please choose the stone. [in Korean]
Lee Sedol, 9-dan, what have you chosen? Black. [in Korean]
Please start the game. [stones rattling] [tense music] [George]We had worked so hardto make sure that this would go
technically smoothly.
We tested it, and tested it,
and tested it.
And still, there comes that moment
when you’re live,
all the TV cameras
are broadcasting everything,
and now it has to do
the thing you built it to do.
[in Korean]
AlphaGo is even considering what to do from the first step. If you look at the time closely, -it has been over 30 seconds.
-Yes. [Seongryong]AlphaGo is thinking too long
at the second move.
[Soyong]Yes.[tensed silence] [somber music] [somber music continues] [Aja]I was a bit nervous.It’s the first time that I sat
in front of a world-class Go player.
And I actually can feel
the spirit and courtesy
of a great Go player like Lee Sedol.Because I think
it was the first time he faced
a strange opponent, I think.
[chuckles]It is non-human,
has no emotion, it’s cold.
But he stayed very calm.And I can feel his mental strength.[stones rattling] [both gasp] Oh. [in Korean]
AlphaGo peeped. [Seongryong sighs]
It’s unbelievable. [Seongryong]This is the first timeI am seeing AlphaGo
making a move like this.
It feels like AlphaGo is playing
like a human.
I’m Andrew Jackson. With me here is Myungwan Kim, a 9-dan pro
from the Korean Baduk Association. We are here live at the Four Seasons Hotel on the 21st floor. What are we looking at?
How’s the game going? Oh, it’s fighting from the beginning. -From the very beginning?
-Yeah, yeah. -AlphaGo plays very well.
-Yeah? -Just like a top professional.
-“Just like a top professional.” [Myungwan]Yeah, it’s very aggressive.-[in Korean] It blocked!
-Did it block? [Soyong chuckles] [Seongryong gasps]
[Soyong]How dare he disconnect it?[Seongryong]This can’t be right.Now, the fight is getting
really complicated. Um, this is actually the first time
I have seen AlphaGoplaying a game
that has this difficult a fight.
[heavy breathing] [in Korean]
[Seongryong]This could makeLee Sedol nervous.Because AlphaGo uses one minute
to 1.5 minutes in any situation.
This action is not like a human at all.No matter how complex you make the game,AlphaGo plays as if it knows
everything already.
[Michael]I just saw him looking
at his opponent’s face.
And that’s just kind of a habit.
-[Chris]It’s just an instinct,as a player, to look at the person
across from you.
[Michael]Yeah, it’s sort of something
that Lee Sedol would do
when he was wondering
how his opponent was feeling.
-[Chris]Right.
-[Michael]It’s just a habit.So, it’s not as if Aja Huang
is going to do any giveaway
because Aja Huang isn’t AlphaGo, right?
-[Chris]Right. Right.[Soyong and Seongryong gasp] [in Korean]
He almost made a move. Lee smiled for a second. -[Seongryong]No. That’s…
-[Soyong]I guess Lee is mistaken?[Seongryong]He was about to make a move
that makes no sense.
-Here is the…
-What is he doing? If he had put his stone there,
he would have lost the game today. -He was trying to place it here,
-His hand… but he moved his hand there
without thinking. -He has so many things to ponder.
-Well, I think… He is exhausted now. -I think…
-Well… He looks a little panicked. [Seongryong]This is the thing
we were most afraid of.
[Soyong]Yes.Self-doubt.
-[Seongryong]Self-doubt.[somber music] [Fan]With a human, when you play,you can have exchange by feeling.I look at you. I know, okay,
maybe you want to talk with me.
Maybe you fear about me.I can feel many, many things.But with AlphaGo, you can feel nothing.So, when you can feel nothing
when you play,
you have more then more questions
about yourself.
For beginning, you think,
“Okay, my move is good.
And really good, really good…Oh, maybe bad.Oh, terrible!Why do I play here?”More, then more.[David] It’s hard to know where to be. All the different rooms
are like exciting in different ways. [Demis] Mm-hm. Right.
[chuckles] It’s quite nice to be here
at the heart of the operation. [Demis] Yeah, I feel safe here. [all laughing] [David] White’s thinking of doing
this huge invasion here from its thick wall. Yes, go for it. [Demis]Stone in. He’s going in.-Look at his face. Look at his face.
-Yeah. [Demis]That is not a confident face.He’s pretty horrified by that. [Myungwan]I can’t believe
what I’m seeing right now.
Really…-She thought she’s a little bit behind.
-Mm-hm. And she made a very aggressive move here. -Okay.
-And made it very complicated. -[Andrew]Okay.
-[Myungwan]I think Lee Sedol,if he doesn’t respond correctly,
-[Andrew]Uh-huh.then he can collapse.I mean, this is kind of unthinkable
as a human Go player.
What if she knows everything about what’s going to happen next? [George] Where are we? Here’s our search depth.
We’re searching… 50 or 60 moves ahead. [David] That’s the maximum number
of moves ahead that AlphaGo is looking
from the current game position. It’s typically over 50.
It’s often over 60. In the games we have seen,
often around move 150, AlphaGo goes for the kill. We are at move 115 now,
so we are getting to that critical point. [tense music] [Seokhyun]We are all astonished,just in the middle of the game
because AlphaGo is, uh… It seems to be doing a much better job
than we all thought it would.I thought Lee Sedol would be leading
the game comfortably,
but it turned out that he’s struggling
at the moment.
But, I think, eventually,
he will prevail. I hope.
I was, you know, more five to zero,but now, I’m not sure about that.
[chuckles] [in Korean]
[Seongryong]What is this?AlphaGo made a mistake.AlphaGo made a mistake here.Wow, what a mistake! It might be the first mistake, kind of a clear mistake that white made. [in Korean] AlphaGo is making mistakes
at the endgame from time to time. If AlphaGo wins
by a small difference in the end,it is possible that it played
just enough to win.
[Seongryong]
The reason I stopped talking a minute ago
was that according to my count,
AlphaGo may have more points. [laughing] I didn’t tell you
because I couldn’t believe it. [male reporter #7]
It seems like a mistake, but because it’s based on calculation,
it’s actually not a mistake. Yes, yes. So if it’s actually based
on calculation… it is so scary.
[chuckles] It means it’s just playing
with its opponent. Myungwan, it looks like
you have got a count. Yeah, right. -What do you think? Yeah.
-It’s done. Yes. White won a lot at this time.
It looks like it. If it’s like this, white has won by a lot. Yeah. [in Korean]
Two, three. I can’t believe it. Thirty-six, thirty-seven… Seventy-two. He lost. He lost. Whoa, it’s so shocking. I… I expected AlphaGo
to win only one game. [laughing] Oh, gosh. [sighs] [somber music] [Aja]I can feel his pain. Like he was…He couldn’t believe, you know.
He couldn’t accept it.
It takes time for him
to accept the outcome.
[Fan]Maybe AlphaGo is very strong now,but he don’t want to believe he will lose.He’s just a Go professional player.We can’t believe this,because, for us,
it’s something very, very far.
It’s not can be coming now.
It’s impossible.
But, in reality…it’s now.[Aja]I think he resigned
in a very polite way.
Lee Sedol plays black,
but he put a white stone.
[clacks] [somber music] [Michael] I think he resigned. [Chris] Oh, my gosh. -Look at the time. It stopped.
-Yeah. Wow. [exciting music] You got this. -Congratulations.
-Thanks. What’s up? [David]I feel really good.
I feel like I really believe in AlphaGo.
Of course, it’s natural that humans
want humans to win.
I mean, I think that’s a natural response.But AlphaGo is human-created,and I think that’s the ultimate sign
of human ingenuity and cleverness.
Everything that AlphaGo does,it does, because a human has either
created the data that it learns from,
created the learning algorithm
that learns from that data,
created the search algorithm.All of these things have come from humans.So, really, this is a human endeavor.[laughs] [reporters clamoring] [camera shutters clicking] [male reporter #8]In the battle
between man versus machine,
a computer just came out the victor.[female reporter #2]DeepMind put
its computer program to the test
against one of the brightest minds
in the world and won.
[male reporter #9]AlphaGo beat
a professional player
who has 18 Go World Championships
under his belt.
The victory is considered a breakthrough
in artificial intelligence.
[in Korean]
First of all, I would have to say
that I was very surprised, because I didn’t think
that I would lose the game. I think the mistakes I made
in the beginning lasted until the very end. That’s why I lost this game. I wasn’t able to foresee. [Sedol] I didn’t think that AlphaGo would
play the game in such a perfect manner. I have won world championship titles
and have a lot of experience, so losing one game won’t affect me
in playing games in the future. I think now it’s 50/50. I would like to express
my respect to the team for developing such an amazing program like AlphaGo. [Demis]In research,we normally work
to produce an academic paper.
It gets published,
and maybe we get to talk about it
in a conference if we’re lucky.This is not normal for a research.In fact, I’ve never experienced any
media attention remotely close to this.
So, it’s a special moment for us all,
and we’re just enjoying it while it lasts.
[male reporter #10]In a matchup between
man and machine, who wins?
So far, it’s the machine.In Seoul, South Korea,
the artificially intelligent computer
defeated the global champion
in the ancient Chinese board game Go.
AlphaGo Shock
AI Shocked the WorldLee Sedol lost the first matchup,
but he’s got four more chances.
[in Korean]
This is the team that played Go with Lee Sedol. [David] We got our newspapers. [Veda] But we are not responsible.
It’s just the man in the beanie. [all laughing] Sorry. AI Defeats Human BrainIt is a bit strange
being on the front cover
and everything as a computer scientist.Normally, you sit there
in your corner and you code.
Nobody really knows about it.Perhaps you’ve heard the joke, “How can you tell
that a computer scientist is an extrovert and not an introvert?” If he’s an extrovert,
he looks at your shoes when he’s talking to you,
instead of at his own. [Julian]If you look at Aja,
he avoids all the cameras like crazy.
He’s like, the game is finished,
and he’s, like, out the back,
and back in his room.And I think a lot of computer scientists
would be like that.
We are more about doing our work
than standing in the spotlight.
[elevator dings] [Chris]Hello, and welcome
to Game Two, Round Two,
in the Google DeepMind Challengethrowdown between man and machine.Game One, the machine takes down man.Huge shock. Headlines around the world.[Andrew]The reactions on the ground here
from the folks in Korea were just stunned.
They estimate 60 million people
watched the game in China alone.
Probably bringing it up
to maybe 80 million people
who watched this game worldwide.It was just incredible.And if anything, today is probably
even more of a madhouse.
So, Lee Sedol knows today.He knows that this is just
a really important game. Right?
He has got to win.[in Korean]
[man #3] Go, Lee Sedol! [woman #2] Fighting! [in Korean]
[Yeowon]Can you tell what Leeis thinking by looking at his face?Does he seem nervous?[Changhyuk]Yes.
Lee seems to be very tense.
My guess is that
he didn’t sleep well last night.
[Chris]Lee Sedol on white,I think probably looking
for a little payback.
[Michael]My impression is that maybe
he underestimated AlphaGo,
and he is going to change his tactics.[Demis] Lee Sedol’s playing
much, much slower today. Yeah. -Which is going to affect us.
-[George] Yes. He’s playing at half the speed, actually. [in Korean]
It is hard to say who is ahead or better now. [Changhyuk]The last two moves
make me doubt AlphaGo’s ability.
-[Yeowon]But we have to stay alert.
-[Changhyuk]Yes.Yes. This is difficult.
AlphaGo is hard to understand.[Michael]If I see anything about AlphaGothat is not normal,
is maybe the way it handles a game
when it thinks it is ahead.
-[Chris]Yes.We’re actually going to have a visit
from one of the team,
and we will talk about exactly
that point from the inside.
Thanks so much for coming by, Thore.I really appreciate it.Can you sort of share a bit
of what is going on in AlphaGo? So, AlphaGo has these three
main components. [Thore]There’s the policy network,which was trained on high-level games
to imitate those players.
And then, we have a second component.
We call this the value net.
And it can evaluate the board positionand say what is the probability of winning
in this particular position.
And the third component
is the tree search,
where it would look through
different variations of the game
and try to figure out
what will happen in the future.
[stone clacks] [Thore]So if we now take
a position like this,
first, the policy network
would scan the position
and come up with what would be
the interesting spots to play,
and it builds up a tree of variations.And then employs this value netthat tells it how promising is the outcome
of this particular variation.
[clacks] So, AlphaGo tries to maximize
its probability of winning, but it doesn’t care at all about
the margin by which it wins. [Michael] Okay, so when you see
a slow-looking move, that’s maybe an indication that AlphaGo
thinks it has a good chance to win. -Yeah, that is a little giveaway.
-Yeah. -A little tell. We’re looking for a tell.
-Oh, yeah. [in Korean]
Lee Sedol is playing in a completely different style
from his usual style. This is a historic moment
and Lee Sedol is the center of attention. He must be feeling immense pressure. [Master Kwon]I hope he gets over
this pressure and enjoys the match.
[retreating footsteps] [Chris]Ooh, it looks like Leeis taking a little bit of a break.[somber music] [Fan]Lee Sedol go to smoke,and AlphaGo just plays.It don’t think about
if the opponent will be there or not.
So, Aja sees AlphaGo plays move 37,and Aja puts the stone on the board.-[Changhyuk]Oh.
-[Yeowon]Oh, wow.-Oh, it’s totally an unthinkable move.
-Yes. The value… That’s a very…
That’s a very surprising move. [Chris]I thought it was a mistake.
[chuckling] [Fan]When I see this move,
for me, it’s just a big shock.
What?Normally, humans, we never play this onebecause it’s bad.It’s just bad.
We don’t know why, it’s bad.
It is a little bit high. Yeah? It’s the fifth line. Normally, you don’t make
a shoulder hit on the fifth line. So, coming on top of a fourth line stone
is really unusual. [Chris] Yeah, that’s an exciting move. I think we are seeing
an original move here.That is the kind of move
that you play Go for.
[Thore] Hey. Interesting stuff. -This fifth line shoulder hit was good.
-Yeah. [Michael]And I wasn’t expecting that.I don’t really know if it’s a good
or bad move at this point.
[David]The professional commentators
almost unanimously said
that not a single human player
would have chosen move 37.
So, I actually had a poke around
in AlphaGo
to see what AlphaGo thought.And AlphaGo actually agreed
with that assessment.
AlphaGo said there was
a 1-in-10,000 probability
that move 37 would have been played
by a human player.
So it knew that this was
an extremely unlikely move.
It went beyond its human guide,and it came up with something new,
and creative, and different.
[Cade]I am very much watching the game
through these commentators.
That is the way it works.So when they are confused,
I’m certainly confused.
At the same time,
I’m latching on to the fact
that they are confused, right?That is an interesting moment.When everyone else is confused,
who is not confused, right, besides the machine? [Fan]I want to see Lee Sedol
when he see this move.
[Chris]He is back. Lee is back.[tense music] [tense music continues] [in Korean]
[Sedol]I thought AlphaGowas based on probability calculationand that it was merely a machine.But when I saw this move,
I changed my mind.
Surely, AlphaGo is creative.This move was really creative
and beautiful.
[Fan]Normally, he has to thinkabout one or two minutes, no more.But this time,
he thinks more than 12 minutes.
[somber music]The more I see this move,
I feel something changed.
Maybe, for humans, we think it’s bad,but for AlphaGo, why not?[Cade]Go is like geopolitics,like something small that happens here,it can have a ripple effect, you know, hours down the road
in a different part of the board.The game kind of turned on its axis
at that moment.
[Fan]This move is very special,because with this move,all the stones played beforeis work together.It’s connect.It look like network, link everywhere.It’s very special. Very special. [in Korean]
[Sedol]This move made me thinkabout Go in a new light.What does creativity mean in Go?It was a really meaningful move.[Michael]This is a tough gamefor Lee Sedol.AlphaGo is just not letting Lee Sedoldo what he wants.
-[Chris]Right.Black has almost 60 points. That’s a lot. [Andrew]That’s not a good sign.[Myungwan]Oh. Oh.[Andrew]Lee Sedol just slapped himself
on the side of the head.
[Myungwan]Oh, wow.I think black is ahead at this point. [Demis] It’s looking good, isn’t it?
We’re on that steady… steady path now. [Fan]I just see Lee Sedol.He lose so much.Normally, we resign before long time ago,
but he wants to try.
He play, he play, he play.He just don’t want to resign.[tense music] [Michael]Because then white…
Oh, he resigned.
It looks like Lee Sedol has just resigned. [Demis] It doesn’t make any sense.
I didn’t foresee that one. -Move 37, very beautiful.
-Yes. Beautiful, yeah. [somber music] [Demis] Is he okay? I brought his friend,
because yesterday I noticed that he really wanted to analyze the game. [in Korean]
I didn’t realize how bad it was. [somber music] [Cade]There was this heavy sadnessover that whole floor,and you could feel it during the game.I felt it during the game.And I’m leaving the commentary room
to go to the press conference,
and I was stopped by someone,another technology reporter. At first, all he wanted to talk about was the technology and how great this was,but then, even he kind of slipped
into this moment of melancholy
where he was upset as well.[in Korean] Yesterday, I was surprised,
but today, I am quite speechless. [translator] “I am quite speechless. I admit that it was a very clear loss
on my part. From the very beginning of the game, there was not a moment in time
that I felt that I was leading the game.” [Cade]You feel elated,
and you feel a little bit scared.
There is something, I think,
frightening to people about a machine that learns on its own. [Julian]For us, AlphaGo is obviously
just some computer program.
But looking at the commentary
on the internet,
I already saw the commentators
call AlphaGo
like “he” and “she” during the games. Completely unconsciously.Which… AlphaGo is really
a very, very simple program.
It’s not anywhere close to full AI,
and we already see that happening.
So I find that very interesting.[zaps] [crackling] [Nick]The tendency
to anthropomorphize AI systems
is one of the big obstaclesin the way of actually trying
to understand
how AI might impact the world
in the future.
For example, the conversation is about what could go wrong, what the risks are. And invariably, you see
thisTerminatorpicture.Every single time,
there are these red glowing eyes, right?
[Fei-Fei]We’re really closer
to a smart washing machine
thanTerminator. If you look at today’s AI, we are really very nascent. I’m extremely excitedand passionate about AI’s potential.But AI is still very limited in its power.[Cade]I think that people
are right to think
that there is a danger that as we continue
to improve these systems, that we might miss that threshold
where we do cross over into danger.But the good news isthat there are already people
thinking about those dangers.
You know, there’s a lot of talk now,
and we are leading the discussion on this, that maybe there should be a kind of, cross-industry best practices
working group or something. Right. Where the leaders of the research teams
in those organizations, you know, the big ones that are working
on AI, IBM, Microsoft, so on, come together and make sure that AI
is used ethically and responsibly. I think what is important
is that there is this community of people who are leading the cutting edge of AI, who are interacting with academics, and already are thinking
about the long term, and how we can ensure
that innovation is responsibleas the power of these machines
gets even greater.
Lee Sedol Lost by Resignation [Chris]This is it, folks.Day Three, Game Three.
Lee Sedol, Go Master.
Back to the wall. He’s down two-zero.He’s got to win today to keep hope alive.[in Korean]
[Hyunwook]Lee Sedol had a day offafter losing two games,and he gathered with Go professionals and analyzed the game all night. I heard that four pros, yeah,
went to visit him. -Hm.
-To console him and to review AlphaGo’s… Console him?
Do you think he’s upset, or… [Hyeyeon]I mean, Lee Sedol
is upset. Yeah.
[Aja]In the beginning,
there was a fierce fight,
and AlphaGo played very well.So he secured a very early lead.From move 50, the win rate
was very high already. It was climbing toward 100%. [Chris]Oh, that’s a pretty move.What’s your probability rating? -Like, 91?
-[Julian] No. -[man #4] It seems 70, you think?
-No. [in Korean]
He must want to win desperately right now. [Master Kwon]But I think the pressureand the psychological burden is adding up.Today must be the worst.I personally believe,when you try too hard to win,
you will lose.
[Fan]
He tried to fight directly in the game
but it’s not his style. When we change our style
to play with opponent, normally, it’s very, very bad.So it’s a game more easy for AlphaGo.-It’s looking good for us.
-[Michael]Hopefully, I think…You know, that black group is huge,
and it has got nowhere to go, and it is going to be running around. [somber music] [Hyeyeon]I don’t know
how to describe the situation.
If I were black, I will resign.
[chuckles]We should admit that we are facing
the strongest existence ever,
ever in the Go history.There’s no point
in playing out the endgame, and you’re going to lose, right? So… [rattles] [Michael]Even if black can live there…-[Chris] It’s done. It’s done.
-[Michael] Oh, he resigned. Okay. Wow. Wow.
[sighs] [Chris]You saw history made here tonight.[Michael]AlphaGo has won again.
Three straight wins.
[Chris]Three straight wins.
Has won the match.
[Fan]When Lee Sedol resigned the game,
he looked like unhappy.
It’s not just he lose the tournament, it’s just especially about this game,because he don’t play his game.I’m very hurt about this, very. But I can do nothing. [Demis]You know, suddenly, I feel
a bit ambivalent about it,
given I’m a games player,and, you know, Go is the pinnacle
of board games.
But I really liked the statementof one of the top Chinese professionals.
He said, you know,
“If AlphaGo wins, maybe we’ll really start
to get to see what this game is about.”
[Maddy]I couldn’t celebrate.It was fantastic that we had won,but there was such a big part of methat saw this man trying so hardand being so disappointed.[clicks] [Fan] I see the internet,
many, many people talk about Lee Sedol. Maybe he don’t play the best. We are Go player. Okay, sometimes in China,
in Korea, in Japan we see Go like art. We are artists, you know. -We play our best for Go.
-Right. Right. -So, be gentle with Lee Sedol.
-Right. He’s a very, very good player.
He’s a great player. I am in the room. I see Lee Sedol.
He wants win. He try everything. It’s just we can’t. Just it’s so… [in Korean] I think I have to express
my apologies first. If I had been able to play better
or smarter, the results might have been different. I think I disappointed too many of you
this time. I want to apologize
for being so powerless. I’ve never felt…
[chuckles] this much pressure, this much weight. I think I was too weak to overcome it. [Sedol]I can’t believe this is happening.Regardless of your opponent’s level,to be defeated not by three-zero,
but five-zero?Losing to AlphaGo by five-zerowould really hurt my pride.I also feel so bad for the people
who have supported me.
[in Korean]
Lee Sedol, 9-dan, has the strongest heart of anyone I know. [Hyunwook] He is fighting a lonely fight. His opponent does not exist
in physical form. I really feel for him. We still have Games Four and Five, and if Lee Sedol, 9-dan,
plays like himself, I believe we can beat the machine. [uplifting music] [Cade]You could see
that he was more relaxed
after he had lost three games in a row.That said, the stakes were still high.You know, in the end,
it isn’t about pride.
[Fan]He don’t feel like confidence,but he feels light.[Chris]Can Lee Sedol
find AlphaGo’s weakness?
Is there, in fact, a weakness?I was thinking I would just pull the plug. -You would just pull the plug?
-Yeah. [Hajin]Everyone is still
cheering for Lee Sedol.
And…Yeah, it’s not going very well. [in Korean]
[Taegon]Lee Sedol has chosento play conservatively.[Hojung]But I am not sure
it will benefit him.
I agree. Yes, it doesn’t look like
a very good strategy for him. It feels pretty good for black at this point. -It feels pretty good for black, yes.
-Pretty good for black. Yeah. [Fan]I want Lee Sedol to play his game.Because for the moment,
he try many, many things
to play with AlphaGo,to understand AlphaGo,but he never tried to play himself.I talk many, many times,AlphaGo look like the real mirror.When you play with AlphaGo,you feel very strange.You look like you’re all the time naked.The first time you see this,
you don’t want to see because…
“Oh, this is me? Real me?”And more then more, you need accept.“Oh, this is the real me. So, how? Now, how I can do?” [stones rattling] [Michael]It’s developing into a very,
very dangerous fight.
This is really Lee Sedol’s type of game.
He likes this kind of fight.
White has to find something
inside black’s territory.
[Hajin]I think that he
is already planning on trying something.
So you believe in Lee Sedol’s ability to live in that very small area, right? Yes. Yes. There is a little potential there. And I think, maybe he is going to try
to do something. -[Andrew]Lee Sedol magic!
-[Myungwan]Nice.[Myungwan]Oh, what would be
the magic move?
Lee Sedol is running short on time,but he’s going to have to use up
all his time.
[Chris]Yeah, he has just burned, like,
seven or eight minutes,
just on this move already.[Myungwan]I don’t see anything.We can’t find anything. [in Korean]
Show us something. I don’t see any possible move.
[chuckles] [Chris] What is Lee Sedol up to here? [Michael]
Yeah, he is really concentrating. [Chris] He really is. Look at that. [Fan]Lee Sedol is very patient.He wait, he wait, he wait his moment.I feel something, he looks like the wolf. Wait in the forest, in the winter.He cold, he feel very, very cold.But he need patience.But the moment is coming…he go out to attack. [Michael]This is the hinge of the game.Oh. Look at that move.
That’s an exciting move. -Basically, I believe that this time…
-[Andrew]He found a wedge.[Chris] Whoa. [Michael]It’s going to change
the equation
because now black cannot escape.That would be so cool if that works. [suspenseful music] Oh! [Andrew]AlphaGo has just played
something maybe unusual.
[Michael]You know, I’m not actually sure
what AlphaGo is trying to do here.
[Chris]What’s that about?[Michael]I don’t really understand it.Well, well. That was a sharp drop in win rate. That’s the sharpest drop
in win rate we’ve seen. [Julian] It dropped eight percent.
[indistinct voice] -[George] Wow.
-[Julian] Wow. [Andrew]This could be that it actually
can’t find a way through.
-I think this is…
-Uh-huh. It has looked far enough ahead
to see that it doesn’t work, and now maybe it’s on tilt. I don’t know. [Julian] Here it comes.
[laughs] -[Michael]That was one time.
-There it comes, though. It looks like it has fallen off the cliff. -Yeah, it has made a mistake.
-[Michael]Yeah.Did anything strange happen in the… -[Julian] No, it all looked normal.
-Yeah. Well, we can definitely say
there is a weakness. Well, we definitely say there’s a mistake. [David]I felt this mixture
of this sinking feeling in my stomach,
where I was wondering if AlphaGo
was becoming delusional in this situation.
Where I could see that it was starting
to play strangely,
and at the same time,
relief, that Lee Sedol,
that he was actually in with a chance now.Aja’s trying not to look horrified. [Aja]I knew after move 78,
after, like, 10 or 20 moves,
I saw AlphaGo’s strange moves.And I knew AlphaGo somehow
became crazy, but I didn’t realize why. What? We searched to 95 ahead at that point? At the part where it made the mistake? -[George] Yes.
-I think that something went wrong. That’s the longest it has searched
the entire game, isn’t it? Yeah. I think it’s like it searched so deeply, -it has lost itself.
-[George] It’s tired. [Michael]I do get the impressionthat AlphaGo has sort of,
gone off on a tangent.
-What is it doing now?
-Well, maybe it has a master plan. No, it doesn’t even think it has, does it? So it knows it has made a mistake,
and it starts evaluating it the other way. [Demis]Look, look, Lee is confused.
He’s like, “What is he doing?”
That’s not a “I’m scared” confused,
that’s a “What is it doing?”
What’s going on? You know, you asked if it was a bug. I’ve said before that if… -Yeah, right. That’s what I thought.
-If DeepMind has figured out how to write code that doesn’t have bugs, that is a bigger news story than AlphaGo. -[David] Are you kidding me?
-Hm? This… Literally, this next move
we are going to play, I think they are going to laugh.
I think Lee is going to laugh. [tense music] [Taegon]Oh! Oh![in Korean]
What is this? [audience laughing] -Oh, that’s ridiculous!
-What’s going on? What is it thinking? [Michael]I don’t really know
what AlphaGo is trying to do here.
That’s the understatement of the year. [Myungwan]Is it a mouse misclickfrom Aja Huang?
-[Andrew]Nope, that’s the move.Aja Huang makes no misclicks.Lee Sedol is very confused.These are not human moves.This move is also sort of inexplicable. [Chris]I mean, those, you can clearly
call those mistakes.
[Michael]Yes, of course.But it’s the first time
in the four matches –that we have seen moves like that.
-[Chris]Right.Oh, the value dropped even more. That’s weird. We’re at 45%. [foreboding music] [Myungwan]White.-[Andrew]White.
-[Myungwan]I think white is winning.[Andrew]Come on, Lee Sedol.-It’s unbelievable.
-Yeah, all right! I was so confident that this black area
would just be consolidated by black, and there was nothing there. And somehow, he has just erased it all.
Like, it’s gone. [Andrew]So, he has found his weakness.That wedge move probably surprised it. -The wedge, yeah.
-Yeah. AlphaGo seemed to have
such a good game, and then… this whole sequence in the center
sort of changed that. He pulls off a miracle. He managed to make it so complicated that the artificial intelligence
doesn’t evaluate it correctly. [Andrew]I think it looks like Aja Huang
maybe, sitting there,
also knows that the game is over.I can’t… I can’t stop smiling.
[chuckles] [Myungwan]Did he smile?[Andrew]No, I haven’t seen him smile yet.I think he is still checking.
-[Myungwan]He’s so serious.[Andrew]He’s so serious.He wants to be careful.
-[Myungwan]Yeah.He concerns a lot.He really does his best.I think he feel something like…responsibility, or burden.I think it’s almost over. [David]So, what’s the percentage?[Julian]It shows as 18.2%.[David]The next move should be resign.[tense music]There you go. AlphaGo resigned.-It looks like AlphaGo has resigned.
-[Chris] Wow. [Cade]The most amazing game.I’m almost going to tear up,
was, uh, Game Four… [clears throat]
um, where he comes back and wins, right? [cheering]
It resigned! [crowd cheering] I’m so happy! [cheering continues] [crowd applauding] [in Korean]
[Sedol]I heard people shouting in joywhen it was clear that AlphaGo
had lost the game.
I think it is clear why.People felt helplessness and fear.It seemed like we humans
are so weak and fragile.
And this victory meant…we could still hold our own.As time goes on, it will probably be
very difficult to beat AI.
But winning this one time,
it felt like it was enough. One time was enough. I heard from so many people saying they were running out in the street. They were so happy. They were chanting, they were celebrating. Especially after zero-three down, at the time, it seemed to be hopeless,
that the end of the world was coming, but we saw the light. Usually… I’m happy when I win,
not when my colleague wins. But, this time, it felt like my win. [in Korean] I didn’t want to make a move
which AlphaGo could predict. This part… It didn’t anticipate this wedge move. I won one game at least. Good job today. [stones rattling] [relieved sigh] [uplifting music] [crowd applauding] [crowd cheering] [loud applause] [in Korean]
[Sedol]But I didn’t expect itto be like this.I couldn’t believe I won one game.It was unbelievable. [Sedol] Thank you very much. [laughter] I have never been congratulated so much
for winning one game. After losing three games in a row,
I couldn’t be happier. [crowd cheering] This victory is so valuable
that I wouldn’t exchange it for anything in the world. My question is about move number 78. [journalist #3] Chinese top Go player
Gu Li said that it was a god’s play. What were you thinking
when you made that play? Thank you. [in Korean]
At that point in the game, move 78 was the only move I could see. There was no other placement. It was the only option for me,
so I put it there. I am quite humbled by all the praise
I am getting for it. [David]It does leave me a little bit
in awe of the human brain’s power,
in particular, Lee’s amazing ability
to cause AlphaGo problems
and find something
seemingly out of nothing.
And so, we really want
to understand what had happened.
[Chris] So, it really was Lee’s move? [Aja] The key is the center. After center go out, there was no chance. [David] Come, come. We were winning before this. But if AlphaGo thought it was winning and it couldn’t convert that win,
that means it wasn’t actually winning. Otherwise, it would have had
the right responses. [Thore] Would we have played it? [Maddy] Nerves of steel in there. What probability does it give it as white? [indistinct chatter] 0.007%. Is that in the position that he played? -That’s when he played it.
-I see. -We thought this was a 1-in-10,000 move.
-I know it was like… -Yeah.
-The values we didn’t know about. -So the God move was literally a God move,
-Yeah. because we believe
that only 1 in 10,000 humans -would have found that move.
-That’s right. It doesn’t come to mind
as one of the top five moves you would consider. Unless you’re Lee Sedol,
he said it was the only move. He thought it was the only move.
Yeah, remarkable, isn’t it? [exciting music] [Chris]Welcome back to the Four Seasons.World Champion Lee Sedolwent looking for AlphaGo’s weakness
in Game Four, and he found it.
Today, last round, he is looking to see
if he can repeat that.
We will see what happens.[Andrew]The place
is a madhouse downstairs.
Maybe as many, if not more,
journalists here today
than there were for Game One.[Maddy]We were really excited
for the fifth match,
to see what would happen.Was this going to be a three-two thing
or was it going to be a four-one thing?
And, you know, there’s a different message
with both of those.
[Fan]For me, I don’t think
AlphaGo will make the mistake again.
But who knows.Maybe it will be coming.And Lee Sedol have now
more confidence about this.
Look like maybe Lee Sedol find the key
to open AlphaGo.
[in Korean]
Oh, this works! Is it fair to say
that AlphaGo made a mistake? We might have another victory today. You weren’t crazy
about the timing on this move. -Yeah.
-And now, you don’t approve of this. Yeah, I’m sort of thinking
that maybe AlphaGo hasn’t recovered from Game Four yet. Yeah.
[Chris chuckling] [Demis] Still deluded? [Julian] We don’t know. Oh, no, I hope he doesn’t… No, no, he needs to play the…
[clicks tongue] [Demis sighs] [Fan]He play some moves.It’s bad moves.I feel something.Oh, maybe his weakness come back again.[Chris]Are we seeing
another short circuit?
Or is there something, what’s…[Michael]I think it could be
a kind of a misreading.
[Chris]And we are…You’re pretty comfortable
with saying that…
[Michael]That it is looking good
for Lee Sedol?
[Chris]It’s looking good for Lee Sedol.What is he playing in there for? There’s no reason for white
to be playing that move. [Michael]It’s a bad move.And in some cases,
it’s going to lose a point, too.
It is exactly the same thing.Ninety-one percent certain now. [Michael]Someone was telling me
that maybe it had…
Yeah, because it’s incorrect again. [Julian]The whole game,
we thought that AlphaGo
was wrong about the board position.We were super worried that,
“Oh, it’s going to play garbage.It’s going to be like lose
in a very embarrassing way.”
And this continued for the whole game.This is a bit weird. -When did it play that?
-Just now. -So I don’t know. I mean, it doesn’t…
-Well, that we don’t know. But we’re not good enough
Go players to know that, right? Yeah. [Julian]As it turns out,
none of us know Go well enough
to accurately judge what AlphaGo is doing. White is winning now. This one looks like white is winning. Ah! We all say some of AlphaGo’s moves
are so weird and strange, and may be mistakes. [Chihyung]But after a game is finished,we have to doubt ourselves, our judgment.AlphaGo making another
kind of nonsensical throw-in. I’m not really sure what that’s about. This is what 10
or maybe 11-dan play looks like. It looks weird,
and we don’t quite understand it. [Chihyung]
I think it’s important to study more
about AlphaGo’s mistake-like moves.
[chuckles] Then maybe we can adjust
our knowledge about Go. [Frank]To me, the most amazing thing
to come out of my understanding of Go
as a result of watching AlphaGo playare the infamous “slack moves.” Well, there’s something strange -about the way it is playing,
-[Chris] Yeah. because it’s playing some moves
that are not really necessary. Right. [Frank]A “slack move” is a move
that looks lazy.
You can see these other better moves,
and AlphaGo is rejecting them.
But what I think AlphaGo is teaching usis that we have been using score
as a proxy for chance of winning.
So the bigger my margin of territory,the more confident I am
that I’m going to win.
And AlphaGo is saying, “No, no, no.It shouldn’t matter how much you win by, you only need to win by a single point.Why should I be seizing all this
extra territory when I don’t need it?”
The lessons that AlphaGo is teaching usare going to influence how Go is played
for the next thousand years.
By my counting, white won this game. How… By how much?
Are we talking two points? -One-and-a-half.
-One-and-a-half points. Yeah, maybe one-and-a-half. Of course, Go is just a game,
but we can learn important lessonsfrom a computer being so successful at Go.[Martin]Machines will have the capability
not only to crunch
through a huge amount of data,
but also to analyze it intelligently.
Just as in the case of the Go games,the machine-made moves
that surprised even the experts.
And, eventually, the machines
will gain our confidence
because we will see that very, very oftenthey make a better guess
than we could have made as humans.
[sharp inhale] [sighs] [in Korean]
[Jimyung] AlphaGo has strong foundation. [chuckling] [groans] [Sedol]What surprised me the most was…that AlphaGo showed usthat moves humans may have thought
are creative, were actually conventional.
I think this will bring
a new paradigm to Go. AlphaGo won this area as well? Oh, god.
[laughs] -That makes me very uncomfortable.
-Oh! Unfortunately, for Lee Sedol, I think white might have
a slight advantage here. [Michael]White lights up in places,
but if we count it like that, it’s 1.5.
[Demis] They keep saying
one-and-a-half points. How do you know the Korean room
has called it? Someone, um… -Who told us the Koreans called it?
-[Chris] I don’t know. [Demis] The Koreans told you? Koreans called it. Someone said the Korean room
has called it for AlphaGo. We would just like to know
if someone Korean in there can find out. [woman speaking indistinctly] [woman #3] The Korean room thinks
AlphaGo is winning. “Winning,” okay, not… then not won. -That’s what she said.
-“Winning.” She said they called it right there. [clears throat] AlphaGo’s saying it’s going to resign. -[Chris M.] What?
-No. I’m only joking. [all laughing] Jesus, I almost had a heart attack. Dave, don’t do that. It’s ridiculous. That was a very good one.
[laughs] -[Veda] Well played.
-Yeah. -[Veda] Well played.
-No, not really. I couldn’t do it for too long.
I just couldn’t think like that. [Chris M.] Dave, you’ve been waiting
two years to do that. He needs to do that.
[laughter] We don’t know the score.
We have no idea what’s going on, right? [in Korean]
Two-and-a-half points. Lee is two-and-a-half points behind,
at least. [Michael]The parting in the center,it’s very hard to… It’s very hard to…[in Korean]
Lee is touching the bowl. [Jimyung]Looks like
he’s considering resigning.
[Seongryong]Yes.
I think he is thinking of resigning.
[indistinct chatter on TV monitor] [clacks] -Did he resign?
-[George] He resigned. Hm? He has what? I think he resigned.
[indistinct chatter] -[Julian] He resigned?
-I think he resigned. [indistinct chatter] Aja’s looking relaxed. -Yeah, he has resigned.
-He has resigned. [in Korean]
Yes, he is giving up. -Okay. That’s it. He has given up.
-Yeah. -Yeah!
-Yes! [applause] [indistinct chattering] [Demis]I mean, I think it just really
is a once-in-a-lifetime thing.
I would say it is the most amazing thing,
you know, I have experienced.You know, for us, it is the culmination
of a 20-year dream.
It started as a pure research endeavor. We just wanted to understand.
Can neural networks play the game of Go? And from there, it went on
to a level that I never expected. [David]And I’m unbelievably proud
of the team.
[Ioannis]When I started doing
artificial intelligence,
it was four or five years ago,and I was really interested in that,but, like, many people
would discourage me, and they would say,
okay, there is no future.So, actually seeing that within five yearswe are at this stage right now,it’s amazing by itself.Everybody say, “Nine dan.” -Nine dan!
-Nine dan! [man #5] Kimchi! [David]There are so many
possible application domains
where creativity, in a different dimension
to what humans could do,
could be immensely valuable to us.And I just love to have more
of those moments where we look back and say,
“Yeah, that was just like move 37. Something beautiful occurred there.” At least in a broad sense,
move 37 begat move 78, begat a new attitude in Lee Sedol,
a new way of seeing the game. [Cade]He improved through this machine.His humanness was expanded
after playing this inanimate creation.
And the hope is that, that machine,and in particular,
the technology behind it,
can have the same effect with all of us.[Martin]I remember hearing a talk
by Kasparov, who says that, uh,
a good human plus a machine
is the best combination. [Fan]This is a unique experience.Nobody can have this experienceplaying with AlphaGo,
five games like this.
So, I hope Lee Sedol can find
something in these five games.
Maybe some change in his game.I see today he fight, fight, fight.He’s very good.Big master, real big master.[in Korean]
[Sedol]I have grownthrough this experience.I will make something out of it
with the lessons I have learned.
I feel thankful and feel like I have found the reason I play Go. I realize it was really a good choice,
learning to play Go. [laughs] It has been an unforgettable experience. [calm music] [Fan]This event is done,but for all the story,
maybe it’s just the beginning.
We don’t know.[tranquil music]It’s just when I play with AlphaGo,
he shows me something.
I feel beautiful, just it.I see the world different,
before everything begin.
What is real thing inside the Go game?With this thing,
I will change something with my game.
Maybe he just can show humans
something we never discovered.
Maybe it’s beautiful.[inspiring music]