Name: 深度學習與SC2介紹--《星際爭霸II》中的Python人工智能教程第7頁。 (Deep Learning with SC2 Intro - Python AI in StarCraft II tutorial p.7)
Uploaded: 2021-01-14T12:27:49.000Z
Duration: 20 min 37 s
Description: 【看影片學英語】數萬部 YouTube 影片，搭配英漢字典即點即查，輕鬆掌握單字發音與用法，長久累積看電影不必再看字幕。

未來進行式

And welcome to part seven of the A I in Starcraft two with Python Siris in this video in the coming videos, we're going to be getting into what I know everybody has been winning for, and that is deep learning.

So, up to this point, we've got just a simple rule based a I, even though it's just if statements some people who seemed confused, it is still a I Ah, but what we're gonna be doing now is implementing deep learning now, right out of the gate.

I just want to say, First of all, this is a completely unsolved problem.

I mean, you know, defeated expert players.

They have done it in s'more simplified games like, you know, if we can remove a lot of complexity from the game, we can definitely defeat human players already, but so far that the actual game itself in its entirety, um, you know, allowing let's say, us tow, tow, build all kinds of different units, build different buildings, research, different upgrades and stuff like that that has not been defeated because it's just so complicated.

So, uh so, first of all, let's get that out of the way.

Second of all, I do not know the answer to this problem.

Forward is my attempt at solving Starcraft, who is deep learning.

So the first thing is, especially with an unsolved task like this is there is there is no tutorial that says, Oh, use this network or whatever.

We have to figure out how we're going to solve it.

When I have a problem like this, the first thing we got to think about is what you know, what do we hope to achieve?

Um, but first we need to just, like, dramatically simple simplify what's going on here.

And at least for me, I think the weakest point in our bots at the moment and, um, a relatively easy task would be the attack method here, so I can simplify the attack to be you know, Don't attack, Defend our base, attacked the enemy base or attack any buildings.

Attack enemy units so I can break that down into four really simple choices.

And then we could take those choices, and we can either reply them unit, um, you know, by unit or by entire army or entire Idol army.

That's not already performing some objective.

So I think the best starting point it would be to apply it to the entire idol army.

You know, on a per unit basis, I think that would result in really cool things, but I think it will overly complicate things to start.

We know what we want the output of our neural network to be.

What's the structure of our neural network?

Well, I know a lot of people are going to be like I want reinforcement learning and the only reinforcement learning everyone seems to know about its cue learning.

I think you learning is way too going to be way too complicated for this kind of a challenge where you take a path.

And then if you got the reward, you, you know, divvy up that reward amongst all the steps you took along the way in your path.

First of all, it's gonna result in a huge amount of training data like but but not really meaningful.

But also, it's just it's not really the best solution.

So other than being click baby, I don't think you learning is actually how we're gonna solve this again.

Just don't think it's gonna be that, um there are other forms of reinforcement learning surprise.

But I think what I want to go with is more like an evolutionary learning method.

So the idea is to have an aye aye, that makes choices.

And if it makes good choices and it wins the war, well, congratulations.

You get to move on your become a continued asset to the gene pool, and if you lose the battle well, you're forgotten history.

You don't get to reproduce into the future.

So I think that makes a little more sense here, and especially if we are able to get down to it.

You know, unit by unit or something like that could be kind of cool, but really, the victorious algorithm either wins or loses as a whole.

So anyways, that's the way I want to do it.

Okay, so that's kind of the structure of how I want to do things we still have to talk about.

What is the neural networks that we're gonna use?

Because basically, what kind of input do we want?

Because basically, when you choose a neural network, you gotta think about what kind of input we're gonna put in.

So again, we're just don't We're going from the end forward here.

Um, starting with you know what did we want our neural network to output?

You know, what are our hopes for in terms of how it's gonna actually learn.

Now, what are we gonna put into this neural network?

And that's going thio basically force our hand was what kind of girl that we're going to use.

And the issue here with Starcraft two is there's so many variables that are.

You know, there's almost a variable number that well, there is a variable number of variables, and even our variables have variables.

So you know, each unit is a variable, but then the type of unit And where is that unit?

It's very hard to feed it into a neural network so immediately.

We're looking at some pretty complex networks.

So to me, I think the simplest network that you can pass any amount of data and any variable data to would be a convolution neural network because you could visualize everything.

So, first of all, you can visualize the unit.

You have a color code units based on what they are, you concise eyes, them, uh, you can also visualize things like our our materials.

Like, how much minerals do we have in the gas that we have you?

Could you visualize that with a bar or something like that?

And the confident should be able to figure that out.

So that's my plan going in, and the first thing that we have to do is basically well, there's two things we have to kind of modify this a little bit.

We wantto further simplify because you just got to make things as simple as possible to start.

If you're successful, make it a little more complex.

So the first thing I want to do is I just I don't want the stalker's anymore.

Because if we only do void raise, we really can't defend ourselves against early rush is, um so just keep that in mind.

Otherwise, I think I'm gonna leave the attack method the same because we're not going to build stalkers anymore.

And we only need that gateway to build the cybernetics core, which we need for the Star Gate.

So, um, so rather than this logic, I'm just gonna get rid of this and make that one.

So if we have less than one gateway well, let's build one.

We'd like to just build Well, let's just get rid of the divided by two, and then these extra parentheses here.

字幕列表影片播放

深度學習與SC2介紹--《星際爭霸II》中的Python人工智能教程第7頁。 (Deep Learning with SC2 Intro - Python AI in StarCraft II tutorial p.7)

stuff

entire

figure

guarantee