字幕列表 影片播放
Let's go talk about robotics, shall we?
我們來談談機器人技術,好嗎?
Let's talk about robots.
讓我們來談談機器人。
Well, the time has come, the time has come for robots.
機器人的時代已經來臨。
Robots have the benefit of being able to interact with the physical world and do things that otherwise digital information cannot.
機器人的優勢在於能夠與物理世界互動,做一些數字信息無法做到的事情。
We know very clearly that the world has severe shortage of human laborers, human workers.
我們清楚地知道,世界嚴重缺乏人類勞動力和人類工人。
By the end of this decade, the world is going to be at least 50 million workers short.
到本十年末,全世界將至少缺少 5000 萬名工人。
We'd be more than delighted to pay them each $50,000 to come to work.
我們非常樂意為他們每人支付 5 萬美元,讓他們來工作。
We're probably gonna have to pay robots $50,000 a year to come to work, and so this is going to be a very, very large industry.
我們很可能要支付機器人每年 5 萬美元的工資來工作,所以這將是一個非常非常龐大的產業。
There are all kinds of robotic systems.
有各種各樣的機器人系統。
Your infrastructure would be robotic.
你們的基礎設施將是機器人式的。
Billions of cameras in warehouses and factories, 10, 20 million factories around the world.
倉庫和工廠裡有數十億個攝像頭,全球有 1,000 萬、2,000 萬個工廠。
Every car is already a robot, as I mentioned earlier, and then now we're building general robots.
正如我之前提到的,每輛汽車都已經是一個機器人,現在我們正在製造通用機器人。
Let me show you how we're doing that.
讓我告訴你我們是如何做到這一點的。
Everything that moves will be autonomous.
一切移動都將是自主的。
Physical AI will embody robots of every kind in every industry.
物理人工智能將體現在各行各業的各類機器人中。
Three computers built by NVIDIA enable a continuous loop of robot AI simulation, training, testing, and real-world experience.
由英偉達™(NVIDIA®)公司製造的三臺計算機實現了機器人人工智能模擬、訓練、測試和實際體驗的連續循環。
Training robots requires huge volumes of data.
訓練機器人需要大量數據。
Internet-scale data provides common sense and reasoning, but robots need action and control data, which is expensive to capture.
互聯網規模的數據可以提供常識和推理,但機器人需要行動和控制數據,而獲取這些數據的成本很高。
With blueprints built on NVIDIA Omniverse and Cosmos, developers can generate massive amounts of diverse synthetic data for training robot policies.
利用基於 NVIDIA Omniverse 和 Cosmos 構建的藍圖,開發人員可以生成大量不同的合成數據,用於訓練機器人策略。
First, in Omniverse, developers aggregate real-world sensor or demonstration data according to their different domains, robots, and tasks, then use Omniverse to condition Cosmos, multiplying the original captures into large volumes of photoreal diverse data.
首先,在 Omniverse 中,開發人員根據不同的領域、機器人和任務彙集真實世界的傳感器或演示數據,然後使用 Omniverse 對 Cosmos 進行調節,將原始捕獲數據乘以大量逼真的多樣化數據。
Developers use Isaac Lab to post-train the robot policies with the augmented dataset, and let the robots learn new skills by cloning behaviors through imitation learning, or through trial and error with reinforcement learning AI feedback.
開發人員利用 Isaac 實驗室使用增強數據集對機器人策略進行後期培訓,讓機器人通過模仿學習克隆行為,或通過強化學習人工智能反饋進行試錯,從而學習新技能。
Practicing in a lab is different than the real world.
在實驗室裡練習與現實世界不同。
New policies need to be field-tested.
新政策需要經過實地檢驗。
Developers use Omniverse for software and hardware-in-the-loop testing, simulating the policies in a digital twin with real-world environmental dynamics, with domain randomization, physics feedback, and high-fidelity sensor simulation.
開發人員利用 Omniverse 進行軟件和硬件在環測試,在數字孿生中模擬具有真實環境動態、域隨機化、物理反饋和高保真傳感器模擬的策略。
Real-world operations require multiple robots to work together.
現實世界中的操作需要多個機器人協同工作。
Mega, an Omniverse blueprint, lets developers test fleets of post-train policies at scale.
Mega 是 Omniverse 的一個藍圖,可讓開發人員大規模測試車隊的列車後政策。
Here, Foxconn tests heterogeneous robots in a virtual NVIDIA Blackwell production facility.
在這裡,富士康在虛擬的英偉達 Blackwell 生產設施中測試異構機器人。
As the robot brains execute their missions, they perceive the results of their actions through sensor simulation, then plan their next action.
機器人大腦在執行任務時,會通過傳感器模擬感知行動結果,然後計劃下一步行動。
Mega lets developers test many robot policies, enabling the robots to work as a system, whether for spatial reasoning, navigation, mobility, or dexterity.
Mega 可讓開發人員測試多種機器人策略,使機器人作為一個系統工作,無論是空間推理、導航、移動還是靈巧性。
Amazing things are born in simulation.
神奇的事物誕生於模擬之中。
Today, we're introducing NVIDIA iZake Groot N1.
今天,我們要介紹的是 NVIDIA iZake Groot N1。
Groot N1 is a generalist foundation model for humanoid robots.
Groot N1 是仿人機器人的通用基礎模型。
It's built on the foundations of synthetic data generation and learning in simulation.
它建立在合成數據生成和模擬學習的基礎之上。
Groot N1 features a dual-system architecture for thinking fast and slow, inspired by principles of human cognitive processing.
Groot N1 採用雙系統架構,既能快速思考,也能慢速思考,其靈感來源於人類的認知處理原則。
The slow thinking system lets the robot perceive and reason about its environment and instructions and plan the right actions to take.
慢速思維繫統可讓機器人感知和推理其所處的環境和指令,並計劃採取正確的行動。
The fast thinking system translates the plan into precise and continuous robot actions.
快速思維繫統可將計劃轉化為機器人精確而連續的動作。
Groot N1's generalization lets robots manipulate common objects with ease and execute multi-step sequences collaboratively.
Groot N1 的通用性可讓機器人輕鬆操縱普通物體,並協同執行多步驟序列。
And with this entire pipeline of synthetic data generation and robot learning, humanoid robot developers can post-train Groot N1 across multiple embodiments and tasks across many environments.
有了這一整套合成數據生成和機器人學習管道,仿人機器人開發人員就可以在多種環境下對 Groot N1 的多種實施方案和任務進行後期訓練。
Around the world, in every industry, developers are using NVIDIA's three computers to build the next generation of embodied AI.
在全球各行各業,開發人員都在使用英偉達™(NVIDIA®)的三臺計算機構建下一代人工智能。
Physical AI and robotics are moving so fast.
物理人工智能和機器人技術發展如此之快。
Everybody pay attention to this space.
大家注意這個空間。
This could very well be the world's first and very well likely be the largest industry of all.
這很可能是世界上第一個,也很可能是最大的產業。
At its core, we have the same challenges.
其核心是,我們面臨著同樣的挑戰。
As I mentioned before, there are three that we focus on.
正如我之前提到的,我們的重點有三個。
They are rather systematic.
它們相當系統化。
One, how do you solve the data problem?
第一,如何解決數據問題?
How, where do you create the data necessary to train the AI?
如何、在哪裡創建訓練人工智能所需的數據?
Two, what's the model architecture?
二、模型結構是什麼?
And then three, what's the scaling loss?
第三,縮放損失是多少?
How can we scale either the data, the compute, or both so that we can make AIs smarter and smarter and smarter?
我們如何才能擴大數據、計算或兩者的規模,從而讓人工智能變得越來越聰明?
How do we scale?
如何擴大規模?
And those two, those fundamental problems exist in robotics as well.
機器人技術中也存在這兩個基本問題。
In robotics, we created a system called Omniverse.
在機器人領域,我們創建了一個名為 "Omniverse "的系統。
It's our operating system for physical AIs.
這是我們的物理人工智能作業系統。
You've heard me talk about Omniverse for a long time.
你們早就聽我說過 Omniverse。
We added two technologies to it.
我們在其中增加了兩項技術。
Today, I'm gonna show you two things.
今天,我要向你們展示兩樣東西。
One of them is so that we could scale AI with generative capabilities and generative model that understand the physical world.
其中之一是,我們可以利用生成能力和能夠理解物理世界的生成模型來擴展人工智能。
We call it Cosmos.
我們稱之為宇宙。
Using Omniverse to condition Cosmos and using Cosmos to generate an infinite number of environments allows us to create data that is grounded, grounded, controlled by us, and yet be systematically infinite at the same time.
用 "宇宙 "來調節 "宇宙",用 "宇宙 "來生成無限多的環境,這樣我們就能創造出腳踏實地的數據,這些數據由我們控制,但同時又是系統性的無限數據。
Okay, so you see Omniverse, we used candy colors to give you an example of us controlling the robot in the scenario perfectly, and yet Cosmos can create all these virtual environments.
好了,你看,"宇宙",我們用糖果色給你舉了一個例子,我們可以完美地控制場景中的機器人,而 "宇宙 "卻可以創造出所有這些虛擬環境。
The second thing, just as we were talking about earlier, one of the incredible scaling capabilities of language models today is reinforcement learning, verifiable rewards.
第二件事,就像我們之前談到的,如今語言模型令人難以置信的擴展能力之一是強化學習,即可驗證的獎勵。
The question is what's the verifiable rewards in robotics?
問題是,機器人技術的可驗證獎勵是什麼?
And as we know very well, it's the laws of physics.
我們很清楚,這是物理定律。
Verifiable physics rewards.
可驗證的物理獎勵
And so we need an incredible physics engine.
是以,我們需要一個令人難以置信的物理引擎。
Well, most physics engines have been designed for a variety of reasons.
大多數物理引擎的設計都有各種原因。
They can be designed because we want to use it for large machineries, or maybe we design it for virtual worlds, video games and such, but we need a physics engine that is designed for very fine-grained, rigid and soft bodies, designed for being able to train tactile feedback and fine motor skills and actuator controls.
它們可以是為大型機械而設計的,也可以是為虛擬世界、視頻遊戲等而設計的,但我們需要的物理引擎是為非常精細的剛體和軟體而設計的,是為能夠訓練觸覺反饋、精細運動技能和執行器控制而設計的。
We need it to be GPU accelerated so that these virtual worlds could live in super linear time, super real time, and train these AI models incredibly fast.
我們需要 GPU 加速,這樣這些虛擬世界就能以超線性時間、超實時時間運行,並以難以置信的速度訓練這些人工智能模型。
And we need it to be integrated harmoniously into a framework that is used by roboticists all over the world, Mojoco.
我們需要將它和諧地整合到一個框架中,而這個框架正是全世界機器人專家都在使用的,那就是 Mojoco。
And so today we're announcing something really, really special.
是以,今天我們要宣佈一件非常非常特別的事情。
It is a partnership of three companies, DeepMind, Disney Research, and NVIDIA, and we call it Newton.
它由 DeepMind、迪斯尼研究院和英偉達三家公司合作開發,我們稱之為 "牛頓"。
Let's take a look at Newton.
讓我們來看看牛頓。
Tell me that wasn't amazing.
告訴我這還不夠精彩
Hey, Blue.
嘿,布魯
How are you doing?
你好嗎?
How do you like your new physics engine?
你喜歡你的新物理引擎嗎?
You like it, huh?
喜歡嗎?
Yeah, I bet.
是啊,我敢打賭。
I know.
我知道
Tactile feedback, rigid body, soft body, simulation, super real time.
觸覺反饋、剛體、軟體、模擬、超實時。
Can you imagine just now what you were looking at as complete real-time simulation?
你能想象你剛才看到的完全是實時模擬嗎?
This is how we're gonna train robots in the future.
這就是我們未來訓練機器人的方式。
Just so you know, Blue has two computers, two NVIDIA computers inside.
你要知道,"藍色 "有兩臺電腦,裡面有兩臺英偉達™(NVIDIA®)電腦。
Look how smart you are.
看看你多聰明。
Yes, you're smart.
是的,你很聰明。
Okay.
好的
All right.
好吧
Hey, Blue, listen.
嘿,布魯,聽著
How about let's take them home?
我們帶他們回家怎麼樣?
Let's finish this keynote.
讓我們結束這次主題演講吧。
It's lunchtime.
現在是午餐時間。
Are you ready?
準備好了嗎?
Let's finish it up.
讓我們來完成它。
We have another announcement.
我們有另一個公告。
You're good, you're good.
你很棒,你很棒。
Just stand right here.
就站在這裡
Stand right here.
站在這裡
Stand right here.
站在這裡
All right, good.
好的,很好
Right there.
就在那兒
That's good.
很好
All right, stand.
好了,起立
Okay.
好的
We have another amazing news.
我們還有一個驚人的消息。
I told you the progress of our robotics has been making enormous progress.
我告訴過你,我們的機器人技術已經取得了巨大進步。
And today we're announcing that Group N1 is open sourced.
今天我們宣佈,Group N1 已經開源。
Group N1 is open sourced.
N1 組是開放源碼的。
Did you see that?
你看到了嗎?
Were you surprised?
你感到驚訝嗎?
The first thing that came to my mind was is Tesla dead?
我首先想到的是特斯拉死了嗎?
We all know that Ultima is coming out.
我們都知道《終極之戰》即將上映。
Have you seen that robot?
你見過那個機器人嗎?
It's great.
太棒了
We all know that Tesla is not an electric car company.
我們都知道,特斯拉不是一家電動汽車公司。
Tesla is a robot company.
特斯拉是一家機器人公司。
But as soon as Group N1 is open sourced, the first thing that comes to mind is is Tesla poor?
但 N1 集團一開源,人們首先想到的是特斯拉窮嗎?
First of all, I have to say my own point of view.
首先,我得說說我自己的觀點。
NVIDIA is bound to be open sourced.
英偉達一定會開源。
NVIDIA is the brain of the robot.
英偉達™(NVIDIA®)是機器人的大腦。
It doesn't do the body.
它不會影響身體。
And a lot of people who do the body can't have a brain.
而很多人的身體不可能有大腦。
So today he put this robot's brain model after being open sourced, what does that mean?
那麼今天他把這個機器人的大腦模型開源之後,意味著什麼呢?
All these manufacturers that do the body or new companies new companies may be able to do it.
所有這些做車身的製造商或新公司可能都能做到。
He can also be a robot.
他也可以是一個機器人。
He can also be a robot.
他也可以是機器人。
It must rely on NVIDIA's open source.
它必須依靠英偉達™(NVIDIA®)的開放源代碼。
It means that NVIDIA can get the data that everyone does the experiment with him.
這意味著英偉達可以獲得每個人與他一起做實驗的數據。
This is a terrible thing.
這是一件可怕的事情。
Will Tesla be finished?
特斯拉會完蛋嗎?
We talked about the development of Ultima I have finished talking about it.
我們談到了《終極之戰》的發展,我已經談完了。
In the last episode, I just mentioned this ISA Group N1.
在上一集中,我剛剛提到了 ISA N1 小組。
After this open source comes out, there will be more competitors for Tesla.
開放源代碼推出後,特斯拉的競爭對手會更多。
Manufacturers such as Huawei, Xiaomi, etc.
華為、小米等製造商。
Ubisoft and Boston Power, etc.
育碧和波士頓電力公司等。
These manufacturers will use it to compete with Tesla.
這些製造商將利用它與特斯拉競爭。
Tesla's stock price is very low.
特斯拉的股價非常低。
Although NVIDIA's stock price is very low, it has not broken the front foot of March.
雖然英偉達的股價很低,但它還沒有跌破 3 月份的前腳。
In other words, on this seal, the market is very unsatisfied with Tesla.
換句話說,在這個印章上,市場對特斯拉非常不滿意。
It's not wrong at the moment.
現在還沒有錯。
But in the long run, I don't think Tesla must be so cruel.
但從長遠來看,我認為特斯拉不一定要這麼殘忍。
Tesla's FSD has real world data.
特斯拉的 FSD 擁有真實世界的數據。
NVIDIA is not running on the road.
英偉達沒有在路上奔跑。
What he collects is virtual world data.
他收集的是虛擬世界的數據。
It is a collaboration between the platform and Cosmos of ONUVERSE.
這是 ONUVERSE 平臺與 Cosmos 之間的一次合作。
So these two things are completely different.
是以,這兩件事是完全不同的。
Who is good and who is bad?
誰是好人,誰是壞人?
I don't think I know now.
我想我現在不知道了。
I think open source can think of the Android system and Apple back then.
我認為,開源可以想想當年的安卓系統和蘋果。
I said a long time ago that I think Tesla is like Apple.
很久以前我就說過,我認為特斯拉就像蘋果。
The open source system must be able to kill the closed system.
開源系統必須能夠殺死封閉系統。
It doesn't have to depend on the supporters of the closed system and the projects he wants to develop now.
這並不取決於封閉系統的支持者和他現在想要開發的項目。
So to a certain extent, Tesla still has an advantage.
是以,在某種程度上,特斯拉仍然具有優勢。
But for the project of robot sales, Tesla really needs to pay attention.
但對於機器人銷售項目,特斯拉確實需要關注。
Especially now the innovation is very, very fast.
尤其是現在,創新的速度非常非常快。
I'm not sure how Tesla will deal with it.
我不知道特斯拉會如何處理。
Deepsea was just starting to open up.
深海剛剛開始開放。
In two months, the future pure competitors and partners have often come out.
在兩個月的時間裡,未來純粹的競爭對手和合作夥伴頻頻出爐。
The changes will be very fast in two months.
兩個月後,變化會非常快。
We just have to remember one thing.
我們只需記住一件事。
Taiwan's supply chain will definitely be damaged.
臺灣的供應鏈肯定會受損。
The US traditional supply chain will also be damaged.
美國的傳統供應鏈也將受到破壞。
Tesla's part is uncertain.
特斯拉的角色還不確定。
I temporarily think NVIDIA's FSD is still very good.
我暫時認為英偉達的 FSD 仍然非常出色。
This is what I will share with you after watching the GDC class.
這就是我在觀看完 GDC 課程後要與大家分享的內容。
I don't know what you saw.
我不知道你看到了什麼。
Also welcome to discuss with me.
也歡迎與我討論。
If you are interested in the topic of this robot series, welcome to join the member channel.
如果您對本機器人系列的主題感興趣,歡迎加入會員頻道。
My link is at the bottom.
我的鏈接在底部。
We will track the latest developments regularly to catch up with the companies that are really worth buying this time.
我們將定期跟蹤最新動態,追趕這次真正值得購買的公司。
I am JG.
我是 JG。