Name: Runway 的 Gen 3 在人工智能視頻領域掀起了一場風暴！ (Gen 3 by Runway takes the AI Video space by storm!)
Uploaded: 2024-06-21T11:30:00.000Z
Duration: 19 min 14 s

程度副詞

So guys, just yesterday we saw what is perhaps the largest competition to OpenAI's incredible Sora video generator model yet.

各位，就在昨天，我們看到了 OpenAI 令人難以置信的索拉視頻生成器模型的最大競爭對手。

情態副詞

A lot of you probably have already seen videos about it, but I want to bring you some new and interesting use cases and value propositions that you might not see in other places.

你們中的很多人可能已經看過相關視頻，但我想給你們帶來一些新的、有趣的使用案例和價值主張，這些可能是你們在其他地方看不到的。

基礎被動語態

So for those of you who don't know, this is Gen 3, which is produced by RunwayML up here.

對於不瞭解的人來說，這是 RunwayML 生產的第 3 代產品。

Now, RunwayML is special in the AI video space because they were the first ones to make the actual first commercial video generation model.

現在，RunwayML 在人工智能視頻領域很特別，因為他們是第一個製作出第一個實際商業視頻生成模型的人。

And now they have Gen 3 Alpha, so the third iteration.

現在他們有了第三代 Alpha，所以是第三次迭代。

It's a step towards building general world models.

這是朝著建立通用世界模型邁出的一步。

And yeah, right off the bat, you can see this thing is damn impressive.

是的，從一開始，你就能看出這東西非常了不起。

I think in the motion department, it does struggle a tad.

我認為，在運動方面，它確實有些吃力。

But I mean, all of these examples are really, really quite impressive.

但我的意思是，所有這些例子都非常、非常令人印象深刻。

I think it doesn't have necessarily the same fidelity that Sora has, but it looks really, really cool and the motion is super impressive.

我認為它的逼真度未必能和《索拉》相比，但它看起來真的非常酷，動作也令人印象深刻。

This has a little bit better detail in my mind, and it's really cool to see how temporally consistent the buildings are as they pass by the camera.

在我看來，這幅畫的細節更好一些，而且當建築物從鏡頭前經過時，它們在時間上的一致性也非常好。

And I mean, you can do very special effect-esque style things as well.

我的意思是，你也可以做一些特效式的東西。

The possibilities, as always with AI video, are truly endless.

人工智能視頻的可能性永遠是無窮無盡的。

So apparently, it's been trained with highly descriptive, temporally dense captions, enabling imaginative transitions like, you know, a street being flooded with water.

是以，很顯然，它經過了高度描述性、時間密集型字幕的訓練，能夠實現富有想象力的過渡，比如，你知道，一條街道被水淹沒了。

Not something you're going to see every day.

Or, you know, we have like this drone shot that moves through a castle.

或者，你知道，我們有像這樣的無人機鏡頭，穿過城堡。

我的意思是，這真的令人印象深刻。

Like, I would believe that that is an actual video, not some AI generated thing.

比如，我會相信那是一段真實的視頻，而不是人工智能生成的東西。

Here we can see some water glistening on a window through a train as it passes by.

在這裡，我們可以透過火車看到窗外閃爍的水光。

Again, wouldn't really be able to tell right off the bat that that is AI.

同樣，我們也無法一眼看出那就是人工智能。

Here is another one that people found really, really impressive.

這是另一個讓人印象深刻的例子。

This is clearly, you know, some more GoPro footage of someone walking through some tunnels, and then it pans over and you see a runway.

很明顯，這是更多的 GoPro 錄像，顯示有人走過一些隧道，然後鏡頭一轉，你會看到一條跑道。

Look at the effect of the flashlight as it moves over the graffiti on the runway.

看看手電筒在跑道塗鴉上移動時的效果。

I mean, you can tell it's a different texture there.

我的意思是，你可以看出那裡的質地不同。

I mean, no doubt in my mind, all of these examples blow me away, and I cannot wait until we get access.

我的意思是，毫無疑問，所有這些例子都讓我大開眼界，我迫不及待地想知道我們能不能進入。

We still don't have access to this, but it appears that access is going to be coming to Gen 3 very, very soon.

我們仍然無法訪問，但似乎很快就能訪問第 3 代。

And I can imagine people are going to be willing to pay a lot for access to this thing because it is the closest thing to Sora that we've seen so far in terms of like prompt following, coherency, and temporal stability.

我可以想象，人們會願意花大價錢來購買它，因為它是迄今為止我們所見過的最接近《索拉》的東西，比如及時跟蹤、連貫性和時間穩定性。

Photorealistic humans, that's obviously a really big deal when you're trying to tell stories.

逼真的人類，對於想要講述故事的人來說顯然是件大事。

Humans are most often a part of a lot of stories that are told in filmmaking, TV shows, etc.

在電影、電視劇等的許多故事中，人類往往是故事的一部分。

So there's some really great-looking humans in here, and obviously that is some bias in the training data there.

是以，這裡有一些非常漂亮的人類，很明顯，訓練數據中存在一些偏差。

They purposefully set out to make sure that it's going to be able to produce some pretty realistic-looking people.

他們有目的地確保它能夠製作出一些外形非常逼真的人。

I mean, look at how cinematic this scene looks, and look at the glare of the sun and everything.

我的意思是，看看這個場景看起來多有電影感，再看看刺眼的陽光和一切。

One thing I will say that I am seeing a lot is pretty much every one of these videos, no matter what it is, if it's a person or like this over here, everything looks like it's being shot in slow motion, which isn't necessarily a downside because, think about it, you can always speed up a video.

我想說的是，我經常看到的一件事是，幾乎每一個視頻，不管是什麼，如果是一個人，或者像這裡這樣，一切看起來都像是慢動作拍攝的，這並不一定是一個缺點，因為想想看，你總是可以加快視頻的速度。

If for some reason it produces videos that look like they're in slow motion, well, we can always just speed up the video.

如果由於某種原因，它生成的視頻看起來像慢動作，那麼我們可以隨時將視頻加速。

Like, that totally looks like it's in slow motion, no?

這看起來就像慢動作，不是嗎？

Maybe they purposefully trained it on slow motion video?

也許他們是故意用慢動作視頻來訓練的？

Like, we could just download these videos and speed them up and they would look completely normal.

比如，我們可以下載這些視頻，然後將它們加速，它們看起來就完全正常了。

I mean, shockingly realistic, but I just find that really intriguing.

我的意思是，現實得令人震驚，但我覺得這真的很有趣。

I mean, there we have like a monster walking around.

我的意思是，我們有一個怪物在走動。

That looks like a shot from a movie legitimately.

我是說，它太令人印象深刻了。

The way that the light bounces and reflects off of the fur, it is so darn cool.

光線在毛皮上反彈和反射的方式，真是酷斃了。

Here's like some, I don't know, rock person walking through the woods.

這裡就像一個，我不知道，在樹林裡行走的石頭人。

Like, this thing has an understanding of physics and the world in a way that reminds me of the Sora demos.

比如，這東西對物理和世界的理解，讓我想起了索拉的演示。

This is a true competitor to Sora, I think, more so than anything else we've seen.

我認為，這是索拉的真正競爭對手，比我們看到的其他任何東西都更勝一籌。

And that's really, I think, what is causing all of the stir around Gen 3.

我認為，這才是引起第 3 代轟動的真正原因。

我一直看到有人在談論這個問題。

我的意思是，是的，看看這個。

I mean, that's some, that's a pretty good understanding of physics and paper and how it's going to interact in this alleyway with the wind tunnel.

我是說，你對物理和紙張的理解還不錯，知道它在巷子裡和風洞是如何相互作用的。

Here's another one that again looks like it's in slow motion.

這是另一張看起來又像是慢動作的照片。

I mean, why does it look like it's so in slow motion?

我的意思是，為什麼看起來像慢動作？

But the way he like moves his thumb and everything, that just looks so legit.

但他移動拇指和其他動作的方式，看起來非常合理。

And these are obviously going to be cherry picked here.

很明顯，這些都是經過挑選的。

我的意思是，這看起來太合法了，夥計。

這只是一些瘋狂、瘋狂的概念。

Here's like an anime, animated film art style.

They've really gotten close to solving motion at this point.

在這一點上，他們確實已經接近解決運動問題了。

I mean, it's just, again, here's another one that looks like it's in slow motion.

我是說，這又是一個看起來像慢動作的畫面。

I mean, what would you guys create if you had access to this?

我的意思是，如果你們能使用它，你們會創造出什麼？

It seems like access is going to be coming.

At least it was hinted in like a few days.

We're going to be able to get access to this.

So I'd love to do like a live stream, testing it out, hanging out with you guys, doing some prompts.

所以我很想做一次直播，測試一下，和你們一起玩，做一些提示。

I don't mind paying for credits to use something like this because it's groundbreaking technology.

我不介意為使用這樣的東西支付點數，因為這是一項突破性技術。

Like I said, biggest Sora competitor that we've seen so far, at least in my mind.

就像我說的，至少在我看來，它是目前我們看到的索拉最大的競爭對手。

Anyways, that's sort of the TLDR on Gen 3.

總之，這就是第 3 代的簡要介紹。

Now let's get into some of the more interesting use cases.

現在，讓我們來了解一些更有趣的使用案例。

Some of the bigger value propositions that you might not see in other places.

一些更大的價值主張，你可能在其他地方看不到。

So Cristobal here on Twitter brings up that there's a lot of unexplored latent horror to discover.

是以，推特上的克里斯托巴爾提出，還有很多未被髮掘的潛在恐怖有待發現。

So the applications for horror movies or horror genres are very, very much already alive, as we can see by this terrifying generation.

是以，恐怖電影或恐怖流派的應用已經非常、非常活躍，我們可以從這一代人的恐怖經歷中看到這一點。

Like we've got a monkey here who is learning to play guitar on the street.

就像我們這裡有一隻在街上學彈吉他的猴子。

And again, it's just a really nice smooth shot.

同樣，這也是一個非常漂亮流暢的鏡頭。

I don't know what it is with runway and the slow-mo stuff, but it's super weird.

我不知道 "跑道 "和慢鏡頭是怎麼一回事，但真的很奇怪。

Oh yeah, he works for runway, so that's why he's got access to it.

哦，對了，他為 Runway 工作，所以才能接觸到它。

是以，文本也確實令人印象深刻。

It's able to do like these animated things with text popping up on the screen.

它能在螢幕上彈出文字等動畫效果。

字幕列表影片播放

Runway 的 Gen 3 在人工智能視頻領域掀起了一場風暴！ (Gen 3 by Runway takes the AI Video space by storm!)

stuff

weird

essentially

absolutely