I experienced something so powerful,

我小時候

I spent the rest of my life searching for it,

經歷了一件很棒的事

and in all the wrong places.

我在接下來的人生中 一直在尋找它

What I experienced wasn't virtual reality.

卻總在錯誤的地方尋找

It was music.

我經歷的不是虛擬實境

And this is where the story begins.

而是音樂

That's me,

故事是這樣開始的

listening to the Beatles' "White Album."

這是我

And the look on my face is the feeling

正在聽披頭四的 白色專輯

that I've been searching for ever since.

而我臉上的表情

Music goes straight to the emotional vein,

就是我一直以來在尋找的感動

into your bloodstream

音樂觸動了我們情感的靜脈

and right into your heart.

流進到你的血液裡

It deepens every experience.

直達你的內心

Fellas?

每次的感動都會深烙在你心中

(Music)

哥兒們？

This is the amazing McKenzie Stubbert

（音樂）

and Joshua Roman.

這兩位是我們最厲害的 麥肯錫史塔伯特

Music --

和約書亞羅曼

(Applause)

（音樂）

Yeah.

（掌聲）

Music makes everything have more emotional resonance.

是的

Let's see how it does for this talk.

音樂讓每樣東西有了 更多情感上的共鳴

The right piece of music at the right time fuses with us

讓我們來看看音樂 在這次演講中如何呈現

on a cellular level.

當我們在對的時間裡 聽到一段對的音樂

When I hear that one song

音樂彷彿會融入到我們的細胞中

from that one summer

當我聽著那首歌

with that one girl,

在那個夏天

I'm instantly transported back there again.

與那個女孩

Hey, Stacey.

我彷彿又回到了過去

Here's a part of the story, though, where I got a little greedy.

嗨 史黛西

I thought if I added more layers on top of the music,

接下來是故事的一部分 雖然 我有點貪心

I could make the feelings even more powerful.

我在想 如果我可以讓 音樂有更多的層次

So I got into directing music videos.

我可以讓那份感動更加的強烈

This is what they looked like.

所以我開始投入音樂影片的製作

That's my brother, Jeff.

這是當時它們長的樣子

Sorry about this, Jeff.

那是我哥 傑夫

(Laughter)

不好意思 傑夫

Here's me, just so we're even.

（笑聲）

Incredible moves.

這是我 所以我們扯平了

Should've been a dancer.

跳的真好

(Laughter)

我應該去當一位舞蹈家

These experiments grew,

（笑聲）

and in time, started to look more like this.

這些實驗 與時漸進

In both, I'm searching for the same thing, though,

最後 成為這樣

to capture that lightning in a bottle.

雖然 我仍在尋找那份感動

Except, I'm not.

渴望能把那份感動的曙光 裝到瓶子裡

Adding moving pictures over the music added narrative dimension, yes,

但 我還是辦不到

but never quite equated the power

在音樂上增加一些動畫 雖然可以增加它的故事性

that just raw music had for me on its own.

卻永遠不能等同

This is not a great thing to realize when you've devoted your life

純音樂本身所帶來的力量

and professional career to becoming a music video director.

意識到這種感受 並不是件很棒的事情

I kept asking myself, did I take the wrong path?

尤其當你已經全心地把你的生活和職業生涯投入其中 成為一名 MV 總監時

So I started thinking: if I could involve you, the audience, more,

我不斷地問自己 我是不是搞錯方向了？

I might be able to make you feel something more as well.

所以我開始想 如果我可以讓 身為觀眾的你們更加地融入到音樂中

So Aaron Koblin and I began auditioning new technologies

也許就可以讓你們感受到更多

that could put more of you inside of the work,

所以 艾朗柯柏霖和我開始 嘗試新的技術

like your childhood home in "The Wilderness Downtown,"

讓聽眾可以更加地 投入到作品中

your hand-drawn portraits, in "The Johnny Cash Project,"

就像各位童年時期 在 荒野城鎮 故事裡的家

and your interactive dreams

就像你在 強尼現金專案 中 的手繪畫像

in "3 Dreams of Black."

就像你在 三個黑色夢想 中

We were pushing beyond the screen,

所互動出來的夢想

trying to connect more deeply

我們嘗試著突破螢幕

to people's hearts and imaginations.

嘗試地更加深人們的

But it wasn't quite enough.

內心與想象的連結

It still didn't have the raw experiential power of pure music for me.

但還是不夠

So I started chasing a new technology

它還是沒有那種純音樂 帶給我的原始體驗的震撼

that I only had read about in science fiction.

所以我開始尋找一種新的技術

And after years of searching, I found a prototype.

一種我在科幻小說中 曾經讀到過的科技

It was a project from Nonny de la Peña in Mark Bolas's lab in USC.

在多年的探尋之後 我找到了一個雛形

And when I tried it, I knew I'd found it.

它是南加州大學馬克波蘿斯實驗室 羅尼德拉佩納的一個專案

I could taste the lightning.

當我嘗試到它的時候 我知道我找到了

It was called virtual reality.

我像是被電到一樣

This was it five years ago when I ran into it.

它叫做虛擬實境

This is what it looks like now.

這是我五年前遇見它時的樣子

I quickly started building things in this new medium,

它現在是這個樣子

and through that process we realized something:

我迅速地開始在這個 新媒介裡建構事物

that VR is going to play an incredibly important role

在過程中 我們意識到了一些東西

in the history of mediums.

虛擬實境將會在媒介的歷史中

In fact, it's going to be the last one.

扮演著不可思議的角色

I mean this because it's the first medium that actually makes the jump

事實上 它將會是最後一種媒介

from our internalization of an author's expression

我會這樣說的原因是因為 這是第一個

of an experience,

可以讓我們從作者第一手身歷其境的表述 直接跳到我們主觀性經歷的媒介

to our experiencing it firsthand.

你看起來很迷惑 我待會解釋 別擔心

You look confused. I'll explain. Don't worry.

（笑聲）

(Laughter)

如果我們回想傳播媒介的起源

If we go back to the origins of mediums,

大家可能猜的到

by all best guesses,

那就像我們圍繞在營火邊 聽故事一樣

it starts around a fire, with a good story.

我們部落的首領正在 向我們描述那一天

Our clan leader is telling us

他是如何在寒漠上 捕獵到毛茸茸的猛瑪象的故事

about how he hunted the woolly mammoth on the tundra that day.

我們聽著他的英勇事蹟

We hear his words

然後把他的話轉譯成 我們所理解的事實

and translate them into our own internal truths.

同樣的體驗也會發生在

The same thing happens

我們看著刻畫在洞穴裡的故事一樣

when we look at the cave painting version of the story,

有關捕獵猛瑪象的書籍

the book about the mammoth hunt,

戲劇

the play,

廣播

the radio broadcast,

電視劇

the television show

或電影

or the movie.

這些媒介都需要我們 暫時放下懷疑

All of these mediums require what we call "suspension of disbelief,"

因為 故事 裡的真實性

because there's a translation gap between the reality of the story

與我們 意識 裡 所理解到的真實性

and our consciousness interpreting the story

有著相當的落差

into our reality.

我是用 意識 這個詞

I'm using the word "consciousness" as a feeling of reality that we get

來表示我們從周圍世界 對實境體驗到的感受

from our senses experiencing the world around us.

虛擬實境填補了那個落差

Virtual reality bridges that gap.

現在 你就在寒漠上與部落首領打獵

Now, you are on the tundra hunting with the clan leader.

或者 你就是部落首領

Or you are the clan leader.

甚至 你可能就是那隻 毛絨絨的猛瑪象

Or maybe you're even the woolly mammoth.

（笑聲）

(Laughter)

所以這就是虛擬實境特別的地方

So here's what special about VR.

在其它媒介中

In all other mediums,

你的意識會轉譯這些媒介

your consciousness interprets the medium.

在虛擬實境 你的意識就是媒介

In VR, your consciousness is the medium.

所以虛擬實境的潛力是很大的

So the potential for VR is enormous.

但 我們到甚麼程度了？

But where are we now?

這項藝術的當前狀況是怎樣呢？

What is the current state of the art?

好的

Well,

我們到這兒了

we are here.

我們相當於在電影剛誕生的第一年

We are the equivalent of year one of cinema.

這是盧米埃爾兄弟的電影

This is the Lumière Brothers film

據說這部電影讓一整間 電影院的人都逃命去了

that allegedly sent a theater full of people running for their lives

因為他們以為火車 朝著他們開了過來

as they thought a train was coming toward them.

和電影早期的發展階段相似

Similar to this early stage of this medium,

在虛擬實境中 我們也必須越過場景

in VR, we also have to move past the spectacle

進入到故事的情境中

and into the storytelling.

它花費了電影幾十年的時間

It took this medium decades

才搞懂原來說故事最好的語言媒介

to figure out its preferred language of storytelling,

就是虛擬實境

in the form of a feature film.

目前在虛擬實境領域 我們更多的是在學習文法

In VR today, we're more learning grammar

而不是寫故事

than writing language.

我們的虛擬實境公司 Vrse 在去年拍了 15 部電影

We've made 15 films in the last year at our VR company, Vrse,

我們從中學到了一些東西

and we've learned a few things.

我們發現我們有一種獨特的方式 可以觸動到你的感官

We found that we have a unique, direct path into your senses,

你的情緒 甚至身體

your emotions, even your body.

所以讓我向各位展示一些東西

So let me show you some things.

這次展示的目的

For the purpose of this demo,

我們準備把各位 可能看到的每個方向

we're going to take every direction that you could possibly look,

都延伸進這個大螢幕框框內

and stretch it into this giant rectangle.

好的 我們開始吧！

OK, here we go.

首先 在虛擬實境裡 鏡頭的移動相當困難

So, first: camera movement is tricky in VR.

弄得不好 會讓你不舒服

Done wrong, it can actually make you sick.

我們發現如果你以一種穩定的速度 在一條直線上移動鏡頭

We found if you move the camera at a constant speed in a straight line,

你就不會覺得不舒服

you can actually get away with it, though.

在電影學院的第一天

The first day in film school,

他們告訴我 在你打破規則前

they told me you have to learn every single rule

你要先學會每一條規則

before you can break one.

我們還沒有學會每一條規則

We have not learned every single rule.

我們幾乎還沒學會什麽

We've barely learned any at all,

但是我們已經開始嘗試打破規則

but we're already trying to break them

去看看我們可以實現什麽樣 創造性的新事物

to see what kind of creative things we can accomplish.

在這一次拍攝裏我們從 地面上升起的時候 我加快了速度

In this shot here, where we're moving up off the ground, I added acceleration.

我這麽做是因為我想要給各位一種

I did that because I wanted to give you a physical sensation

從地面升起的實體感受

of moving up off the ground.

在虛擬實境中 我可以給各位這種感受

In VR, I can give that to you.

（音樂）

(Music)

不意外地 音樂在這當中 扮演了很重要的角色

Not surprisingly, music matters a lot in this medium as well.

它引導我們如何去感受

It guides us how to feel.

在這個和紐約時報合作的專案中

In this project we made with the New York Times, Zach Richter

我和我們的朋友 JR

and our friend, JR,

帶各位坐上直升機

we take you up in a helicopter,

即使你翱翔在曼哈頓 上空 2000 英呎的地方

and even though you're flying 2,000 feet above Manhattan,

你也不會感到害怕

you don't feel afraid.

你感受到的是 JR 心中的興奮

You feel triumphant for JR's character.

音樂會引導你到那個地方

The music guides you there.

（音樂）

(Music)

與大家想的不太一樣

Contrary to popular belief,

虛擬實境也會產生創作的感覺

there is composition in virtual reality,

但是這個和你螢幕上方框中的影片

but it's completely different than in film,

感覺完全不一樣

where you have a rectangular frame.

那創作的感覺 與你現在的意識

Composition is now where your consciousness exists

和你身邊所處的世界 而會有所不同

and how the world moves around you.

這部影片 恩澤之音 是由 Vrse

In this film, "Waves of Grace," which was a collaboration between Vrse,

United Nations，Gabo Arora 和 Imraan Ismail 合作出品

the United Nations, Gabo Arora, and Imraan Ismail,

我們了解到虛擬實境中 近距離拍攝的角色置換技巧

we also see the changing role of the close-up in virtual reality.

在虛擬實境中的近距離鏡頭 會讓你有很靠近某人的感覺

A close-up in VR means you're actually close up to someone.

它會把故事裡的主角 帶到你身邊的空間

It brings that character inside of your personal space,

一個你總是會預留給愛人的空間

a space that we'd usually reserve for the people that we love.

你會近距離地 感受到主角的情緒

And you feel an emotional closeness to the character

因為你會感覺主角就在你身邊

because of what you feel to be a physical closeness.

虛擬實境的運鏡方式和 一般鏡頭的移動方式不同

Directing VR is not like directing for the rectangle.

它比較像是 觀眾注意力的舞蹈編排

It's more of a choreography of the viewer's attention.

有一個工具可以導引你的注意力

One tool we can use to guide your attention

叫做 空間化音效

is called "spatialized sound."

我可以把聲音放在任何地方 放在你前面 左 右邊

I can put a sound anywhere in front of you, to left or right,

甚至是後面

even behind you,

而且當你轉頭的時候 聲音也會跟著轉

and when you turn your head, the sound will rotate accordingly.

所以我可以用音樂導引你的注意力 到我想讓你看的地方

So I can use that to direct your attention to where I want you to see.

下在你可能會感受到 有人在你肩膀後面唱歌

Next time you hear someone singing over your shoulder,

他可能就是波諾

it might be Bono.

（笑聲）

(Laughter)

虛擬實境讓我們感覺 自己就像影片中的一部分

VR makes us feel like we are part of something.

在大部分的人類歷史中 我們都生活在小家庭單位裡

For most of human history, we lived in small family units.

我們從山洞開始

We started in caves,

然後搬到家族和部落 然後村莊和城鎮

then moved to clans and tribes, then villages and towns,

而現在 我們都是世界公民

and now we're all global citizens.

但我相信 我們最關心的仍然是

But I believe that we are still hardwired to care the most

那些我們身旁的事情

about the things that are local to us.

虛擬實境讓每個地方 和每個人變的靠近

And VR makes anywhere and anyone feel local.

這也是為什麼它像是一部 有感情的機器

That's why it works as an empathy machine.

我們的電影 敘利亞的天空 會帶你到敘利亞的一個難民營

Our film "Clouds Over Sidra" takes you to a Syrian refugee camp,

不是帶各位去看 一個人的故事

and instead of watching a story about people over there,

而是帶你去感受 我們內心的世界

it's now a story about us here.

但我們到甚麼程度了

But where do we go from here?

棘手的事是 所有之前的媒介

The tricky thing is that with all previous mediums,

它們呈現的形式 在它們製造出來時就固定了

the format is fixed at its birth.

從邁布里奇和他的馬到現在 影片一直都是一系列的矩形

Film has been a sequence of rectangles,

這種呈現的方式從來沒有改變

from Muybridge and his horses to now.

但虛擬實境作為 一種格式 一種媒介

The format has never changed.

雖然還不夠完整

But VR as a format, as a medium,

但它不是用電影膠片或是紙張 或者電視信號

isn't complete yet.

它實際上是利用 我們的感官去感受這個世界

It's not using physical celluloid or paper or TV signals.

我們是用你的感官 作為帆布上的油漆

It actually employs what we use to make sense of the world.

但是目前只有兩個（視覺及聽覺）

We're using your senses as the paints on the canvas,

最終，我們可以看看是否能 利用上我們人類身上所有的感官當作媒介

but only two right now.

去體驗任何一個我們想經歷的故事

Eventually, we can see if we will have all of our human senses employed,

我現在可以稱它做虛擬實境

and we will have agency to live the story in any path we choose.

但當我們超越虛擬現實的時候

And we call it virtual reality right now,

我們會叫它甚麼？

but what happens when we move past simulated realities?

如果不是靠口說告訴你一個夢想

What do we call it then?

而是讓你住進到這個夢裡呢？

What if instead of verbally telling you about a dream,

如果不是讓你只是體驗 參觀一下地球的一些實境

I could let you live inside that dream?

而是帶你到黑洞邊緣 的重力波上衝浪

What if instead of just experiencing visiting some reality on Earth,

或者描繪宇宙的緣起

you could surf gravitational waves on the edge of a black hole,

或者不是用文字彼此溝通

or create galaxies from scratch,

而是用我們最初衷的想法溝通呢？

or communicate with each other not using words

這將不僅僅是虛擬實境而已

but using our raw thoughts?

坦白說，我也不知道那叫甚麼

That's not a virtual reality anymore.

但我希望各位可以看看 我們到哪個程度了

And honestly I don't know what that's called.

但我今天來到這邊 是想讓各位 體驗一下我剛剛提的智能媒介

But I hope you see where we're going.

所以 我們開始體驗吧！

But here I am, intellectualizing a medium I'm saying is experiential.

在各位手上 應該都有一片紙板

So let's experience it.

請各位把它打開

In your hands, you hopefully hold a piece of cardboard.

按下開關按鈕 解鎖手機

Let's open the flap.

對於家裡觀看的民眾

Tap on the power button to unlock the phone.

我們現在在螢幕上會顯示

For the people watching at home,

告訴你如何從手機上 下載這次的體驗

we're going to put up a card right now

甚至可以買到 Google 的紙板眼鏡

to show you how to download this experience on your phone yourself,

我們小時候，在紙箱裡玩

and even get a Google cardboard of your own to try it with.

現在長大了 我希望我們 都能找回兒時的純真

We played in cardboard boxes as kids,