Name: 運行自己的人工智能（但不公開） (Run your own AI (but private))
Uploaded: 2024-10-01T13:32:00.000Z
Duration: 22 min 13 s

現在進行式

我正在運行一個名為 "私人人工智能 "的系統。

It's kind of like ChatGPT, except it's not.

它有點像 ChatGPT，只不過不是。

Everything about it is running right here on my computer.

它的一切都在我的電腦上運行。

This is private, contained, and my data isn't being shared with some random company.

這是私人的、保密的，我的數據不會被隨便一家公司共享。

So in this video, I want to do two things.

是以，在這段視頻中，我想做兩件事。

First, I want to show you how to set this up.

首先，我想告訴大家如何設置。

It is ridiculously easy and fast to run your own AI on your laptop, computer, or whatever it is.

在筆記本電腦、計算機或其他任何設備上運行自己的人工智能，簡單快捷得令人髮指。

This is free, it's amazing, it'll take you about five minutes.

這是免費的，非常神奇，只需五分鐘。

And if you stick around to the end, I want to show you something even crazier, a bit more advanced.

如果你堅持到最後，我想給你看一些更瘋狂、更先進的東西。

I'll show you how you can connect your knowledge base, your notes, your documents, your journal entries, to your own Private GPT, and then ask it questions about your stuff.

我將向你展示如何將你的知識庫、筆記、文檔、日誌條目與你的私人 GPT 相連接，然後向它提出有關你的東西的問題。

And then second, I want to talk about how Private AI is helping us in the area we need help most, our jobs.

其次，我想談談私人人工智能如何在我們最需要幫助的領域--我們的工作--幫助我們。

You may not know this, but not everyone can use ChatGPT or something like it at their job.

您可能不知道，並不是每個人都能在工作中使用 ChatGPT 或類似功能。

Their companies won't let them, mainly because of privacy and security reasons.

他們的公司不允許他們這樣做，主要是因為隱私和安全原因。

But if they could run their own Private AI, that's a different story.

但如果他們能運行自己的私人人工智能，那就另當別論了。

And VMware is a big reason this is possible.

而 VMware 正是實現這一點的重要原因。

They are the sponsor of this video, and they're enabling some amazing things that companies can do on-prem in their own data center to run their own AI.

他們是本視頻的贊助商，公司可以在自己的數據中心運行自己的人工智能。

And it's not just the cloud, man, it's like in your data center.

不僅是雲計算，就連數據中心也是如此。

Just go ahead and open it and take a little glimpse at what they're doing.

We're gonna dive deeper, so just go ahead and have it open right in your second monitor or something, or on the side, or minimize.

我們要深入研究，所以請在你的第二個顯示器或其他地方打開它，或者在側面，或者最小化。

I don't know what you're doing, I don't know how many monitors you have.

我不知道你在做什麼，也不知道你有多少臺顯示器。

Oh, and before we get started, I have to show you this.

哦，在我們開始之前，我必須給你看這個。

You can run your own private AI that's kind of uncensored.

你可以運行自己的私人人工智能，這種人工智能是未經審查的。

So yeah, please don't do this to destroy me.

所以，是的，請不要這樣做毀了我。

At the end of this video, I'm doing a quiz.

在視頻的最後，我要做一個小測驗。

And if you're one of the first five people to get 100% on this quiz, you're getting some free coffee.

如果您是前五名在測試中獲得 100% 高分的人之一，您將獲得免費咖啡。

So take some notes, study up, let's do this.

所以，做一些筆記，好好學習，讓我們開始吧。

Now, real quick, before we install a private local AI model on your computer, what does it even mean?

現在，在我們在你的電腦上安裝私人在地人工智能模型之前，請快速瞭解一下，它到底意味著什麼？

At its core, an AI model is simply an artificial intelligence pre-trained on data we've provided.

人工智能模型的核心是根據我們提供的數據預先訓練的人工智能。

One you may have heard of is OpenAI's chat GPT, but it's not the only one out there.

您可能聽說過 OpenAI 的哈拉 GPT，但它並不是唯一的一種。

We're gonna go to a website called huggingface.co.

我們要去一個叫 huggingface.co 的網站。

Just an incredible brand name, I love it so much.

這真是一個不可思議的品牌名稱，我非常喜歡。

This is an entire community dedicated to providing and sharing AI models.

這是一個致力於提供和共享人工智能模型的完整社區。

You're about to have your mind blown, ready?

Many of these are open and free for you to use, and they're pre-trained, which is kind of a crazy thing.

其中很多都是開放的，你可以免費使用，而且它們都經過預先培訓，這有點瘋狂。

We're gonna search for a model named Llama 2, one of the most popular models out there.

我們將搜索一款名為 "Llama 2 "的機型，它是最受歡迎的機型之一。

Llama 2 is an AI model known as an LLM or large language model.

Llama 2 是一種人工智能模型，被稱為 LLM 或大型語言模型。

OpenAI 的哈拉 GPT 也是一名法學碩士。

Now this LLM, this pre-trained AI model was made by Meta, AKA Facebook.

現在這個 LLM，這個預先訓練好的人工智能模型是由 Meta（又名 Facebook）製作的。

And what they did to pre-train this model is kind of insane.

他們對這個模型的預先訓練簡直是瘋了。

And the fact that we're about to download this and use it, even crazier.

而事實上，我們正要下載並使用它，這就更瘋狂了。

If you scroll down just a little bit, here we go, training data.

如果你向下滾動一點，就會看到訓練數據。

It was trained by over 2 trillion tokens of data from publicly available sources, instruction data sets, over a million human annotated examples.

它由超過 2 萬億個來自公開來源的數據、指令數據集和超過一百萬個人工註釋示例進行訓練。

Data freshness, we're talking July, 2023.

數據新鮮度，我們說的是 2023 年 7 月。

Step two is insane because this is where the training happens.

第二步是瘋狂的，因為培訓就在這裡進行。

Meta, to train this model, put together what's called a super cluster.

為了訓練這個模型，Meta 組建了一個超級集群。

It took 1.7 million GPU hours to train this model.

該模型的訓練花費了 170 萬 GPU 小時。

And it's estimated it costs around $20 million to train it.

據估計，它的訓練費用約為 2000 萬美元。

And now Meta's just like, here you go kid, download this incredibly powerful thing.

現在 Meta 就像在說，給你，孩子，下載這個無比強大的東西。

But this intelligent source of information that you can just download on your laptop and ask it questions.

但這個智能信息源，你只需下載到筆記本電腦上，就可以向它提問。

And this is just one of the many models we could download.

這只是我們可以下載的眾多模型之一。

They have special models like text to speech, image to image.

它們有特殊的模式，如文本到語音、影像到影像。

They have an uncensored version of Allama too.

他們還有未經審查的《阿拉瑪》版本。

This guy, George Sung, took this model and fine tuned it with a pretty hefty GPU, took him 19 hours and made it to where you could pretty much ask this thing anything you wanted.

這個叫喬治-宋的傢伙利用這個模型，並通過一個相當大的 GPU 對其進行了微調，他花了 19 個小時，終於做到了你可以問這個東西任何你想要的東西。

Whatever question comes to mind, it's not going to hold back.

無論想到什麼問題，它都不會退縮。

So how do we get this fine tuned model onto your computer?

那麼，我們如何把這個經過微調的模型放到你的電腦上呢？

Well, actually I should warn you, this involves quite a bit of Allamas, more than you would expect.

實際上，我得提醒你，這裡面涉及到不少阿拉瑪斯，比你想象的要多。

Our journey starts at a tool called Allama.

我們的旅程從一個名為 "阿拉瑪 "的工具開始。

Let's go ahead and take a field trip out there real quick.

All we have to do is install this little guy, Mr. Allama.

我們要做的就是安裝這個小傢伙，阿拉瑪先生。

And then we can run a ton of different LLMs.

然後，我們就可以運行大量不同的 LLM。

Llama2, Code Llama, told you lots of llamas.

拉瑪 2，代號 "拉瑪"，告訴你有很多拉瑪。

And there's others that are pretty fun like Llama2 Uncensored, more llamas.

還有一些其他的遊戲也很有趣，比如《Llama2 Uncensored》，裡面有更多的駱駝。

但首先，我們要在什麼上面安裝阿拉瑪？

We can see right down here that we have it available on Mac OS and Linux, but oh, bummer, Windows coming soon.

我們可以看到，我們已經在 Mac OS 和 Linux 上提供了該軟件，但無奈的是，Windows 即將推出。

It's okay, because we've got WSL, the Windows Subsystem for Linux, which is now really easy to set up.

沒關係，因為我們已經有了 WSL，Linux 的 Windows 子系統，現在設置起來非常簡單。

So we'll go ahead and click on download right here.

For Mac OS, you'll just simply download this and install it like one of your regular applications.

對於 Mac OS，只需下載並安裝即可，就像安裝普通應用程序一樣簡單。

字幕列表影片播放

運行自己的人工智能（但不公開） (Run your own AI (but private))

stuff

specific

insane

version