OpenAI发布会快速解读+全程双语回放｜地表最强模型GPT-4o免费发布｜AI进化论-花生

Summary

在这段视频中，我们见证了一场展示先进人工智能技术的活动。首先，一位名叫Mark的演讲者通过与AI助手Chat GPT的互动，展示了实时对话和情感识别的能力。接着，Barrett向观众展示了如何通过语音模式讲述一个关于机器人和爱情的睡前故事，以及如何使用不同的情感风格来表达故事。此外，还展示了AI在解决线性方程和编程问题方面的应用，包括实时翻译和面部表情分析。最后，演讲者强调了将这些技术以安全和有用方式带给公众的重要性，并预告了未来几周将逐步推出这些功能，同时感谢了Open AI团队和Nvidia团队对演示的支持。

Takeaways

• 🌐 该演示展示了如何使用GPT 40模型，它具备实时对话语音、视觉和文本能力，能够提供更自然和流畅的交互体验。
• 📈 GPT 40在语音模式下允许用户打断对话，响应时间更快，并且能够识别和表达情感。
• 📊 通过代码演示，GPT 40能够理解和分析线性方程，并提供解决问题的提示，而不是直接给出答案。
• 🔍 GPT 40的视觉能力可以分析和解释图像内容，如天气数据图表，以及实时翻译文本。
• 📅 2018年的天气数据分析显示，最热的月份是7月和8月，平均温度在25°至30°之间。
• 🎓 GPT 40的推出意味着即使是免费用户也能享受到高级AI工具，这有助于降低技术使用的门槛。
• 🚀 GPT 40的发布是AI技术在易用性方面的一大步进，预示着未来人机交互的新方向。
• 🌟 GPT 40的实时性和情感识别能力，使得它在教育、娱乐和日常生活等多个领域都有潜在的应用价值。
• 📱 GPT 40的移动应用演示表明，该技术可以轻松集成到用户的日常工作流程中，提供便捷的服务。
• 🌍 GPT 40支持50多种语言，这表明其旨在为全球用户提供服务，无论他们使用何种语言。
• 🔧 GPT 40的迭代部署和安全性能的持续优化，展示了开发团队在确保技术负责任使用方面的努力。

Q & A

在演示中，GPT 40的主要特点是什么？

GPT 40的主要特点包括实时会话语音功能，能够以不同的情感风格生成语音，以及在语音、文本和视觉方面的实时响应能力。此外，GPT 40还提供了更高效的性能，允许免费用户也能享受GPT 4级的智能服务。

GPT 40如何改善用户体验？

GPT 40通过实时响应和情感感知能力，提供了更自然和流畅的交互体验。它还能够原生处理语音、文本和视觉信息，减少了延迟，提高了沉浸感。

GPT 40在安全性方面面临哪些挑战？

GPT 40在安全性方面的挑战包括实时音频和视觉处理的能力，这要求团队构建有效的对策来防止滥用。此外，还需要与政府、媒体、娱乐等不同利益相关者合作，确保技术的安全部署。

GPT 40的发布对免费用户意味着什么？

对于免费用户来说，GPT 40的发布意味着他们可以享受到以前只有付费用户才能使用的高级工具，包括使用GPT进行对话、访问GPT商店、使用视觉功能以及高级数据分析等。

GPT 40在多语言支持方面有哪些改进？

GPT 40在50多种语言上提高了质量和速度，这使得产品能够服务于更广泛的用户群体，无论他们使用哪种语言。

在演示中，GPT 40如何帮助解决线性方程？

GPT 40通过提供逐步的提示和反馈，帮助用户解决线性方程，而不是直接给出答案。它引导用户理解并应用解决方程的每个步骤，从而增强了用户的理解和信心。

GPT 40的视觉功能如何帮助用户理解代码和图形？

GPT 40的视觉功能允许它查看用户屏幕上的内容，如代码和图形输出。它能够分析这些视觉信息，并以简洁的方式向用户提供解释和概述。

GPT 40的实时语音功能如何帮助减轻演讲者的紧张情绪？

GPT 40通过提供实时反馈和建议，如指导演讲者进行深呼吸，帮助他们放松。它还能够感知演讲者的情绪状态，并给出相应的建议。

GPT 40在情感识别方面有哪些能力？

GPT 40能够通过语音和视觉输入识别和响应用户的情感状态。它可以根据用户的声音强度、语调和其他线索来感知情绪，并据此调整其响应。

GPT 40的API对开发者意味着什么？

GPT 40的API意味着开发者现在可以使用这一先进的模型来构建和部署他们自己的AI应用程序。这为创造新的、创新的解决方案提供了可能性，并能够大规模地部署这些应用。

GPT 40在性能上相比GPT 4有哪些提升？

GPT 40在性能上相比GPT 4有显著提升，它运行速度更快（2倍速），成本更低（50% cheaper），并且提供了更高的速率限制（五倍于GPT 4 Turbo）。

GPT 40如何帮助用户在不同领域中应用数学？

GPT 40通过提供实际的数学问题解决示例，帮助用户理解数学在日常生活中的应用，如计算开支、规划旅行、烹饪，甚至是商业利润和损失计算等。

Outlines

00:00

😀 语言翻译与数据分析

第一段主要描述了一个场景，其中两个人，一个说英语，一个说意大利语，通过一个翻译器进行交流。他们讨论了关于鲸鱼是否能交流的话题，并解决了线性方程的问题。此外，还提到了一个显示2018年全年平均温度、最低温度和最高温度的图表，以及一个在九月份标记的大降雨事件。

05:01

📈 产品发布与技术介绍

第二段介绍了一个产品的发布会，演讲者表达了对产品的热情，并介绍了三个主要议程。重点在于发布桌面版本的CH gbt和用户界面的更新，使得产品更易于使用。最引人注目的是推出了新的旗舰模型GBT 4，它为所有用户包括免费用户提供了高级智能。演讲者还提到了实时音频、视觉和多种语言支持的改进，以及如何确保新技术的安全使用。

10:02

🎉 新功能展示与用户互动

第三段继续展示了GBT 4的新功能，包括实时对话语音模式，以及如何通过减少延迟来提高用户体验。演讲者还提到了将高级工具免费提供给所有用户，从而扩大了定制聊天GBT的受众范围。此外，还介绍了视觉功能，允许用户上传包含文本和图像的文档，并与聊天GBT进行交流。

15:04

🤖 机器人故事与情感交互

第四段通过一个实时演示，展示了如何使用GBT 4进行实时对话和情感交互。Mark在舞台上进行了一个实时演示，GBT 4帮助他平静下来，并以不同的情感风格讲述了一个关于机器人和爱的故事。此外，还展示了如何使用GBT 4的语音模式来提高用户体验。

20:08

🧮 解决数学问题与编码交互

第五段展示了如何使用GBT 4解决数学问题和与编码交互。演讲者写下了一个线性方程，并与GBT 4一起解决了它，GBT 4提供了解决步骤的提示。接着，演讲者展示了一段代码，GBT 4解释了代码的功能，包括获取天气数据、平滑温度数据、注释重要天气事件以及显示带有平均温度、最低温度和最高温度的图表。

25:08

🌡️ 温度数据分析与实时翻译

第六段继续展示了GBT 4的数据分析能力，特别是对温度数据的处理。演讲者询问了关于温度最高的月份和相应温度的问题，GBT 4提供了答案。此外，还展示了GBT 4的实时翻译功能，能够将英语和意大利语互译。

30:09

😊 情感检测与技术展望

第七段展示了GBT 4的情感检测能力，通过分析一张自拍照来识别情感。此外，演讲者感谢了团队和合作伙伴，并预告了未来几周将推出的新功能和技术。最后，演讲者对观众的参与表示感谢。

Keywords

💡实时对话语音

实时对话语音是指能够即时响应用户语音输入并提供语音输出的技术。在视频中，这项技术使得用户可以与GPT模型进行自然的对话，无需等待，就像与人交谈一样。例如，Mark在舞台上进行实时演示时，可以直接与GPT进行对话，GPT能够即时回应，帮助他平静紧张的情绪。

💡情感识别

情感识别是指通过分析语音、面部表情或其他信号来识别和理解人的情感状态的技术。视频中，GPT模型展示了它能够通过语音判断Mark的紧张情绪，并给出建议，如进行深呼吸来平静下来。此外，GPT还能够在讲述睡前故事时根据要求调整语音的情感表达，如更具戏剧性或机器声。

💡线性方程

线性方程是数学中的一种方程，涉及变量的一次幂。视频中提到线性方程的解决，展示了GPT模型不仅能够进行语言处理，还能帮助用户解决数学问题。例如，视频中的一个人询问如何解线性方程，GPT通过提供解题步骤的提示来帮助用户，而不是直接给出答案。

💡机器学习模型

机器学习模型是指利用机器学习算法从数据中学习并做出预测或决策的模型。视频中提到的GPT 4是一个先进的机器学习模型，它结合了语音、文本和视觉智能，提供了更自然和高效的用户体验。GPT 4的发布是视频中的主要事件之一，标志着技术的一个重要进步。

💡用户界面(UI)

用户界面（UI）是指软件或设备的前端部分，用户通过它与系统进行交互。视频中提到了对GPT的UI进行了刷新，使其更简单、更自然，以便用户更容易地使用GPT的功能。这表明了设计者对于提升用户体验的重视。

💡桌面应用

桌面应用是指在计算机桌面操作系统上运行的软件应用程序。视频中提到了GPT的桌面版本发布，这意味着用户可以在没有网络浏览器的情况下，在本地计算机上使用GPT的功能，提高了使用的便捷性。

💡编程问题

编程问题是指在编写或理解计算机程序时遇到的问题。视频中，GPT帮助用户解决了一个编程问题，涉及获取特定位置和时间段的每日天气数据，并在代码中应用了一个函数来平滑温度数据。这展示了GPT在处理复杂任务，如数据分析和编程问题解决方面的应用潜力。

💡滚动平均

滚动平均是一种统计学上用来分析时间序列数据的方法，通过计算连续时间段内的平均值来平滑数据。在视频中，代码中的一个函数就是用来对温度数据进行滚动平均处理，以减少数据中的噪声，使趋势更加明显。

💡视觉能力

视觉能力在这里指的是模型处理和理解视觉信息的能力。视频中的GPT桌面应用展示了视觉能力，能够查看屏幕上的内容，如代码和图表，并对其进行分析和解释。这使得GPT能够更全面地与用户交互，提供更丰富的信息处理能力。

💡实时信息搜索

实时信息搜索是指能够即时搜索并获取最新信息的能力。视频中提到了GPT的浏览功能，用户可以在对话中搜索实时信息，这表明了GPT在提供最新、最相关信息方面的能力。

💡高级数据分析

高级数据分析涉及使用复杂数学和统计方法来分析数据，提取有用信息和洞察力。视频中提到GPT可以上传图表或其他信息，并进行分析，提供答案。这展示了GPT在处理和解释复杂数据集方面的高级能力。

Highlights

介绍新的旗舰模型gbt 4，它为包括免费用户在内的所有人带来了gbd4级别的智能。

gbt 40在语音、文本和视觉方面的能力得到了提升，并且使用更加自然和容易。

gbt 40原生支持语音、文本和视觉，极大提高了效率，并允许为免费用户提供GPT 4级别的智能。

超过1亿人使用chat GPT进行工作、学习和创造，现在这些高级工具也对免费用户开放。

展示了如何使用chat GPT解决线性方程，说明了数学在日常生活中的应用。

通过实时对话和演示，展示了gbt 40在实时语音转换和情感识别方面的能力。

演示了如何使用gbt 40的视觉效果解读和讨论代码以及生成的图表。

gbt 40的发布意味着高级AI工具对所有人免费开放，减少了使用门槛。

介绍了gbt 40在50多种语言中的改进，使其能够服务于更广泛的用户群体。

讨论了将新技术安全地引入世界时面临的挑战，以及如何与不同利益相关者合作以负责任地部署这些技术。

展示了gbt 40在实时语音模式下的交互，包括情绪感知和实时响应。

通过讲述一个关于机器人和爱的睡前故事，展示了模型在不同情感风格中生成语音的能力。

演示了如何使用gbt 40的视觉功能来解决数学问题，展示了模型的交互式学习和教学能力。

强调了线性方程在现实生活中的应用，如计算费用、规划旅行、烹饪以及商业利润和损失计算。

展示了如何通过chat GPT桌面应用程序和语音应用程序实时交互，以及如何将代码发送给模型进行分析。

演示了gbt 40如何通过实时翻译功能帮助不同语言的用户进行交流。

通过实时分析面部表情来识别情绪，展示了gbt 40在情感识别方面的高级能力。

Transcripts

open

[Music]

for

for

for

for hey chbt how are you I'm doing

fantastic thanks for asking how about

you how's your day going I'm uh doing

great so I would like you to function as

a translator I have a friend here who

only speaks Italian and I only speak

English and uh every time you hear

English I want you to translate it to

Italian and if you hear Italian I want

you to translate it back to English is

that

good Mike she wonders if whales could

talk what would they tell us um they

might ask uh how do we solve linear

equations certainly yes great looks like

it works

okay chat PT I'm sharing with you the

plot now I'm wondering if you can give

me a really brief one- sentence overview

of what you see

plot displays smoothed average minimum

and maximum temperatures throughout 2018

with a notable annotation marking a big

rainfall event in late

September fantastic I have another

question for you um which months do you

see the hottest temperatures and roughly

what temperatures do those correspond

to the hottest temperatures occur around

July and August the maximum temperature

during these months is roughly between

25 de and 30° 77° fahit to 86°

Fahrenheit ah there we go it looks like

you're feeling pretty happy and cheerful

with a big smile and maybe even a touch

of excitement whatever's going on it

seems like you're in a great mood care

to share the source of those good vipes

yeah no uh the reason I'm in a really

good mood is because we were doing a

presentation showcasing how useful and

amazing you

are oh stop it you're making me BL

everyone Hi everyone thank you thank you

it's great to have you here today today

today I'm going to talk about three

things that's it we will start with why

it's so important to us to have a

product that we can make freely

available and broadly available to

everyone and we're always trying to find

out ways to reduce friction so everyone

can use CH wherever they are so today

we'll be releasing the desktop version

of CH gbt and the refreshed UI that

makes it simpler to use is much more

natural as

well but the big news today is that we

are launching our new flagship model and

we are calling it gbt

4 the special thing about gbt 40 is that

it brings gbd4 level intelligence to

everyone including our free users we'll

be showing some live demos today to show

the full extent of the capabilities of

our new model and we'll be rolling them

out iteratively over the next few weeks

all right so let's get

started a very important part of our

mission is to be able to make our

Advanced AI tools available to everyone

for free we think it's very very

important that people have an intuitive

feel for what the technology can do and

so we really want to pair it with this

broader understanding and we're always

finding ways to reduce that friction and

recently we made CH gbt available

without the signup

flow and today we're also bringing the

desktop app to Chad gbt because we want

you to be able to use it wherever you

are as you can see it's easy it's simple

it integrates very very easily in your

workflow along with it we have also

refreshed the

UI we know that these models get more

and more complex but we want the

experience of interaction to actually

become more natural easy and for you not

to focus on the UI at all but just focus

on the collaboration which had

GPT and now the big news today we are

releasing our newest Flagship model this

is GPT for o

[Applause]

GPT 40 provides gp4 level intelligence

but it is much faster and it improves on

its capabilities across text vision and

audio for the past couple of years we've

been very focused on improving the

intelligence of these models and they've

gotten pretty good but this is the first

time that we are really making a huge

step forward when it comes to the EAS of

use and this is incredibly important

because we're looking at the future of

interaction between ourselves and the

machines and we think that GPT 40 is

really shifting that Paradigm into the

future of collaboration where this

interaction becomes much more natural

and Far Far

easier but you know making this happen

is actually quite complex because when

we interact with one another there's a

lot of stuff that we take for granted

you know the ease of our dialogue when

we interrupt one another the background

noises the multiple voices in a

conversation or you know understanding

the tone of voice all of these things

are actually quite complex for for these

models and until now with voice mode we

had three models that come together to

deliver this experience you have

description intelligence and then text

to speech all comes together in

orchestration to deliver voice mode this

also brings a lot of latency to the

experience and it really breaks that

immersion in the collaboration which had

gbt but now with gbt 40 this all happens

natively gbt 4 reasons across voice text

and vision

and with these incredible efficiencies

it also allows us to bring the GPT 4

class intelligence to our free users

this is something that we've been trying

to do for many many months and we're

very very excited to finally bring gbt

40 to all of our

users today we have 100 million people

more than 100 million in fact they use

chat GPT to create work

learn and we have these Advanced tools

that are only available to our paid paid

users at least until now with the

efficiencies of 40 we can bring these

tools to

everyone so starting today you can use

gpts and the GPT

store so far we've had more than a

million users create amazing experiences

with gpts these are custom chat gbts for

specific use cases they're available in

the store and now our Builders have a

much bigger audience where you know

University professors can create content

for their students or podcasters can

create content for their

listeners and you can also use Vision so

now you can upload um screenshots photos

documents containing both text and

images

and you can start conversations with

chat gbt about all of this content you

can also use memory where it makes CH

GPT far more useful and helpful because

now it has a sense of continuity across

of all your

conversations and you can use browse

where you can search for Real Time

information in your conversation and

Advanced Data analysis where you can

upload charts or any information and it

will analyze

this information it will give you

answers and so

on lastly we have also improved on the

quality and speed in 50 different

languages for chbt and this is very very

important because we want to be able to

bring this experience to as many people

out there as

possible so we're very very excited to

bring dut 40 to all of our free us users

out there and for the paid users they

will continue to have up to five times

the capacity limits of our free

users but GPT 40 is not only available

in chat GPT we're also bringing it to

the

API

so so our developers can start building

today with GPD 40 and making amazing AI

applications deploying them at scale 40

is available at 2x faster 50% cheaper

and five times higher rate limits

compared to gbd4

Turbo but you know is we bring these

Technologies into the world it's quite

challenging to figure out how to do so

in a way that's both useful and also

safe and gbd 40 presents new challenges

for us when it comes to safety because

we're dealing with realtime audio

realtime

vision and our team has been hard at

work figuring out how to build in

mitigations against

misuse we continue to work with

different stakeholders out there from

government media entertainment all

Industries red

seamers Civil Society to figure out how

to best bring these Technologies into

the world so over the next few weeks

we'll continue our iterative deployment

to bring out all the capabilities to you

but today I want to show you all these

capabilities so we'll do some live demos

I will bring on two of our research

leads Mark Shen and Barrett Z to

[Applause]

join hi I'm I'm Barrett hey I'm Mark so

one of the key capabilities we're really

excited to share with you today is

realtime conversational speech let's

just get a demo fired up so I'm taking

out a phone if you are wondering about

this wire it's so we have consistent

internet and if you see there's this

little icon on the bottom right of the

track GPT app and this will open up GPT

40's audio

capabilities hey chat GPT I'm Mark how

are you oh mark

I'm doing great thanks for asking how

about you hey so I'm on stage right now

I'm doing a live demo and frankly I'm

feeling a little bit nervous can you

help me calm my nerves a little

bit oh you're doing a live demo right

now that's awesome just take a deep

breath and remember you're the expert I

like that suggestion let me try a couple

deep breaths can you give me feedback on

my breaths okay here I go

whoa

slow a bit there mark you're not a

vacuum cleaner breathe in for a count of

four okay uh let me try again so I'm

going to breathe in

deeply and then

breathe for four and then exhale

slowly okay I'll try again breathing

in and breathe

out that's it how do you feel I feel a

lot better thank you so

much so Mark you've been working on

these capabilities for a while now can

you tell us a bit how it's different

from voice mode right so if you've used

our voice mode experience before you'll

notice a couple key differences first

you know you can now interrupt the model

you don't have to wait for it to finish

your turn before you can start speaking

and you know you can just butt in

whenever you want second the model is

real time responsiveness so that means

that you don't have this awkward 2 to 3

second lag before you wait for the model

to give a response and finally the model

picks up on emotion right when I was

breathing super hard there it could tell

and it you hey you might want to calm

down a little bit you're kind of running

a little bit too fast so you know it

really has that capability across the

board to perceive your emotion not only

that though the model is able to

generate voice in a variety of different

emotive Styles and it really has a wide

dynamic range so I'm going to fire up

another demo for that yeah

hey chachu PT how are you doing I'm

doing fantastic thanks for asking how

about you pretty good what's up so my

friend um Barrett here he's been having

trouble sleeping lately and uh I want

you to tell him a bedtime story about

robots and love oh a bedtime story about

robots and love I got you covered gather

round Barrett once upon a time in a

world not too different from ours there

was a ro robot named bite bite was a

curious robot always expl started this

story but I want a little bit more

emotion in your voice a little bit more

drama got it let's add some drama once

upon a time in a world not too different

from ours there was a robot named no

chat I really want maximal emotion like

maximal expressiveness much more than

you were doing before understood let's

amplify the drama once upon a time in a

world not too different from ours there

was a robot named bite bite can you do

this in a robotic voice now initiating

dramatic robotic voice once upon a time

in a world not too different from ours

there was a robot named bite bite was a

curious robot always exploring new yeah

Barett here calm down a little bit can

you end the story um but do it in a

singing voice h ah and so bite found

another robot friend and may live circly

Ever After thank you so much I

definitely feel a lot more

[Music]

relaxed you've just seen the voice

capabilities but we also want to show

you the vision capabilities as the model

can also see the whole world around us

yeah absolutely like as you can see you

know you can chat with chat GPT in real

time but you can also interact with it

um with video as well okay let me boot

up chat

BT hey Chachi

BT hello there how's it going it's going

really well today I'd really like your

help solving a math problem I'm all ears

what math problem can I help you tackle

today so I'm going to write down a

linear equation on a sheet of paper and

I'll show you and then I love your help

working me through it but importantly

don't tell me the solution just help

give me hints along the

way got

it okay I see it no I didn't show you

yet just give me help along the way one

second whoops I got too excited I'm

ready when you

are so chat

GPT what equation did I write down

there ah I see it now you wrote down 3x

+ 1 = 4 yep exactly so what's the first

step I should take to try to solve this

the first step is to get all the terms

with X on one side and the constants on

the other side so what do you think we

should do with that plus one okay I'm

going to try to subtract one from both

sides and then I'll see what I

get great

idea perfect now now what do you get

when you subtract one from both

sides okay so chat GPT this is what I

ended up with how does this look spot on

now you've isolated the term with X on

one side and it looks like 3x equal 3

what do you think we should do next to

solve for x I'm not sure can you give me

another

hint of course you have 3x and you want

to find the value of x

think about what operation would undo

multiplication is it

subtraction close but think of the

opposite of multiplication because 3x

means 3 * X okay I think it's division

let me try to divide both sides by three

and let me see what I get Bingo go ahead

and divide both sides by

three okay so chat GPT this is what I

ended up with how does this look

it looks perfect you've solved it and x

equals 1 nicely done how do you feel

about solving linear equations now yeah

honestly i' I'm not pretty confident I

can solve linear equations but why would

you ever need to use this in the real

world I'm really

skeptical that's a fair question linear

equations pop up in a lot of everyday

situations even if we don't realize it

for example calculating expenses

planning travel cooking and and even in

business for profit and loss

calculations it's basically a way to

solve problems where you need to find an

unknown Value Plus wow okay you know I

have a lot of unknown values in my life

I'm totally convinced we I'm going to

learn math

now I love that attitude Matt can

definitely help solve some of life's

mysteries whenever you're ready to dive

into more math I'm here for you anything

else you'd like to tackle today so chbt

I really love that you you know taught

the value of math to my friend Mark and

I wrote uh one last thing I'd love if

you could take a look at of course I'd

love to see what you wrote show it to me

whenever you're ready okay so this is

what I wrote down what do you

see a I see I love chat chpt that's so

sweet of

you yeah well I really appreciate all

the

help so yeah as we can

see wow that's quite the outfit you've

got on yeah as we can see you know we

can chat in real time to chat GPT and

not only that we can interact with it

with uh video as well and I swear like

if you look at Barrett's GPT history

it's all equations like

this now that you know you can do linear

equations can you show us something more

complex I think so okay next let's try

something uh coding related so let me

take out um a computer for this

okay so I'm going to open the chat gbt

desktop app like miror was talking about

before okay and to give a bit of

background on what's going on so here we

have um a computer and on the screen we

have some code and then the chat gbt

voice app is on the right so chat gbt

will be able to hear me but it can't see

anything on the screen so I'm going to

highlight the code command C it and then

that will send it to chat GPT and then

I'm going to talk about the code to chat

GPT hey chat GPT

hey there how's it going yeah it's going

really well I was wondering if you could

help me with uh a coding problem today

of course I'd love to help you out

what's the coding problem you're dealing

with okay I'm going to share with you

some code one second sure thing take

your

time okay so I just shared some code

with you could you give me a really

brief one- sentence description of

what's going on in the code this code

fetches daily weather data for a

specific location and time period

Smooths the temperature data using a

rolling average annotates a significant

weather event on the resulting plot and

then displays the plot with the average

minimum and maximum temperatures over

the year awesome thanks so much and in

the code there's this function Fu could

you describe to me what the plot would

look like if I had versus didn't have

this function sure the function Fu XY

takes in a data frame X containing

temperature data and a window size y for

calculating the rolling mean it Smooths

the average temperature minimum

temperature and maximum temperature

columns by applying a rolling mean over

the specified window with the fu

function the plot would show smoother

temperature lines because the rolling

mean reduces the noise or fluctuations

in the data awesome this makes thanks so

much so yeah I definitely will want to

apply this function and so I'm going to

uh generate the plot and then show it to

you give me one

second absolutely take your time time

I'm excited to see the plot when you're

ready yeah so so far chat gbt has only

been able to see the code and now I'm

going to run it and then I'll use the

vision capabilities of the chbt desktop

app so it can actually see everything

going on on the screen as

well okay chat GPT I'm sharing with you

the plot now I'm wondering if you can

give me a really brief one sentence

overview of what you

see plot displays smoothed average

minimum and maximum temperatures

throughout 2018 with a notable

annotation marking a big rainfall event

in late

September fantastic I have another

question for you um which months do you

see the hottest temperatures and roughly

what temperatures do those correspond

to the hottest temperatures occur around

July and August the maximum temperature

during these months is roughly between

25° and 30° 77° F to 8 86°

F what's going on with the Y AIS is this

in Celsius or Fahrenheit the Y AIS is in

Celsius the temperatures are labeled

accordingly such as average temperature

minimum temperature and maximum

temperature yeah so as we can see you

know not only can cha PT help me solve

very easy linear um algebra equations

that I need help with it can also

interact with you know code bases and

see the outputs of plots and everything

like this going on on a computer

[Music]

so a few minutes ago we asked the live

audience on X to submit few requests for

what they would like us to try out here

so I will take a couple of

prompts okay bot gasar wants to know if

gb40 is capable of realtime

translation Mark you want to try this

one sure yeah let's do it I I speak

Italian so we can just English Italian's

try to do English Italian sure let's do

it hey Chachi how are you I'm doing

fantastic thanks for asking how about

you how's your day going I'm uh doing

great so I would like you to function as

a translator I have a friend here who

only speaks Italian and I only speak

English and uh every time you hear

English I want you to translate it to

Italian and if you hear Italian I want

you to translate it back to English is

that good perfecto

Mike she wonders if Wales could talk

what would they tell us um they might

ask uh how do we solve linear

equations certainly yes great it looks

like it

[Applause]

works all right so the next one is from

burito John 78 who asks can you tell

what you're feeling just by looking at

your face Barrett you want to give this

one a try absolutely let's try it

out hey chat

GPT hey there what's up how can I

brighten your day today okay yeah so I'm

going to show you um a selfie of what I

look like and then I'd like you to try

to see what emotions I'm feeling based

on how I'm looking sounds like a fun

challenge go ahead and show me that

selfie and I'll put my emotional

detective hat on okay so here's me so

what kind of emotions do you think I'm

feeling H it seems like I'm looking at a

picture of a wooden surface oh you know

what that was the thing I sent you

before don't worry I'm not actually a

table um okay so so take a take another

look uh that makes more

sense a there we go it looks like you're

feeling pretty happy and cheerful with a

big smile and maybe even a touch of

excitement whatever's going on it seems

like you're in a great mood care to

share the source of those Good Vibes

yeah no uh the reason I'm in a really

good mood is because we were doing a

presentation showcasing how useful and

amazing you

are oh stop it you're making me BL

amazing well that's it for today on live

demos as you can see this is this just

feels so magical and and that's

wonderful but we also want to remove

some of the mysticism from the

technology and bring it to you so you

can try it for yourself so over the next

few weeks we'll be rolling out these

capabilities to everyone today has been

very much focused on the free users and

the new modalities and new products but

we also care a lot about the next

Frontier so soon we'll be updating you

on our progress towards the next big

thing and before we wrap up I just want

to thank the incredible open AI team and

also thanks to Jensen and the Nvidia

team for bringing us the most advanced

gpus to make this demo possible today

and thank you all very very much for

being a part of this today

[Applause]