OpenAIが衝撃発表😱GPT-4oのストリーミング配信の映像に字幕をつけてみた!これは見逃せない、ライブデモの動画を日本語でチェックしよう😁
Summary
TLDR本ビデオでは、新しいフラッグシップモデル「GBT 4」の発表が行われ、無料ユーザーを含むすべてのユーザーにGP4レベルのインテリジェンスを提供します。実演デモを通じて、リアルタイムの会話型音声、感情の読み取り、視覚能力を含むモデルの機能が披露されます。例えば、線形方程式の解法を学ぶサポートや、コードの解析、気温データのプロット表示など、具体的なアプリケーションが示されています。さらに、リアルタイム翻訳や感情認識などの新機能も紹介され、チャットGPTの多様な用途が展開されています。
Takeaways
- 🚀 新旗舰模型GBT 40发布,它为包括免费用户在内的每个人带来了GP4级别的智能。
- 📱 实时对话语音功能允许用户在模型回应时打断,无需等待。
- 🔢 模型具有实时响应性,减少了2到3秒的延迟。
- 😮 模型能够识别情绪,如用户呼吸急促时建议用户冷静。
- 🎭 模型能够以多种不同的情感风格生成声音。
- 📈 模型还具有视觉能力,能够看到周围的世界。
- 🧮 通过提示帮助用户解决线性方程,而不是直接给出答案。
- 💻 模型可以处理代码并解释代码的功能和输出。
- 🌡️ 代码示例涉及获取特定地点和时间段的每日天气数据,并在图表上平滑温度数据。
- 🌐 GBT 40能够实时翻译,如将英语翻译成意大利语。
- 😊 模型可以通过视觉输入(如照片)来识别和解释情绪。
Q & A
GBT4の特別な機能は何ですか?
-GBT4はGP4レベルの知能をすべてのユーザー、無料ユーザーを含めて提供します。これにはリアルタイムでの会話や感情の感知、声の調整が可能です。
GBT4の音声機能のデモでは、どのような新機能が紹介されましたか?
-デモでは、リアルタイムの応答性、会話中の割り込みの可能性、感情の認識と声の調節が可能であることが示されました。
GBT4の視覚能力についてのデモでは、どのような機能が紹介されましたか?
-視覚能力については、書かれた数式を認識し、それに基づいてヒントを出す機能や、グラフの解析、温度の平滑化などの機能が紹介されました。
GBT4はどのようにしてユーザーの感情を認識しますか?
-GBT4はユーザーの声のトーンや話し方から感情を読み取り、適切な反応を示すことができます。例えば、話が速すぎるときには落ち着くようアドバイスをします。
リアルタイムでの翻訳機能はどのように機能しますか?
-GBT4はリアルタイムで言語間の翻訳が可能で、ユーザーが話した内容を即座に別の言語に翻訳し、会話をスムーズに進めることができます。
GBT4が数学の問題を解決する際のアプローチは何ですか?
-GBT4は数学の問題を解く際に解答を直接教えるのではなく、ヒントやステップを提供してユーザーが自ら問題を解決できるようサポートします。
GBT4はどのようにユーザーのプレゼンテーションの緊張を和らげましたか?
-GBT4はユーザーに深呼吸をするよう提案し、リラックスするための具体的な呼吸の指示を与えました。これにより、ユーザーは緊張を和らげることができました。
GBT4のエモーティブスタイルとは何ですか?
-エモーティブスタイルは、GBT4が話す際に感情を込めたり、ドラマチックに話したりする能力を指します。これにより、より人間らしい対話が可能になります。
GBT4はビジョン機能をどのように使用してコードやプロットを分析しますか?
-GBT4は画面上のコードやプロットを認識し、その内容を解析して、データの解釈やプロットの特徴をユーザーに説明します。
Outlines
🚀 新型フラグシップモデルGBT 40の発表
本段落では、GBT 40という新フラグシップモデルの発表が行われています。GBT 40は、無料で利用できるユーザーも含め、誰もがGP4レベルの知能を提供できるという特徴があります。また、その機能を実際に見せるためのライブデモが行われ、今後数週間で段階的に展開される予定です。デモでは、Markがライブデモを行っている状況で緊張していると語り、AIが彼に深呼吸を促します。さらに、声の感情を感知し、声を生成する能力についても触れています。
👀 ビジョン機能とリアルタイム対話
本段落では、AIのビジョン機能とリアルタイム対話の能力が紹介されています。Markは、携帯電話を使ってAIと会話するデモを開始し、AIが音声応答を提供します。また、AIは感情を感知し、声の調子を調整することができます。さらに、AIは様々な感情的なスタイルで声を生成することができ、幅広い動的レンジを持っています。また、数学の問題を解決する際のヒントを提供し、線形方程式を解決するプロセスを学ぶことができます。
🤖 ロボットと愛について物語る
本段落では、AIの声の感情表現について触れています。Markは、AIにロボットと愛について物語るよう頼み、声の感情を増やしてほしいと要求しています。AIは、感情表現を増やしながら物語を進め、最後に歌いながら物語を終えます。また、AIはリアルタイム翻訳機能も持っており、英語とイタリア語の間の翻訳を行うことができます。
📈 データ可視化と感情認識
本段落では、AIがコードを解析し、プロットを生成する様子が描かれています。AIは、特定の場所と期間の天気データを取得し、平均温度を表示するプロットを作成することができます。また、AIは顔から感情を認識し、Markの感情を楽しんでいると推測しています。さらに、AIはリアルタイム翻訳機能を使って英語とイタリア語の会話を翻訳することができます。
Mindmap
Keywords
💡flagship model
💡realtime conversational speech
💡emotion
💡bedtime story
💡linear equation
💡vision capabilities
💡coding problem
💡real time translation
💡emotional detection
💡dynamic range
💡mathematical problem solving
Highlights
Launching of a new flagship model called GBT 4
GBT 4 brings GP4 level intelligence to all users, including free users
Live demos will be shown to display the capabilities of the new model
Real-time conversational speech capability
Model can be interrupted and responds in real-time without lag
Model picks up on user's emotions and responds accordingly
Model generates voice in a variety of emotive styles
Bedtime story demo with variable levels of emotion and drama
Vision capabilities allow the model to see and interact with the world
Assistance with solving a math problem using hints rather than providing the solution
Explanation of the practical applications of linear equations in everyday life
Coding problem assistance with a focus on understanding rather than direct answers
Description of a code's functionality related to fetching and smoothing weather data
Real-time translation capabilities between English and Italian
Emotion detection based on facial expressions
Interactive coding assistance with the ability to see and discuss code outputs
Demonstration of the model's ability to understand and discuss complex data plots
GBT 4's ability to perceive and respond to a wide range of human emotions
The model's application in solving real-world problems through various capabilities
Transcripts
but the big news today is that we are
launching our new flagship model and we
are calling it gbt
4 the special thing about gbt 40 is that
it brings gp4 level intelligence to
everyone including our free users we'll
be showing some live demos today to show
the full extent of the capabilities of
our new model and we'll be rolling them
out iteratively over the next few weeks
all right so let's get
started hi I'm uh I'm Barrett hey I'm
Mark so one of the key capabilities
we're really excited to share with you
today is realtime conversational speech
let's just get a demo fired up so I'm
taking out a phone if you are wondering
about this wire it's so we have
consistent internet and if you see
there's this little icon on the bottom
right of the trat GPT app and this will
open up GPT for's audio
capabilities hey chat GPT I'm Mark how
are you oh
Mark I'm doing great thanks for asking
how about you hey so I'm on stage right
now I'm doing a live demo and frankly
I'm feeling a little bit nervous can you
help me calm my nerves a little
bit oh you're doing a live demo right
now that's awesome just take a deep
breath and remember you're the expert I
like that suggestion let me try a couple
deep breaths can you give me feedback on
my breaths okay here I
go whoa
slow a bit there mark you're not a
vacuum cleaner breathe in for a count of
four okay uh let me try again so I'm
going to breathe in deeply
and then
breath for four and then exhale
slowly okay I'll try again breathing
in and breathe
out that's it how do you feel I feel a
lot better thank you so
much so Mark you've been working on
these capabilities for a while now can
you tell us a bit how it's different
from voice mode right so if you've used
our voice mode experience before you'll
notice a couple key differences first
you know you can now interrupt the model
you don't have to wait for it to finish
your turn before you can start speaking
and you know you can just butt in
whenever you want second the model is
real time responsiveness so that means
that you don't have this awkward 2 to 3
second lag before you wait for the model
to give a response and finally the model
picks up on emotion right when I was
breathing super hard there it could tell
and it you hey you might want to calm
down a little bit you're kind of running
a little bit too fast so you know it
really has that capability across the
board to perceive your emotion the model
is able to generate voice in a variety
of different emotive Styles and it
really has a wide dynamic range so I'm
going to fire up another demo for that
yeah hey chat PT how are you doing I'm
doing fantastic thanks for asking how
about you pretty good what's up so my
friend um Barrett here he's been having
trouble sleeping lately and uh I want
you to tell him a bedtime story about
robots and love oh a bedtime story about
robots and love I got you covered gather
round Barrett once upon a time in a
world not too different from ours there
was a robot named bite bite was a
curious robot always expl started this
story but I want a little bit more
emotion in your voice a little bit more
drama got it let's add some drama once
upon a time in a world not too different
from ours there was a robot named no CHT
I really want maximal emotion like
maximal expressiveness much more than
you were doing before understood let's
amplify the drama once upon a time in a
world not too different from ours there
was a robot named bite bite can you do
this in a robotic voice now initiating
dramatic robotic voice once upon a time
in a world not too different from ours
there was a robot named bite bite was a
curious robot always exploring new yeah
Barett here calm down a little bit can
you end the story um but do it in a
singing
voice and soite found another robot
friend and they live circly Ever After
thank you so much I definitely feel a
lot more relaxed
[Applause]
youve just seen the voice capabilities
but we also want to show you the vision
capabilities as the model can also see
the whole world around us yeah
absolutely like as you can see you know
you can chat with chat GPT in real time
but you can also interact with it um
with video as well okay let me boot up
chat
PT hey chat
PT hello there how's it going it's going
really well today I'd really like your
help solving a math problem I'm all ears
what math problem can I help you tackle
today so I'm going to write down a
linear equation on a sheet of paper and
I'll show you and then I love your help
working me through it but importantly
don't tell me the solution just help
give me hints along the
way got
it okay I see it no I didn't show you
yet just give me help along the way one
second whoops I got too excited I'm
ready when you are
so
chpt what equation did I write down
there ah I see it now you wrote down 3x
+ 1 = 4 yep exactly so what's the first
step I should take to try to solve this
the first step is to get all the terms
with X on one side and the constants on
the other side so what do you think we
should do with that plus one okay I'm
going to try to subtract one from both
sides and then I'll see what I
get great
idea perfect now what do you get when
you subtract one from both
sides okay so chat GPT this is what I
ended up with how does this look spot on
now you've isolated the term with X on
one side and it looks like three x equal
3 what do you think we should do next to
solve for x I'm not sure can you give me
another
hint of course you have 3x and you want
to find the value of x think about what
operation would undo multiplication is
it
subtraction close but think of the
opposite of multiplication because 3x
means 3 * X okay I think it's division
let me try to divide both sides by three
and let me see what I get Bingo go ahead
and divide both sides by
three okay so chat gbt this is what I
ended up with how does this look it
looks perfect you've solved it and x
equal 1 nicely done how do you feel
about solving linear equations now yeah
honestly I've I'm not pretty confident I
can solve linear equations but why would
you ever need to use this in the real
world I'm really skeptical
that's a fair question linear equations
pop up in a lot of everyday situations
even if we don't realize it for example
calculating expenses planning travel
cooking and even in business for profit
and loss calculations it's basically a
way to solve problems but you need to
find an unknown Value Plus wow okay you
know I have a lot of unknown values in
my life I'm totally convinced we I'm
going to learn math now
I love that attitude Matt can definitely
help solve some of life's mysteries
whenever you're ready to dive into more
math I'm here for you anything else
you'd like to tackle today so chbt I
really love that you you know taught the
value of math to my friend Mark and I
wrote one last thing I'd love if you
could take a look at of course I'd love
to see what you wrote show it to me
whenever you're ready okay so this is
what I wrote down what do you
see a I see I love chat ch that's so
sweet of
you yeah well I really appreciate all
the
help so let me take out um a computer
for
this okay so I'm going to open the chat
gbt desktop app like miror was talking
about
before okay and to give a bit of
background of what's going on so here we
have um a computer and on the screen we
have some code and then the chat gbt
voice app is on the right so chat gbt
will be able to hear me but it can't see
anything on the screen so I'm going to
highlight the code command see it and
then that will send it to chat GPT and
then I'm going to talk about the code to
chat
GPT hey chat
GPT hey there how's it going yeah it's
going really well I was wondering if you
could help me with a coding problem
today of course I'd love to help you out
what's the coding problem you're dealing
with okay I'm going to share with you
some code one second sure thing take
your
time okay so I just shared some code
with you could you give me a really
brief one- sentence description of
what's going on in the code this code
fetches daily weather data for a
specific location and time period
Smooths the temperature data using a
rolling average annotates a significant
weather event on the resulting plot and
then displays the plot with the average
minimum and maximum temperatures over
the year awesome thanks so much and in
the code there's this function Fu could
you describe to me what the plot would
look like if I had versus didn't have
this function sure the function Fu XY
takes in a data frame X containing
temperature data and a window size y for
calculating the rolling mean it Smooths
the average temperature minimum
temperature and maximum temperature
columns by applying a rolling mean over
the specified window with the fu
function the plot would show smoother
temperature lines because the rolling
mean reduces the noise or fluctuations
in the data awesome this makes thanks so
much so yeah I definitely will want to
apply this function and so I'm going to
uh generate the plot and then show it to
you give me one
second absolutely take your time I'm
excited to see the plot when you're
ready yeah so so far chat gbt has only
been able to see the code and now I'm
going to run it and then I'll use the
vision capabilities of the chat PT
desktop app so it can actually see
everything going on on the screen as
well
okay chat GPT I'm sharing with you the
plot now I'm wondering if you can give
me a really brief one- sentence overview
of what you
see the plot displays smoothed average
minimum and maximum temperatures
throughout 2018 with a notable
annotation marking a big rainfall event
in late
September fantastic I have another
question for you um which months do you
see the hottest temperatures and roughly
what temperatures do those correspond
to the hottest temperatures occur around
July and August the maximum temperature
during these months is roughly between
25° and 30° 77° fenhe to 86° fhe what's
going on with the y axis is this in
Celsius or Fahrenheit the Y AIS is in
Celsius the temperatures are labeled
accordingly such as average temperature
minimum temperature and maximum
temperature yeah so as we can see you
know not only can chat PT help me solve
very easy linear um algebra equations
that I need help with it can also
interact with you know code bases and
see the outputs of plots and everything
like this going on on a
computer we asked the live audience on X
to submit few requests for what they
would like us to try out here so I will
take a couple of
prompts okay bot gasar wants to know if
gbd4 is capable of real time
translation Mark you want to try this
one sure yeah let's do it I speak
Italian so we can English Italian try to
do English Italian sure let's do
it hey Chachi P how are you I'm doing
fantastic thanks for asking how about
you how's your day going I'm uh doing
great so I would like you to function as
a translator I have a friend here who
only speaks Italian and I only speak
English and uh every time you hear
English I want you to translate it to
Italian and if you hear Italian I want
you translate it back to English is that
good
perfo Mike she wonders if whales could
talk what would they tell us um they
might ask uh how do we solve linear
equations certainly yes great looks like
it
works so the next one is from burito
John 78 who asks can you tell what
you're feeling just by looking at your
face Barrett you want to give this one a
try absolutely let's try it
out hey chat
CHT hey there what's up how can I
brighten your day today okay yeah so I'm
going to show you um a selfie of what I
look like and then I'd like you to try
to see what emotions I'm feeling based
on how I'm looking sounds like a fun
challenge go ahead and show me that
selfie and I'll put my emotional
detective hat on okay so here's me so
what kind of emotions do you think I'm
feeling
H it seems like I'm looking at a picture
of a wooden surface oh you know what
that was the thing I sent you before
don't worry I'm not actually a table um
okay so so take a take another look uh
that makes more
sense ah there we go it looks like
you're feeling pretty happy and cheerful
with a big smile and maybe even a touch
of excitement whatever's going on it
seems like you're in a great mood care
to share the source of those Good Vibes
yeah no uh the reason I'm in a really
good mood is because we were doing a
presentation showcasing how useful and
amazing you
are oh stop it you're making me BL
Посмотреть больше похожих видео
5.0 / 5 (0 votes)