Gemini Live Is WILD | Hands-on with Google's new conversational AI

Summary

Gemini Live, showcased at the 'Made by Google' event, is a new AI assistant set to replace Google Assistant. Demonstrated on Pixel 8 Pro and S24 Ultra, it offers a seamless, conversational experience with 10 customizable voice options. Users can engage in continuous dialogue without repeated wake words and even multitask on their devices. Gemini Live's intelligent responses and ability to handle interruptions make it a promising feature, despite limitations like requiring an internet connection and lacking access to personal data.

Takeaways

• 🌟 Gemini Live is a new feature showcased at the 'Made by Google' event with the Pixel 9es, designed to replace Google Assistant as the default assistant.
• 📱 It is available on devices like the S24 Ultra and Pixel 8 Pro, and can be activated by selecting the Gemini Live option within the Assistant UI.
• 🔊 Users can choose from 10 different voices for Gemini Live, with the ability to change the voice later in settings.
• 🗣️ Gemini Live allows for natural and continuous conversations without needing to repeatedly wake the assistant with voice commands.
• 📲 The feature runs in the cloud, which means it requires an internet connection to function and does not have access to personal data like calendar, emails, or messages.
• 🤔 Gemini Live provides thoughtful and in-depth responses to questions, capable of handling interruptions and steering the conversation in different directions.
• 🍰 It can provide recipes and adapt them based on user requests, such as changing a classic cheesecake recipe to a no-bake lemon cheesecake.
• 🌐 Gemini Live can translate sentences and provide answers in different languages, enhancing its utility for multilingual users.
• 🔍 Users can revisit past conversations with Gemini Live, which retains memory of previous interactions.
• 🎁 Gemini Live can suggest gift ideas based on user input and preferences, showing an ability to understand and respond to personal queries.
• 🏠 The speaker expresses a desire for Gemini Live to be integrated into Google Nest devices and Pixelbuds Pro 2 for a more seamless smart home experience.

Q & A

What is Gemini Live?

Gemini Live is a new feature introduced by Google, designed to replace Google Assistant as the default assistant. It offers a more natural and continuous conversational experience with the AI, without needing to repeatedly wake it up.

Which devices currently support Gemini Live?

Gemini Live is available on the Pixel 8 Pro and the S24 Ultra, and it will come as standard on the Google Pixel 99's.

How do you activate Gemini Live on a supported device?

To activate Gemini Live, you need to open the Assistant app, and then select the Gemini Live option at the bottom right of the screen.

How many voices can you choose from when you first start Gemini Live?

When you start Gemini Live for the first time, you get to choose from 10 different voices.

Can you change the voice you've selected in Gemini Live later on?

Yes, you can change the voice later in the settings if you wish to do so.

What is special about the conversational aspect of Gemini Live?

The conversational aspect of Gemini Live is designed to be natural and continuous, allowing users to have ongoing conversations without needing to frequently wake up the assistant.

Does Gemini Live require an internet connection to function?

Yes, Gemini Live requires an internet connection as it runs in the cloud and needs to access the cloud to provide answers.

Can Gemini Live access personal information such as calendar, emails, or messages?

No, Gemini Live does not have access to personal information like calendar, emails, or messages. It only knows general information such as your location and anything you tell it during the conversation.

What are some limitations of Gemini Live in terms of phone control?

Gemini Live cannot perform tasks like sending text messages, making calls, or sending emails. For such tasks, you would need to use the regular Gemini Assistant and exit the Gemini Live UI.

Can Gemini Live translate sentences or provide answers in different languages?

Yes, Gemini Live can translate sentences and provide answers in different languages upon request.

How does Gemini Live handle gift suggestions?

Gemini Live can provide gift suggestions based on the information you provide about the person and their interests. It can also adjust its suggestions based on the type of gift or experience you are interested in.

Outlines

00:00

🌟 Introduction to Gemini Live

The script introduces Gemini Live, a new feature showcased at the Google event for Pixel 9es. It's described as mind-blowing and is set to replace Google Assistant on devices like the S24 Ultra and Pixel 8 Pro. Gemini Live offers a seamless conversational experience with 10 initial voice options, continuous interaction without the need for frequent wake words, and the ability to multitask while conversing. The feature is intelligent, providing thoughtful and in-depth responses to questions, and allows for conversational steering and interruptions. It also offers functionalities like recipe suggestions and can adapt to user requests on the fly.

05:01

🚀 Gemini Live's Limitations and Additional Features

This paragraph delves into the limitations of Gemini Live, such as its dependency on an internet connection and lack of access to personal data like calendar and emails. Despite these, Gemini Live impresses with its ability to translate sentences and provide answers in different languages. It also retains memory of past conversations, allowing users to revisit and continue old discussions. The script highlights Gemini Live's potential in suggesting personalized gift ideas based on user input and its ability to offer detailed suggestions for activities, such as sports experiences. The author expresses a desire for Gemini Live to be integrated into Google Nest devices and Pixelbuds Pro 2 for a more hands-free experience and concludes with the need for a Gemini Advanced subscription for its use.

Keywords

💡Gemini live

Gemini live is a new feature introduced by Google, designed to replace Google Assistant as the default assistant on devices. It is characterized by its ability to have natural and continuous conversations with users without the need to repeatedly wake the device. In the video, Gemini live is highlighted for its impressive responsiveness and intelligence, as demonstrated through various examples of conversational interactions.

💡Pixel 9es

Pixel 9es refers to the new range of smartphones announced by Google during the 'Made by Google' event. These devices are significant in the context of the video as they are the first to feature Gemini live as a standard feature. The script mentions that Gemini live was showcased during the event and worked exceptionally well in the demo.

💡Assistant

In the context of the video, 'Assistant' refers to the virtual assistant feature on Google devices, which traditionally responds to voice commands. Gemini live is set to replace this traditional assistant, offering a more advanced and conversational experience to users, as illustrated by the script's description of its capabilities.

💡S24 Ultra

The S24 Ultra is mentioned as one of the devices that can support Gemini live, alongside the Pixel 8 Pro. It signifies the expansion of Gemini live beyond Google's own Pixel line, indicating that the feature is adaptable to other devices and manufacturers, thus broadening its potential user base.

💡Voices

The script discusses the option for users to choose from 10 different voices when they first start using Gemini live. This feature allows for a more personalized experience, as users can select a voice that they prefer for their interactions with the assistant.

💡Continuous Conversations

Continuous Conversations is a key feature of Gemini live that enables users to have ongoing dialogues with the assistant without needing to initiate the interaction with a wake word each time. This is highlighted in the script as a significant improvement over traditional voice assistants, making interactions more fluid and natural.

💡Liverpool

Liverpool is used in the script as an example to demonstrate the depth of knowledge and the conversational capabilities of Gemini live. The assistant provides detailed information about a recent football match involving Liverpool, showcasing its ability to understand and respond to specific and complex queries.

💡AR slot

AR slot is mentioned as the new manager of Liverpool football club, succeeding Jurgen Klopp. This reference is used in the script to illustrate how Gemini live can provide up-to-date and relevant information, even in the context of changing real-world circumstances.

💡Cheesecake Recipe

The term 'Cheesecake Recipe' is used in the script to demonstrate Gemini live's ability to adapt and provide customized responses. When asked for a recipe, Gemini live not only provides a classic cheesecake recipe but also adapts it to a lemon cheesecake and a no-bake version, showing its versatility.

💡Gift Ideas

The script highlights Gemini live's capability to offer personalized gift suggestions based on user inputs. It shows the assistant's ability to engage in a back-and-forth dialogue to narrow down the best gift options, reflecting its advanced conversational AI.

💡Sports Experience

The term 'Sports Experience' is used in the script to illustrate Gemini live's capacity to provide specific suggestions based on user interests. It shows the assistant's ability to understand the context of the user's request and offer relevant activity options, such as a cooking class or a sports-themed experience.

Highlights

Gemini live was showcased at the 'Made by Google' event where the Pixel 9es were announced.

Gemini live is a feature that works exceptionally well and is set to replace Google Assistant on devices.

The feature is available on Pixel 8 Pro and S24 Ultra, and will come standard on Google Pixel 99's.

Users can activate Gemini live by selecting the option within the Google Assistant.

Upon first use, Gemini live offers 10 different voice options for users to choose from.

The conversational interface of Gemini live allows for natural, continuous interactions without needing to repeatedly wake the assistant.

Gemini live can provide in-depth, thoughtful answers to questions, demonstrating its intelligence.

Users can interrupt Gemini live mid-conversation to ask different questions or change topics.

Gemini live operates in the cloud, requiring an internet connection to function.

It does not have access to personal information such as calendar, emails, or messages.

Gemini live cannot perform tasks like sending texts, making calls, or emails.

The feature includes real-time translation capabilities and can answer questions in different languages.

Users can review past conversations with Gemini live and continue from where they left off.

Gemini live can suggest gift ideas based on user input and preferences.

It asks relevant questions to tailor gift suggestions to the recipient's interests and hobbies.

Gemini live is expected to be integrated into Google Nest devices and Pixelbuds Pro 2 for a hands-free experience.

For non-Pixel 9 users, a subscription to Gemini Advanced will be required to use Gemini live.

Transcripts

one of the biggest showoffs from Google

at the made by Google event where the

pixel 9es were announced was Gemini live

and on stage when they showed this this

is one of those demos that actually

worked really well and I was thinking

maybe this is working a little bit too

well so I wanted to try it out for

myself and now I'm lucky that I've got

Gemini live working on both the pixel 8

Pro and the s24 ultra so I'm going to go

through like a crash course of exactly

what Gemini live is all about firstly if

you haven't tried Gemini live at any

point yet then it's like one of those

features that is a little bit

mind-blowing it just works so well and

this should be coming to a whole host of

devices it will be coming as standard on

the Google pixel 99's and of course

Gemini is going to replace Google

Assistant as your default assistant but

as I mentioned you can also get it on

devices like the s24 ultra and the pixel

8 Pro all you have to do is activate

assistant to get to Gemini live and once

you're inside Gemini you then just need

to on the bottom right of the screen

select that Gemini live option which you

can see just at the bottom there and as

soon as you click that you will go

straight into to the Gemini live feature

right first off when you start Gemini

live for the first time you will get 10

voices to pick from and you can scroll

through all these and pick your

favorites and you can also change the

voice later on in settings if you get

bored of them but I really like Vega

orbit Ursa and Orion if you end up going

with capella tell which is the British

voice just know not a single person in

England sounds like that this voice

sounds like everybody on that TV series

you on Netflix in like the latest series

when they're in the UK but no one sounds

like this be honored to be the voice you

choose for Gemini the conversations that

you can have though with the Gemini are

so natural and you can have continuous

conversations so you don't have to stop

and wake up the assistant every couple

of minutes by saying Hey or Okay Google

you can just continue to carry on asking

it questions you also don't have to stay

inside that Gemini live UI so if you're

chatting to it you can actually just go

about with using your phone as you would

which I think is a pretty nice bonus

that it doesn't completely stop you from

using your phone whilst talking to

Gemini the conversational part of Gemini

live is so good and it's actually really

exciting so I'm going to show you how

easy it is I'm not going to edit this

and you can just see how quickly and how

intelligently it can respond and just

how much like having a real conversation

it is

so what was Liverpool's last

score Liverpool won 2 to zero last

Saturday against ipswitch okay and what

was the game like did Liverpool dominate

or were ipswitch part of the

game Liverpool had a pretty strong

performance they didn't score until the

second half but they were definitely in

control for most of the game ipswitch

put up a decent

fight proved too

strong Dogo Joda opened the scoring for

Liverpool in the 60th minute followed by

a goal from mosala just 5 minutes later

don't Liverpool have a new manager

now yes Liverpool has a new manager his

name is AR slot and he took over from

Jurgen klopp it'll be interesting to see

how Liverpool does under his leadership

do you think it'll be a difficult job

for him or do you think it'll be quite

simple it's definitely a a big job to

step into Liverpool is a massive club

with a lot of expectations AR slot had a

lot of success with fyord so he's proven

he knows how to manage a team whether

it'll be easy or not it's too early to

say and that shows you how good Gemini

live is like it's answers are thought

out it's not just giving you generic

answers it kind of knows in depth the

questions that you're asking and as you

saw you can actually interrupt Gemini

live and ask it different questions or

steer the conversations in different

ways if you think of something that you

want to ask let me show you another

example of how this works so now I'll

just asked Gemini about a recipe for

something so can you give me a recipe

for a

cheesecake sure here's a classic

cheesecake recipe it's a great though

you can always switch things

up no problem here's a classic

cheesecake recipe

can is a lemon cheesecake as

well sure I can adjust the recipe to

make a lemon cheesecake since we're

already making a we also need it to be

no bake thanks let me know if you want

help with

anything so I can totally help you out

with a nobaked cheesecake recipe since

we already have a good base for a lemon

cheesecake let's adapt that you'll need

first so it can show you how good it is

when you just interrupt it and divert

the conversation and I just think it's

really well thought out and it's not

like a gimmicky feature I feel like I've

used Gemini live more than I had used

Google assistant in the past two weeks

and I did in about a year there are

things that Gemini live can't do one of

these is work without internet

connection so Gemini live runs in the

cloud completely so there's nothing that

can be done on device which is a bit

disappointing but of course to get any

of those answers it needs to access the

cloud the other things that Gemini live

has no control over on your phone is it

has no access to calendar email

messages and doesn't really know

anything about you like it knows some

general information like your location

and anything you tell it inside of the

conversation but it doesn't know any

personal information this also means you

can't ask Gemini live to send a text

message make a call send an email it

can't do any of those things if you need

help with that you would just need to

use Gemini regular and come out of the

Gemini live UI there are a couple of

other cool things inside Gemini live

though that you can do and if you ask it

to translate a sentence it will

translate that sentence immediately

really quickly you can also ask Gemini

live to give you the answer to the

question that you're asking in a

different language so if you were to say

to it can you tell me where the closest

McDonald's is but give me the answer in

French it will give you the answer in

French you can also go back into Gemini

and read all the answers and questions

that you've had with Gemini live and you

can go back into Old conversations from

that recent Tab and you can continue the

chat that you were already having maybe

two or 3 days ago cuz Gemini live

remembers it I do wish though there was

a way you could go straight into Gemini

live without triggering assistant and

then selecting that Gemini live option

you also have to manually end the

conversation you're having with Gemini

live every single time otherwise it will

just keep listening in the background

and even know you can tell it you're

done with that conversation it kind of

just like hangs around there waiting

like someone who doesn't want to hang up

the call First another part of Gemini

live and showing how intelligent it is

is being able to ask it for gift ideas

so I will ask it for a gift idea for a

friend and it will ask questions back to

get an idea of what gift it should

suggest so again it's really simple can

you give me a gift idea for my friend

for their birthday

sure what kind of gift are you looking

for is there a price range you're trying

to stick to I'd like to keep it under

$50 a personalized touch can go a long

way even on a budget maybe a custommade

card where you write a heartfelt message

or if your friend likes to laugh you can

get a funny mug with a joke or pop

culture reference on it cooking and

sports as well as driving a

car in that case maybe consider getting

them a cookbook focused on their

favorite Cuisine or type of food there

are tons of options for different skill

levels interest can you give me another

suggestion based on their

Hobbies sure here's another idea you

could get them a gift certificate for a

cooking class or a sports themed

experience like hitting the batting

cages or going to see a game together

experiences can be a fun way to make

let's go with a sport experience can you

find me a place that does

that all right to find the best place

for a Sports Experience I'll need to

know what sport your friend is into

they're into American

football all right so you mentioned

American football are you looking for

something more like an experience day

where they can try things like American

football skills challenges or would they

prefer tickets to an actual game there

you go so you can see again it doesn't

just say oh okay here is an activity it

wants to know more about the person and

wants to know more about that certain

activity so it can just give you an idea

and give you a suggestion that's

accurate it's really impressive overall

I think Gemini live is really impressive

like I don't think I've ever used a new

feature on a device more than I have

used Gemini live in the last couple of

days my hope next is that this comes to

Google Nest devices because that would

make having a smart home an actual smart

home it would be really cool we'll see

Gemini live handsfree on the pixelbuds

Pro 2 that released in September as well

where you're actually a able to have

that conversation without having to

trigger Gemini and then go into Gemini

live but let me know what you think of

Gemini live remember if you don't get a

new pixel 9 which comes with 12 months

free Gemini Advanced you will actually

have to subscribe to Gemini Advan to use

Gemini live but let me know in the

comments what you think of this I think

it's really cool I kind of love it

before you head off make sure you

subscribe to the channel as well and if

you do that then I will see you later

[Music]