Microsoft's New AI AGENT Computer SURPRISES Everyone! - New AI CO-Pilot PC

TheAIGRID
20 May 202422:32

Summary

TLDRMicrosoft has unveiled its groundbreaking Co-Pilot AI features set to revolutionize computer interaction. The highlight is 'Javis', an AI system akin to Iron Man's, offering real-time gaming assistance. Additionally, 'Recoil' introduces an unprecedented search capability, acting as a PC's unlimited memory. 'Co-Creator' leverages AI to enhance creative tasks, while the new Surface Pro integrates these features with an NPU for efficient AI processing. Live captions and translations are also introduced, breaking language barriers for global communication.

Takeaways

  • 🚀 Microsoft showcased a new product called 'Co-Pilot', which is an AI system that could revolutionize computer usage.
  • 🎮 Co-Pilot Plus Games is a feature that acts like J.A.R.V.I.S. from Iron Man, providing real-time feedback to assist users, even in activities like playing Minecraft.
  • 👀 The demo included a scenario where Co-Pilot helps a user craft a sword in Minecraft, including advice on handling in-game threats like zombies.
  • 👴 The technology could be particularly useful for teaching children or assisting the elderly with technology and tasks.
  • 🔍 'Recall' is a feature that uses AI to help users find anything they've seen or done on their PC, leveraging the power of the MPU for fast, private searches.
  • 💡 'Recall' can understand semantic associations, such as recognizing 'peacock' as a blue hue, to help find items like a blue dress discussed in a Discord chat.
  • 🎨 'Co-Creator' is a feature that allows users to generate images based on text prompts and their own ink strokes, with AI enhancing the original drawing.
  • 🖌️ The 'Co-Creator' feature includes a creativity slider, enabling users to balance between their original drawing and AI modifications.
  • 💻 The new Surface Pro is equipped with an NPU (Neural Processing Unit) that works alongside AI models in the cloud for enhanced performance and efficiency.
  • 🌐 Live captions and translations are now possible in real-time on any audio passing through the PC, thanks to the NPU, breaking language barriers for global communication.

Q & A

  • What is the main focus of the video script?

    -The video script focuses on Microsoft's new product demonstrations, particularly the co-pilot AI systems that are designed to change how we use computers.

  • What is the concept of 'co-pilot plus games' or 'co-pilot plus computer'?

    -The 'co-pilot plus games' or 'co-pilot plus computer' concept is a virtual assistant system similar to Javis from Iron Man, which is integrated with various applications and provides real-time feedback and assistance.

  • How does the co-pilot system assist a user in a game like Minecraft?

    -The co-pilot system assists by providing real-time guidance, such as helping a user find materials to craft a sword and advising on how to escape from a zombie attack in the game.

  • What is the potential use case for co-pilot AI for elderly users?

    -The co-pilot AI can help elderly users learn how to play games or navigate technology, such as filling out forms, by providing interactive guidance and assistance.

  • What is the 'recall' feature and how does it work?

    -The 'recall' feature is a capability developed by Microsoft that allows users to find anything they have ever seen or done on their PC by leveraging the power of the AI to maintain content on the device for fast access and privacy.

  • How does 'recall' differ from traditional search functions?

    -Unlike traditional search functions, 'recall' uses natural language processing to understand and find items based on descriptions and context, even if the exact words are not used in the search query.

  • What is the 'co-creator' feature and how does it enhance creativity?

    -The 'co-creator' feature is an AI-powered tool that allows users to generate images based on text prompts and their own ink strokes. It uses machine learning models to refine and enhance the user's original drawing, providing a co-creative experience.

  • What is the significance of the 'Surface Pro' device mentioned in the script?

    -The new Surface Pro device is highlighted as the fastest and most intelligent Surface Pro ever, featuring an npu (neural processing unit) that works with AI models in the cloud to deliver enhanced performance and efficiency for AI tasks.

  • How does the 'live captions' feature work and what is its benefit?

    -The 'live captions' feature turns any audio that passes through the PC into real-time captions on the screen, making content more accessible. It also offers live translations, breaking down language barriers for global communication.

  • What is the role of the npu in the new Microsoft device?

    -The npu in the new Microsoft device is designed to handle specific AI tasks directly on the device, such as image processing, voice recognition, and local data indexing, providing low latency operations and freeing up CPU and GPU resources for other tasks.

Outlines

00:00

🎮 Microsoft Co-Pilot: AI Assistant for Gaming and More

The script introduces Microsoft's Co-Pilot, an AI system that revolutionizes computer use, particularly in gaming. It demonstrates Co-Pilot's capabilities through a Minecraft gameplay scenario where a player receives real-time assistance in crafting a sword and evading a zombie attack. The AI's intuitive interaction with the game and the player is highlighted, suggesting a future where AI can assist with various tasks, from gaming to helping the elderly navigate technology.

05:01

🔍 Introducing Recall: Unlimited Memory for Your PC

This section presents 'Recall,' a new feature that uses AI to help users find anything they've seen or done on their PC, leveraging the power of the mpu to maintain speed and privacy. The product leader, Carolina Hernandez, showcases Recall's ability to search for specific items, like a blue dress, and to retrieve information from Discord chats. The feature's semantic association capabilities and its potential to streamline work processes by saving time on searching for documents and content are emphasized.

10:02

🎨 Co-Creator: AI-Powered Art Creation Tool

The script discusses 'Co-Creator,' an AI-powered tool that enhances users' creative tasks by generating images based on text prompts and ink strokes. It allows users to guide the AI's level of creativity through a slider, blending the original drawing with AI enhancements. The tool's potential to democratize art creation and improve productivity by bridging skill gaps is highlighted, showing how it can transform basic strokes into detailed artwork.

15:02

💻 Surface Pro with AI: The Fastest and Most Intelligent Yet

The script introduces a new Surface Pro device, claimed to be the fastest and most intelligent ever, featuring an npu that works alongside AI models in the cloud for enhanced performance and efficiency. The npu handles AI tasks like image processing, voice recognition, and local data indexing with low latency. The device's ability to offload complex tasks to the cloud while keeping CPU and GPU resources free for other tasks is demonstrated through the 'Magic Mask' feature, which allows for complex color corrections without slowing down the PC.

20:28

🌐 Live Captions: Real-Time Translations for a Global Community

The final paragraph showcases 'Live Captions,' a feature that provides real-time translations for any audio on a PC, making content more accessible. The feature's ability to switch between languages instantaneously is demonstrated with a video call in Spanish, Mandarin, and Russian. The script suggests that this feature will break down international barriers and enable more meaningful global connections, hinting at future improvements including real-time voice translations.

Mindmap

Keywords

💡Co-Pilot

Co-Pilot, in the context of the video, refers to a suite of AI-powered tools and features designed to assist users in various tasks, much like a co-pilot assists a pilot during a flight. It is central to the video's theme as it showcases how these tools can transform computer usage, making tasks more intuitive and efficient. For instance, 'Co-Pilot helping someone who is playing a game' and 'Co-Pilot plus games or Co-Pilot plus computer' illustrate the concept of AI assistance in gaming and computing.

💡AI System

An AI system, or artificial intelligence system, is a computational or software-based entity that can perform tasks that typically require human intelligence. In the video, the AI system is likened to 'Javis' from Iron Man, which is capable of connecting to various applications and providing real-time assistance. This concept is integral to the video's narrative, demonstrating the potential of AI to enhance user experience in gaming and computing.

💡Minecraft

Minecraft is a popular sandbox video game that allows players to build and explore virtual worlds made of blocks. The video script uses Minecraft as an example to illustrate how the Co-Pilot AI system can assist a player in real-time, offering guidance on crafting items like a sword. This example demonstrates the practical application of AI in gaming scenarios.

💡Crafting Table

A crafting table is a type of block in Minecraft that players use to combine materials to create new items. In the script, the Co-Pilot AI system recognizes the presence of a crafting table and uses it as a starting point to guide the player in crafting a sword, showing how AI can enhance gameplay by providing useful and context-aware advice.

💡NPU (Neural Processing Unit)

An NPU, or Neural Processing Unit, is a type of processor designed specifically to accelerate machine learning tasks. In the video, the NPU is highlighted as a key component that enables real-time AI operations on the device, such as image processing and voice recognition, without burdening the CPU or GPU. This is a significant aspect of the video's message about the future of AI-integrated devices.

💡Recall

In the video, 'Recall' refers to a feature that leverages the power of the NPU to help users find anything they have ever seen or done on their PC. It maintains privacy by keeping content on the device and offers a fast search experience. The script provides examples of how Recall can assist in finding a specific dress from a Discord chat or a PowerPoint deck, illustrating its utility in enhancing productivity and memory recall on a computer.

💡Semantic Association

Semantic association refers to the process of understanding and making connections between related concepts or words. In the context of the video, Recall's ability to understand that 'peacock' is part of the blue color family and use this association to find a dress exemplifies semantic association. This feature allows Recall to provide more intuitive and context-aware search results.

💡Co-Creator

Co-Creator is a feature introduced in the video that allows users to generate images based on text prompts and their own ink strokes. It uses diffusion-based algorithms and machine learning models running locally to create high-quality output in minimal steps. The script demonstrates how Co-Creator can enhance creative tasks by responding to every stroke and allowing users to balance between their original drawing and AI-generated creativity.

💡Live Captions

Live Captions is a feature that transcribes audio in real-time into text on the screen. In the video, it is shown to automatically and instantly translate audio from over 40 languages into English, making content more accessible. The script highlights its potential to break down international barriers and improve communication, especially in the context of video calling and global teamwork.

💡Surface Pro

Surface Pro is a line of Microsoft devices known for their versatility as both a tablet and a laptop. The video script introduces a new version of the Surface Pro, claiming it to be the 'fastest most intelligent Surface Pro ever.' This device is significant as it integrates the NPU for AI tasks, demonstrating Microsoft's commitment to incorporating AI capabilities into their hardware to enhance user experience and productivity.

Highlights

Microsoft has demoed a new product, a co-pilot AI that is set to revolutionize computer usage.

The co-pilot AI is compared to J.A.R.V.I.S. from Iron Man, offering real-time feedback and assistance in applications such as gaming.

In a demo, co-pilot assists a user playing Minecraft, providing crafting tips and helping to evade in-game threats like zombies.

Co-pilot has potential applications beyond gaming, such as aiding children or the elderly in learning to use technology.

The AI's capabilities extend to assisting with computer tasks, suggesting a broad range of use cases beyond traditional AI chat interfaces.

Recoil is a new feature with seemingly unlimited memory, allowing users to find anything they have ever seen or done on their PC.

Product leader Karolina Hernandez introduces Recall, which leverages the CPU to keep content on the device for fast, private experiences.

Recall helps users find specific items, such as a blue dress, by searching through various online platforms and chat histories.

Recall's semantic association capabilities allow it to understand related terms and find items even when the exact phrase isn't used in the search.

Co-creator is a feature that uses AI to enhance creative tasks, allowing users to generate images based on text prompts and their own drawings.

Co-creator's machine learning models run locally to optimize output quality and responsiveness, creating a truly co-creative experience.

The AI in co-creator can be adjusted via a creativity slider, giving users control over how much the AI modifies their original work.

The new Surface Pro is claimed to be the fastest and most intelligent yet, with an NPU that handles specific AI tasks for enhanced performance.

Live captions is a new feature that provides real-time translations, breaking down language barriers and making content more accessible.

The live captions feature works across all apps and can translate from over 40 languages into English, with more languages to be added.

The seamless integration between the NPU and the cloud allows for efficient AI tasks, reducing the load on the CPU and GPU.

The Magic Mask feature allows for complex color corrections to be made quickly and simply with AI, enhancing productivity in video editing.

These innovations are expected to greatly increase productivity and change the way people interact with technology, bringing AI capabilities to a wider audience.

Transcripts

play00:00

so Microsoft literally just demoed one

play00:02

of their amazing new products their

play00:04

co-pilot aips that are literally going

play00:07

to change how we use computers and if

play00:09

you don't believe me please watch the

play00:10

video Until the End before you make a

play00:12

comment because what I saw is truly

play00:14

stunning so let's take a look at the

play00:15

trailer and then I'm going to show you

play00:17

guys some of the unique features that

play00:18

this really does offer

play00:33

[Music]

play00:51

[Music]

play01:01

n

play01:07

[Music]

play01:33

[Music]

play01:44

so that was a really quick overview of

play01:46

some of the things that are going to be

play01:47

coming but this video is going to show

play01:49

you guys a few of those things in a lot

play01:51

more detail so one of the things and

play01:53

this is where I say I truly do believe

play01:55

that things are about to change is the

play01:57

co-pilot plus games or co-pilot plus

play01:59

computer so this is truly science

play02:02

fiction because this is essentially

play02:04

Javis so if you don't know what Javis is

play02:06

basically in Iron Man there was an AI

play02:08

system that was connected to pretty much

play02:10

every application and it was able to see

play02:12

things and be able to be your virtual

play02:15

assistant that was really really good so

play02:17

basically what we're about to see here

play02:18

is a demo of co-pilot helping someone

play02:21

who is playing a game they're playing

play02:23

Minecraft and they're literally able to

play02:25

in real time get feedback on what they

play02:28

should be doing I think it is really

play02:29

really futuristic but take a look at the

play02:31

demo cuz it's pretty crazy hey co-pilot

play02:33

how's it going hey I'm doing great and

play02:35

it looks like you're about to dive into

play02:36

some Minecraft ready to build explore

play02:38

and maybe dodge a few moms yeah I'm

play02:41

trying to figure out how to make a sword

play02:42

my son plays this game all the time and

play02:44

I have no idea what I'm doing no worries

play02:47

I'm here to help you impress your son I

play02:49

see you've got a crafting table in front

play02:50

of you which is a great start to craft a

play02:52

sword you'll need some materials can you

play02:54

open your inventory just press e on your

play02:57

keyboard yeah uh do I have what I need

play03:00

let's see you've got some sticks perfect

play03:02

for the swords handle but it looks like

play03:04

you're missing the material for the

play03:06

blade you can use wood Stone iron gold

play03:09

or Diamond let's start by gathering some

play03:11

wood or stone shall we head out and find

play03:14

some resources yeah that sounds great oh

play03:16

my God what's that oh no it's a zombie

play03:19

run you need to get away from it fast

play03:21

either Sprint away or quickly build a

play03:22

tower of blocks straight up to get out

play03:24

of its reach if you can find a shelter

play03:26

or dig into the side of a hill do it now

play03:29

just make sure it can't reach you all

play03:31

right I think I might be safe now that

play03:33

was a close one great job finding

play03:35

shelter yeah do I have what I need let's

play03:38

see you've got some sticks perfect for

play03:40

the swords handle but it looks like

play03:42

you're missing the material for the

play03:43

blade you can use wood Stone iron gold

play03:47

or Diamond let's start by gathering some

play03:49

wood or stone shall we head out and find

play03:52

some resources yeah that sounds great oh

play03:54

my God what's that oh no it's a zombie

play03:56

run you need to get away from it fast

play03:58

either Sprint away or quickly build a

play04:00

tower of blocks straight so yeah I think

play04:03

this demo is what surprised me most

play04:05

because surprisingly no one's built this

play04:07

just yet and I think this is a product

play04:09

that we could all use I mean you know I

play04:11

don't think I need help in certain video

play04:13

games but I think with regards to

play04:15

certain computer tasks it actually might

play04:17

be pretty useful so for those of you who

play04:20

are pretty tech-savvy you might think

play04:22

okay why would I ever even use this what

play04:24

is the point of this but think about it

play04:25

like this for example you've got a kid

play04:27

who wants to learn how to play a game or

play04:29

you've got someone elderly who's trying

play04:31

to get to grips with a certain maybe a

play04:33

game a certain piece of technology a

play04:35

form that they're trying to fill out

play04:37

this kind of you know I guess you could

play04:39

say application has a lot more use cases

play04:42

than the standard generative AI chat

play04:43

interface so imagine an elderly person

play04:46

trying to correctly fill out a form and

play04:48

you know you can talk back and forward

play04:50

with your system asking it which you

play04:52

know things I should click on and in

play04:54

some cases in the future what will

play04:56

happen and this is what my prediction is

play04:58

for the future of things and there's

play04:59

going to be some more cool Demos in a

play05:00

moment but the AI is going to be able to

play05:03

do some of those moves for you so you're

play05:05

going to be able to be like okay uh I

play05:06

need a paragraph on this and it's going

play05:08

to be able to write that you're going to

play05:09

be able to talk with it so I think this

play05:11

just shows us a small glimpse into the

play05:13

future of what's to come now there was

play05:15

also something really really cool that I

play05:18

think has a lot of different

play05:19

applications whilst yes I think this

play05:21

Javis feature is so cool for video games

play05:24

and just a million different things like

play05:26

for example I mean you know you could

play05:27

literally be like editing a project and

play05:29

you know you could play back the video

play05:31

see how well it is you could be you know

play05:32

designing a poster I mean there's just a

play05:35

million different things you could do

play05:36

but I think this new feature here this

play05:38

is called recoil and its ability to have

play05:40

basically unlimited memory so I want you

play05:42

guys to look at this cuz this is pretty

play05:43

pretty crazy and this entire video is

play05:46

going to show you guys pretty much the

play05:47

first time that I think we're going to

play05:49

get that huge technological innovation

play05:51

that truly changes the way we use

play05:52

computers to show you recall I'd like to

play05:55

welcome our product leader on Windows

play05:56

who built this incredible new capability

play05:58

karolina Hernandez this welcome

play06:01

[Applause]

play06:05

Carolina thanks Carolina give us a

play06:08

overview of recall please yeah

play06:09

absolutely I would love to uh my team

play06:11

developed recall to help you find

play06:13

anything you have ever seen or done on

play06:15

your PC we Leverage The Power of the mpu

play06:17

to ensure content stays on your device

play06:19

which makes the experience fast and

play06:21

maintains your privacy okay let me show

play06:24

you a few ways that recall helps me like

play06:26

all of you I am constantly jumping

play06:28

between different task throughout my day

play06:30

managing my time between a career I am

play06:33

passionate about staying connected with

play06:34

my family and friends around the world

play06:37

and the hobbies that I love Reco helps

play06:39

me get through all these tasks more

play06:41

quickly my family and I have been

play06:43

searching for the perfect dress for my

play06:45

grandmother who lives in Colombia to

play06:47

wear at my cousin's wedding I've been

play06:48

browsing Pinterest in shopping websites

play06:51

for some options that I can share with

play06:52

her after looking for options for a few

play06:55

weeks I wanted to go back and see some

play06:56

of the favorite blue dresses I have

play06:58

found but I didn't keep all my browser

play07:01

tops open with recall I can just search

play07:04

for blue dress and it pulls together all

play07:07

the Dres I have seen now Grandma decided

play07:09

that she wanted to get the awesome pamu

play07:11

that we shared in our Discord chat about

play07:13

3 weeks ago now scrolling through

play07:16

multiple weeks of chat messages to find

play07:18

that specific D would have taken an

play07:21

eternity instead with recall it was easy

play07:24

I refined my search using the script of

play07:26

language blue pan suit with a sequin

play07:28

lace from from Abita and as you can see

play07:31

recall quickly found the Discord chat my

play07:34

family and I were using to discuss the

play07:36

options and here it is the dress that

play07:38

aita liked recall analyzes the snapshot

play07:41

and it gives me options for what I can

play07:43

do next in this case I want to click the

play07:45

link which takes me back to the right

play07:47

web page where I can make the purchase

play07:50

and now Grandma has a gorgeous outfit

play07:52

for the wedding this is a great example

play07:54

Carolina that I think is going to show

play07:55

how recall is so helpful for people but

play07:57

one thing I'm not sure people noticed is

play07:59

you used the word peacock but it wasn't

play08:01

anywhere in what you were searching for

play08:03

how did recall recognize that and what's

play08:05

going on behind the covers yeah

play08:06

absolutely so recall can understand that

play08:08

peacock is in the family of the blue

play08:10

hues so it creates that semantic

play08:13

Association that is used to help me find

play08:16

the dress recall is also essential for

play08:18

me at work like many of you my team and

play08:21

I spend a ton of time collaborating on

play08:23

presentations and documents for example

play08:25

over the past few weeks we have been

play08:27

collaborating on a presentation for a

play08:28

product the deck was created by my

play08:31

partners in the marketing team and when

play08:33

I finally got around to add my content I

play08:35

could not figure out where to look for

play08:37

the deck I tried to remember was a deck

play08:39

shared in the call maybe I had seen it

play08:42

in an email or maybe I could go and find

play08:45

it in my recent files in PowerPoint I

play08:47

don't really have time to spend clicking

play08:49

around but with recall I no longer have

play08:51

to go on a searching Expedition I

play08:54

remembered in the outline we had added a

play08:56

purple chart with writing a purple WR a

play08:59

chart with purple writing uh and to find

play09:01

the PowerPoint all I had to do was

play09:03

simply use my voice to search for that

play09:06

clue that I remember in in a few seconds

play09:08

Reco found the deck for me and notice

play09:11

that it took me to the exact slide that

play09:14

I remember saving me even more time now

play09:17

to put the finishing touches I wanted to

play09:19

add the final marketing line but

play09:20

couldn't remember the exact words I did

play09:23

remember that Nikki shared it in the

play09:24

planning meeting on teams last Tuesday

play09:27

with timeline and recall I was able to

play09:28

scroll back in time and find the

play09:31

snapshot of that meeting I was then able

play09:33

to quickly copy that um quote and add it

play09:36

to the deck and then once again recall

play09:39

made it easier for me to find the

play09:40

information just using the clues that I

play09:43

remember now these are just two of the

play09:45

examples of how I use recall on a daily

play09:47

basis so I thought that was rather

play09:50

impressive because once again this opens

play09:52

up a huge huge amount of opportunities

play09:55

because with recall it's basically like

play09:57

having unlimited memory for your

play09:59

computer I'm sure we literally all do a

play10:01

million different things on our computer

play10:03

and sometimes we often do forget things

play10:06

and what this allows us to do is this

play10:08

literally allows us to recall anything

play10:10

we've ever done on our computers and I

play10:12

think I think that what we have here is

play10:14

something that's truly truly impressive

play10:16

and pretty gamechanging because you can

play10:18

imagine a scenario where you know you

play10:20

need to find an important email you need

play10:23

to find an important document that

play10:25

you're working on or you need to find

play10:26

you know something like an article that

play10:28

you're viewing and you you really

play10:29

enjoyed it you're literally able to go

play10:31

back view that and immediately get that

play10:34

information and you can see here I think

play10:36

one of the most impressive things about

play10:37

this wasn't the fact that this was some

play10:39

kind of basic search history was the

play10:41

fact that you could literally in natural

play10:43

language describe what you're looking

play10:45

for like a blue pants suit with you know

play10:47

sequin lace from Abita and then you

play10:50

could immediately find what you're

play10:52

talking about so the visual matches and

play10:53

the text matches are really really

play10:55

important and really really key I think

play10:58

this is going to be a really unique

play10:59

feature because it's integrated directly

play11:02

into your PC so it allows you to just

play11:04

literally remember anything that you've

play11:06

done and I think another thing that

play11:08

would be cool in the future is that you

play11:09

know maybe you could say okay what were

play11:12

some of the things I worked on last week

play11:14

recall could be in the future I'm not

play11:16

sure if this is going to be a feature

play11:17

just yet but they could allow it to you

play11:19

know say okay you worked on this you

play11:20

worked on that you know you could have

play11:22

it for you know your timee keeping in

play11:24

terms of how much you use certain apps I

play11:26

mean it's something that is I think

play11:28

opens up like I said whole whole range

play11:30

of different possibilities like you

play11:31

could say based on the work that I've

play11:33

done previously analyze the footage and

play11:34

see where I'm lacking uh you know maybe

play11:37

the AI is like maybe have you tried

play11:39

using this program in your workflow you

play11:41

could be a lot faster I mean there is

play11:42

just a lot that I think is going to come

play11:44

from this that a lot of people don't

play11:45

realize I think this is just the first

play11:47

step and I think with these co-pilot PCS

play11:50

we're going to see a lot more AI

play11:51

integration that is truly going to

play11:53

change the game now there was also

play11:55

another integration that I did want to

play11:57

show you guys cuz this one I think was

play11:58

really really really cool too and this

play12:00

is the co-creator now most of you may

play12:02

have actually seen something similar to

play12:04

this because there do exist some online

play12:06

programs that are quite similar to this

play12:08

but I think that now this is going to be

play12:10

integrated into the Surface Pro natively

play12:12

this is going to change a lot of

play12:14

people's workflows and make them a lot

play12:16

quicker today we're releasing a brand

play12:18

new feature called co-creator that will

play12:20

allow you to explore the full range of

play12:22

your imagination without sacrificing the

play12:25

Integrity or intent of your original

play12:27

drawing let me show you how fun this is

play12:31

so this experience is built on diffusion

play12:33

based algorithms meaning we start with

play12:35

the random image and go through a series

play12:36

of denoising or diffusion as that random

play12:39

image tries to match up with our text

play12:41

prompt in this case I'm going to use

play12:44

mountainous Valley of wild

play12:47

flowers since spring is in full bloom

play12:52

now the magical thing about this

play12:53

experience is that the generated output

play12:56

is not only taking guidance from my text

play12:58

prompt but also my ink

play13:01

Strokes so notice how these

play13:04

two blue blobs have suddenly become a

play13:08

more refined

play13:11

Valley now there are five different

play13:14

machine learning models running locally

play13:16

in tandem to optimize for highest

play13:19

quality output over minimum number of

play13:21

inference steps making the experience

play13:23

feel truly co-creative the generated

play13:25

output responding to every single stroke

play13:31

so this now I actually really love what

play13:33

we have going on here but I can also

play13:35

play with how much I want AI to modify

play13:37

my output so with this creativity slider

play13:40

the farther I slide to the left the more

play13:43

closely resemble my original

play13:45

drawing the farther I slide to the right

play13:48

the more freedom or creativity I allow

play13:50

AI to play with now once I found the

play13:54

perfect balance here I can take this a

play13:56

step further and actually continue

play13:58

iterating on top top of my

play14:00

drawing so I think a monarch butterfly

play14:03

hovering over this far right

play14:07

flower would be the perfect

play14:10

ending and there we go so I think this

play14:13

actually shows us how AI can be used to

play14:16

increase the productivity of us on our

play14:18

creative tasks and whilst yes a lot of

play14:20

people saying that this is replacing

play14:22

people I still think that many AI

play14:23

systems currently lack the I guess you

play14:26

could say adhering to the actual text

play14:29

prompts this is something that I find

play14:31

you know many AI systems struggle with

play14:32

so for those of you who just want to

play14:34

create something and for those of you

play14:35

who aren't you know artistically

play14:36

talented like myself this is going to be

play14:39

something that provides you the ability

play14:40

to create decent art from just basic

play14:43

strokes and I think something like this

play14:45

is important because the overarching

play14:47

trend what we've seen in this industry

play14:49

is that AI is something that Bridges the

play14:51

gap between the different skill classes

play14:53

so this is something that is really

play14:55

really really impressive uh but it's not

play14:57

something I hadn't seen before so

play15:00

co-creator seems to be something that is

play15:02

really impressive and something that we

play15:03

will likely see in the future in terms

play15:05

of how different skill levels are all

play15:08

being B towards the same level and I'm

play15:10

kind of excited for this because I think

play15:12

with this kind of Technology now being

play15:14

put natively into computers this is

play15:17

actually going to bring in another wave

play15:18

of people who previously didn't know

play15:20

about AI Technologies because whilst yes

play15:22

if you are someone that's watching this

play15:24

channel you're likely someone who's

play15:25

pretty much into AI but there are a lot

play15:27

of people who just go about their day

play15:29

today lives and really don't see the

play15:30

impact of AI that it's going to have in

play15:32

their lives whether it be generative

play15:33

narrow and it's important to you know

play15:36

kind of bring in that second huge wave

play15:37

of people that are then going to be

play15:39

surprised by what AI can do now here's

play15:41

where we have the other announcement for

play15:43

Microsoft this is their new device it's

play15:46

another new device and this is their

play15:49

Surface Pro which they claim to be the

play15:51

fastest most intelligent Surface Pro

play15:53

ever and this is really really

play15:55

impressive because it has a few things

play15:57

that are going to make this AI on the

play15:59

device a lot faster so essentially they

play16:02

have an npu in co-pilot and they work in

play16:05

conjunction with the AI models running

play16:06

in the cloud to deliver enhanced

play16:08

performance and efficiency so basically

play16:11

how it works and I was actually confused

play16:12

but the npu is designed to handle

play16:14

specific AI tasks directly on the device

play16:17

and this includes real-time operations

play16:19

that benefit from low latency such as

play16:21

image processing voice recognition and

play16:23

local data indexing and you know the

play16:25

things that are going to be processed by

play16:26

the npu are things like recall which

play16:28

allows you to quickly access previously

play16:31

viewed content co-creator which is where

play16:33

you can generate images on device and of

play16:35

course live captions where you can

play16:36

translate audio in real time and of

play16:38

course the more complex AI tasks that

play16:40

require substantial computational power

play16:42

and data can be offloaded to the cloud

play16:44

and this actually leverages Microsoft's

play16:45

AER Cloud infrastructure which hosts D

play16:47

llms like GPT 4 and allows you to do a

play16:50

lot of stuff so essentially what we have

play16:52

here is we have a seamless integration

play16:54

between the npu and the cloud which

play16:57

allows for pretty efficient work which

play16:59

is pretty different to what we have now

play17:01

and I think this magic mask feature on

play17:03

my laptop so I can select and make color

play17:06

complex make complex color corrections

play17:08

to any object in a single frame and

play17:11

render that across the whole clip so

play17:13

it's easy as this I'll select the key

play17:16

frame and with just a single swipe I'm

play17:19

able to detect and mass that jellyfish

play17:21

there and if I play this forward magic

play17:24

mask is going to attract the jellyfish

play17:26

through the whole clip so let's

play17:29

now I'm not a professional filmmaker

play17:31

myself of course but I've been playing

play17:33

around with this magic mask feature on

play17:34

my laptop so I can select and make color

play17:38

complex make complex color corrections

play17:40

to any object in a single frame and

play17:42

render that across the whole clip so

play17:44

it's easy as this I'll select a key

play17:47

frame and with just a single swipe I'm

play17:51

able to detect and mass that jelly fish

play17:53

there and if I play this forward magic

play17:56

mask is going to attract the jellyfish

play17:57

through the whole clip

play17:59

so let's take a look at the test manager

play18:01

here you'll notice the mpu is enabled

play18:04

magic mask is offloaded and my CPU yep

play18:08

my CPU and GPU resources are almost

play18:11

completely available for me to work on

play18:13

any other task without slowing down my

play18:17

PC and this is running really fast I'm

play18:21

really impressed with this um let's wait

play18:23

and see as it finishes and so what I'm

play18:26

going to do with this is I'm going to

play18:27

make a quick color Ed it um we're going

play18:30

to change the color of this jellyfish

play18:32

and really see what we're able to do

play18:34

here with the power of this mpu and hit

play18:39

play and there it is complex editing

play18:43

made quick and simple with

play18:46

[Applause]

play18:50

AI we're so excited about the potential

play18:52

of copilot plus PCS to give time back to

play18:54

all creators so they can focus on what

play18:57

they do best thank

play19:03

you thanks oen it's amazing to see that

play19:06

level of performance from our App

play19:08

Partners across the CPU and the

play19:11

mpu another new experience that's

play19:13

powered by the mpu and available across

play19:15

all co-pilot plus species is live

play19:18

captions now with live

play19:20

translations imagine if we could talk to

play19:23

our family our friends and our

play19:24

colleagues or enjoy content from across

play19:27

the world in any language with this new

play19:30

feature live live captions will turn any

play19:33

audio that passes through your PC into a

play19:35

single consistent captions experience in

play19:38

real time on your screen it's incredible

play19:41

and makes content more accessible to

play19:43

more people video calling has become

play19:46

such a huge part of our Lives both at

play19:49

home and at work let's watch how live

play19:52

captions can help Global teams

play19:54

communicate more naturally

play20:27

har

play20:46

[Applause]

play20:50

for as you saw the captions just

play20:53

switched automatically and instantly

play20:55

across three different languages Spanish

play20:57

Mandarin and Russian this was never

play20:59

possible before and since it's a Windows

play21:02

feature it's available across all your

play21:04

apps consistently any video calling app

play21:07

any Entertainment app translated locally

play21:09

on the npu it translates from over 40

play21:12

languages into English today and we'll

play21:14

be adding more output languages over

play21:16

time with the impressive translate as

play21:18

they talk feature I think this is going

play21:20

to be something that is revolutionary

play21:22

for the ability to break down barriers

play21:25

internationally and to open up a vast

play21:27

ecosystem of different creat being able

play21:29

to connect with each other in a way that

play21:31

is a lot more meaningful now I think

play21:33

this is going to be something that is of

play21:35

course improved in the future with

play21:36

possibly even you know actual realtime

play21:38

voice translations as well like with

play21:40

audio but for now I think the live

play21:42

captions feature is something that is

play21:43

really really effective and something

play21:45

that I would love to see on my device

play21:47

and I think also this short demo here

play21:51

was very very effective because it

play21:52

showcased exactly what we could do when

play21:55

we have different parts of the computer

play21:57

that are special list for different

play21:59

tasks and this is going to allow a huge

play22:02

huge huge increase in terms of

play22:03

productivity because I mean being able

play22:05

to literally you know do a very very

play22:08

intensive AI related task on your

play22:09

computer without burdening the CPU or

play22:12

GPU is is really really impressive and

play22:15

it makes me actually want to get one of

play22:17

these and I guess that now when we're

play22:19

moving to different you know

play22:20

architectures in terms of Hardware I

play22:23

think that this is going to truly truly

play22:25

change the game and people are going to

play22:26

really start to realize the value for a

play22:29

I okay come on come on

Rate This

5.0 / 5 (0 votes)

Related Tags
Microsoft AICo-PilotRecoilLive CaptionsAI GamingProductivity ToolsTech InnovationUser ExperienceReal-time TranslationCreative AI