WWDC 2024 Recap: Is Apple Intelligence Legit?

Marques Brownlee
11 Jun 202418:23

Summary

TLDRApple's WWDC 2024 showcased a plethora of updates across its ecosystem, with a spotlight on 'Apple Intelligence,' a suite of AI-driven features. Key highlights include the introduction of Vision OS 2.0, iOS 18's customizable home screen, Mac OS 'Sequoia' with iPhone mirroring, and iPad OS 18's new calculator app with handwriting recognition. The keynote emphasized on-device AI capabilities, with privacy as a core focus, and a selective integration with OpenAI's chat GPT for complex tasks.

Takeaways

  • 🎉 Apple's WWDC 2024 keynote introduced significant updates across all of its operating systems, with a notable focus on AI integration.
  • 🕶️ Vision OS 2.0 was unveiled with new features like wrist turn gestures, immersive media enhancements, and improved Mac mirroring resolution.
  • 📱 iOS 18 brought major customization options to the home screen, including the ability to freely place icons and a new theme engine for icon and widget color coordination.
  • 📲 New control center customization and features like hidden apps and scheduled text messages were introduced for iOS and iPadOS.
  • 🎮 AirPods received updates such as voice isolation during calls, spatial audio for games, and head gesture controls.
  • 📺 Apple TV gained a feature displaying actors and character names in real-time, along with a voice boost feature to hear dialogue over music.
  • 🏋️‍♂️ watchOS introduced a training mode for evaluating workout intensity and balance.
  • 📘 iPadOS 18 featured a new calculator app with handwriting recognition and the ability to solve equations and graph variables directly on the iPad.
  • 🌲 Mac OS Sequoia added features like automatic window snapping, built-in backgrounds for webcam feeds, and an improved password manager.
  • 🧠 The introduction of 'Apple intelligence' rebranded AI features, focusing on generative models and large language models for on-device functionality.
  • 🔒 A strong emphasis on privacy with AI features processing primarily on-device, and cloud processing only for complex tasks with user consent.

Q & A

  • What was the focus of Apple's WWDC Keynote in 2024?

    -The focus of Apple's WWDC Keynote in 2024 was on AI, which was introduced in the second half of the presentation, and was branded as 'Apple intelligence'. The first half of the keynote covered various updates across Apple's operating systems without mentioning AI.

  • What is the significance of the wrist turn gesture introduced in watchOS 2.0?

    -The wrist turn gesture in watchOS 2.0 allows users to quickly see the time and their battery percentage, and then immediately jump into the control center, making it more convenient than having to look up at the ceiling as before.

  • What new features were introduced for immersive media in watchOS 2.0?

    -watchOS 2.0 introduced features that use advanced machine learning to turn old photos into spatial photos and provided new tools for creating spatial and immersive videos on cameras other than the iPhone, with the ability to view them only on a Vision Pro.

  • How has the Mac mirroring resolution been improved in watchOS 2.0?

    -The Mac mirroring resolution has been improved in watchOS 2.0 by implementing fixed rendering on the Mac, which frees up resources and allows for up to double the resolution, enabling a larger ultrawide view for more room for windows and activities.

  • What major update did iOS 18 bring to the iPhone's home screen?

    -iOS 18 brought the ability to place icons wherever users want on the home screen grid, a feature that was met with applause during the keynote, as well as a new theme engine that allows for changing the color of every icon and widget to match the wallpaper.

  • How has the control center been redesigned in iOS 18?

    -The control center in iOS 18 has been redesigned to be fully customizable across multiple pages, with more customizable shortcuts in more places, including the ability to replace the flashlight and camera on the home screen without jailbreaking.

  • What is the new feature in iPadOS 18 that allows for remote control of an iPad?

    -iPadOS 18 introduced a feature in SharePlay that lets users remotely control someone else's iPad when they allow it, which is particularly useful for family tech support.

  • What is the notable new feature in the calculator app for iPadOS 18?

    -The notable new feature in the calculator app for iPadOS 18 is the addition of 'Math Notes', which allows users to write down equations in handwriting that the app recognizes and answers in the user's handwriting, with the ability to adjust equations and see real-time updates of the answer.

  • What is the name of the new version of Mac OS introduced at WWDC 2024?

    -The new version of Mac OS introduced at WWDC 2024 is called Sequoia.

  • What is Apple intelligence and how does it integrate AI into Apple's ecosystem?

    -Apple intelligence is a suite of new generative models and large language models built by Apple that bring new functionality to supported devices. It integrates AI into Apple's ecosystem by offering features like writing tools, cleanup tools in the Photos app, generative emojis, and an image playground, as well as Siri improvements for better context understanding and app integration.

  • How does Apple ensure privacy with the integration of OpenAI's chat GPT into Apple intelligence?

    -Apple ensures privacy by processing almost everything on the device using Apple-built models. If a task is too complex, it may use a server-based model on Apple's private cloud compute, ensuring no data is stored or sent to Apple. When using OpenAI's chat GPT, a prompt asks for user consent each time, and Apple obscures the user's IP address to prevent profiling.

Outlines

00:00

📱 WWDC 2024 Keynote Recap: Apple's AI-Centric Update

The script provides a comprehensive review of Apple's WWDC 2024 keynote, focusing on the significant updates and the introduction of Apple Intelligence. The first half of the keynote was devoid of AI mentions, but the second half revealed a plethora of AI-driven features. The summary details the new features in Vision OS 2.0, including wrist gestures and immersive media capabilities. It also discusses the major UI overhaul in iOS 18, allowing for personalized home screen layouts and a new theme engine for icon and widget color customization. Other highlights include the redesigned control center, new messaging features, and the introduction of a calculator app with handwriting recognition in iPad OS 18.

05:01

🎧 AirPods and Apple TV Updates: Enhancing User Experience

This paragraph covers the minor but notable updates to AirPods, such as voice isolation during calls and spatial audio during games. It also introduces a new feature for Apple TV that allows viewers to identify actors and characters in real-time, along with a feature to boost dialogue clarity over background music. The summary touches on the redesigned Photos app, the addition of game mode to minimize latency, and the automatic categorization in the new Mail app. The paragraph also hints at an upcoming in-depth video focusing on iOS 18's new features.

10:04

🖥️ Mac OS 'Sequoia' and Apple's AI Strategy Unveiled

The script delves into the new features of Mac OS 'Sequoia,' including automatic window snapping and built-in backgrounds for webcam feeds. It also introduces a new password management app and discusses the iPhone mirroring feature that integrates iPhone notifications and audio with Mac. The latter part of the summary focuses on Apple's AI strategy, now branded as 'Apple Intelligence,' highlighting the generative models and large language models developed by Apple. It outlines the AI features supported only on high-end Apple silicon devices and the suite of tools integrated across various apps, such as writing tools, cleanup tools in Photos, and generative emojis.

15:04

🤖 Apple Intelligence: On-Device AI and Privacy Considerations

This paragraph provides insights into Apple's approach to AI, emphasizing on-device processing for speed and privacy. It explains that complex tasks may utilize server-based models or, with user permission, integrate with OpenAI's chat GPT for enhanced capabilities. The summary clarifies that Apple's AI features prioritize on-device processing, with cloud computing used only for more complex tasks. It also addresses privacy concerns, noting that OpenAI cannot store requests and that user IP addresses are obscured. The paragraph concludes with the author's perspective on the significance of AI in Apple's ecosystem and the anticipation of upcoming videos exploring these features in-depth.

Mindmap

Keywords

💡Apple WWDC Keynote

The Apple WWDC Keynote is an annual event where Apple Inc. announces and showcases its new software and technologies. It is a significant occasion for tech enthusiasts and industry professionals. In the script, the keynote is described as 'possibly one of the biggest' due to the anticipation of AI advancements in 2024 and Apple's role in leading these innovations.

💡AI (Artificial Intelligence)

AI refers to the simulation of human intelligence in machines that are programmed to think like humans and mimic their actions. In the context of the video, AI is a central theme as Apple is expected to integrate AI at the forefront of its technological offerings. The script mentions that Apple initially did not mention AI in the first half of the keynote but later revealed its AI initiatives under the term 'Apple intelligence'.

💡Apple Intelligence

Apple Intelligence is a term coined by Apple to describe its suite of AI features and capabilities. It encompasses generative models, large language models, and other AI functionalities that Apple has developed to enhance user experience. The script explains that Apple Intelligence is a collection of new tools and features that are integrated across Apple's ecosystem, emphasizing on-device processing for speed and privacy.

💡Vision OS

Vision OS is the operating system for Apple's Vision Pro device, which is likely a reference to a hypothetical advanced device in the video's narrative. The script discusses the update to Vision OS 2.0, which includes new features such as a wrist turn gesture and immersive media features, indicating the ongoing development and enhancement of Apple's software for its devices.

💡iOS 18

iOS 18 represents the hypothetical next major version of Apple's mobile operating system for iPhones and iPads. The script highlights significant updates to iOS 18, such as the ability to place icons anywhere on the home screen grid and a new theme engine for customization. These updates suggest a shift towards greater personalization and user control over the device interface.

💡Mac OS Sequoia

Mac OS Sequoia is the name given to the new version of Apple's desktop operating system in the script. It includes features like automatic window snapping and a new password app, indicating improvements in usability and security. The script also mentions iPhone mirroring, which allows users to wirelessly view their iPhone on a Mac, showcasing the integration between Apple's devices.

💡watchOS

watchOS is the operating system for Apple Watch devices. In the script, watchOS 2.0 is mentioned with updates such as a new wrist turn gesture and immersive media features. Additionally, the script discusses Mac mirroring enhancements, which improve the resolution for using an Apple Watch with a Mac, demonstrating Apple's commitment to refining its wearable technology.

💡iPadOS 18

iPadOS 18 is the updated version of the operating system for iPad devices. The script notes that it includes full home screen customization and a customizable control center, similar to iOS 18. A standout feature mentioned is the new calculator app with 'math notes,' which allows users to write equations in handwriting and receive answers, showcasing the integration of AI and Apple Pencil functionality.

💡Siri

Siri is Apple's voice-activated virtual assistant. The script discusses improvements to Siri as part of Apple Intelligence, including the use of large language models for better context understanding and natural interactions. Siri will also gain the ability to pull information from and perform actions within apps, highlighting advancements in AI-driven personal assistance.

💡On-device Processing

On-device processing refers to the execution of tasks or operations directly on the user's device, rather than relying on cloud computing. The script emphasizes that Apple prioritizes on-device processing for its AI features to ensure speed and privacy. This approach allows for faster response times and keeps user data secure by minimizing data transmission to external servers.

Highlights

Apple's WWDC Keynote in 2024 focused heavily on AI, branded as 'Apple Intelligence', showcasing a range of new features across their ecosystem.

Vision OS 2.0 introduced with new wrist turn gesture, immersive media features, and higher resolution Mac mirroring.

iOS 18 allows for home screen customization, including rearranging icons and a new theme engine for icon and widget color changes.

Control Center in iOS has been redesigned to be fully customizable with more shortcuts.

AirPods received updates for voice isolation, spatial audio during games, and gesture-based prompts.

Apple TV now offers real-time actor and character information, and music playing during shows with a swipe-down feature.

watchOS includes a new training mode for evaluating workout intensity and balance.

iPadOS 18 brings full home screen customization and a new Photos app, along with SharePlay's remote iPad control feature.

The new iPad calculator app with Apple Pencil support allows handwriting recognition for equations and variables.

macOS Sequoia introduces automatic window snapping, built-in backgrounds for webcam feeds, and a new password app.

iPhone mirroring on macOS allows for wireless integration of iPhone with Mac, including notifications and drag-and-drop functionality.

Apple Intelligence integrates generative models and large language models for new functionalities like writing tools and photo cleanup.

Siri improvements include better context understanding and the ability to perform actions within apps.

Notes and phone call summaries are part of the new features enhancing user experience.

Apple's AI features are primarily on-device for speed, with cloud processing as a secondary option for complex tasks.

Open AI's chat GPT 40 is integrated with user consent for complex queries, ensuring privacy and no data storage.

The keynote suggests a new era for Apple, with AI taking center stage and overshadowing traditional feature updates.

Transcripts

play00:02

[Music]

play00:03

so we just got done with possibly one of

play00:05

the biggest apple WWDC Keynotes of all

play00:09

time maybe just because of the state of

play00:11

the world and what everyone expects from

play00:13

tech companies in 2024 which is AI at

play00:16

the front of what you do interestingly

play00:19

with apple this time Apple had AI at the

play00:22

back half of what they did literally the

play00:24

entire first half of the keynote they

play00:25

didn't say AI once zero times then the

play00:28

second hour they just went all right

play00:30

yeah we we actually do have a lot of AI

play00:32

stuff to share with you and they just

play00:33

spit it all out and of course they did

play00:35

manage to Brand it because of course

play00:38

they did AI for them is now Apple

play00:40

intelligence but look I watched and live

play00:43

tweeted the entire 2hour long keynote so

play00:45

you don't have to and I've gathered all

play00:47

my thoughts and all the most important

play00:48

announcements so this is everything you

play00:50

need to know that's new and some of my

play00:52

takes on it so I'm going to go in the

play00:53

same order that Apple went I'm going to

play00:54

start with vision OS and we're already

play00:56

on somehow Vision OS 2.0 less than half

play01:00

a year after the Vision Pro first got

play01:02

announced and there are some solid new

play01:04

features but I don't know if I would

play01:05

call this 2.0 worthy it feels more like

play01:07

a 1.2 update but okay whatever we'll go

play01:10

with it so there's a new wrist turn

play01:12

gesture to quickly see the time and your

play01:14

battery percentage and then you can jump

play01:15

right from there into the control center

play01:17

instead of having to like look way up at

play01:19

the ceiling like you had to before every

play01:21

time kind of reminds me of the Oculus

play01:22

Quest that is easy that's an upgrade

play01:24

there's a bunch of immersive media

play01:26

features like they let you go through

play01:28

your old photos and use Advanced machine

play01:30

learning to turn them into spatial

play01:33

photos which is really interesting if it

play01:36

works and there are also new tools to

play01:38

help people create spatial videos and

play01:40

immersive videos on cameras other than

play01:42

the iPhone but then of course you can

play01:44

only view them on a Vision Pro so who

play01:47

knows how valuable this will actually

play01:48

turn out to be but then this year Mac

play01:50

mirroring will get way more resolution

play01:53

thanks to it now doing the fiated

play01:55

rendering on the Mac so basically it

play01:57

frees up a ton of resources and it lets

play01:59

you do up to double the resolution so

play02:01

you could do a gigantic ultrawide if you

play02:03

want it to be that is way more room for

play02:05

Windows and activities love that and

play02:08

that's pretty much it again it's not the

play02:10

biggest 2.0 update we've ever seen but

play02:12

it does feel like there's some nice

play02:13

updates in there including some new

play02:16

environments and the ability to

play02:18

rearrange your home screen believe it or

play02:21

not you couldn't do that before now you

play02:23

can but speaking of rearranging your

play02:25

home screen iOS just got one of the

play02:28

biggest or at least most interesting

play02:29

updates in a long time and I'm just

play02:33

going to if you're an Android User I'd

play02:35

say for the next like 2 minutes 3

play02:37

minutes just go ahead and unplug your

play02:39

keyboard for a second and just relax cuz

play02:41

yes we've had these features for a long

play02:43

time but now it's the iPhone's time to

play02:46

shine all right so officially you will

play02:48

finally be able to put icons wherever

play02:50

you want on the iOS 18 home screen grid

play02:54

and it was hilarious that this got a

play02:56

whole Applause moment from the audience

play02:58

during the keynote as if they just inv

play02:59

vented a new feature but fine you've

play03:02

been waiting for a long time for this

play03:04

have your fun but they didn't stop there

play03:06

they added a whole bunch of other

play03:07

customization features to the iPhone

play03:09

home screen 2 and it started to get a

play03:12

little more interesting see there's this

play03:14

new theme engine now that lets you go in

play03:16

and change the color of every icon and

play03:19

widget on your home screen to the same

play03:22

color so you can really you can match

play03:24

your wallpaper with your icons to frame

play03:26

it nicely and have matching colors

play03:28

everywhere it's a simple thing and we've

play03:30

been doing it on Android with launchers

play03:32

for years but the thing about these is

play03:35

before this moment basically every

play03:37

iPhone home screen look the same we've

play03:39

been saying that they've just given you

play03:41

the ability to go crazy and kind of ruin

play03:44

your home screen if you want to and

play03:47

people seem to absolutely want to I have

play03:50

seen some rough home screens people are

play03:52

making on Twitter a lot of them just

play03:54

look terrible and I think the main thing

play03:56

I noticed is it seems like there are

play03:57

apps that support this whole

play04:00

colored thing well and then there are

play04:03

apps that don't that just looks like it

play04:05

tints the entire it just literally

play04:07

applies a color cast to the entire icon

play04:09

on your home screen which causes all

play04:11

kinds of legibility problems doesn't

play04:13

look good there are widgets that look

play04:15

horrible that it's just unreadable so

play04:19

yeah you can make some some pretty

play04:20

looking home screens if you want but you

play04:22

can also make some really ugly looking

play04:24

home screens and I was trying to decide

play04:25

if I like this more or less than what

play04:27

Google did on the pixels with material U

play04:29

I think technically technically it's

play04:31

better because it works on all of the

play04:34

icons I don't know how many setups I've

play04:35

tried where I wanted to the monochrome

play04:37

icons but there are just a few of my

play04:38

apps that aren't supported so they end

play04:40

up looking kind of like they stick out

play04:42

like a sore thumb so at least apple is

play04:43

letting you change all of the icons at

play04:45

once but anyway Apple's also redesigned

play04:47

the control center to be fully

play04:49

customizable across multiple pages so

play04:52

again there's a lot more going on here

play04:54

and there are many more customizable

play04:56

shortcuts in more places including

play04:59

finally replacing the flashlight and

play05:01

camera on the home screen without

play05:02

jailbreaking finally and the list keeps

play05:04

going stop me if you've heard these

play05:06

before but there are you can do hidden

play05:08

apps now inside your app drawer so you

play05:10

can lock apps into a hidden folder that

play05:13

makes it easier than ever to hide Tinder

play05:17

from your wife there's also scheduled

play05:19

text messages an iMessage great finally

play05:23

they're having some fun over there

play05:24

there's also text formatting there's

play05:26

messages via satellite RCS support was

play05:28

very casually but briefly mentioned uh

play05:31

the photos app is redesigned there's

play05:32

also a game mode that now minimizes

play05:34

background activity and minimizes

play05:36

Bluetooth latency for peripherals great

play05:38

and a new automatic categorization in

play05:40

the new mail app so you can tell there's

play05:42

there's been a whole bunch of stuff I

play05:43

will definitely be doing a larger more

play05:45

Focus just iOS 18 video so you can see

play05:48

everything that's new there's plenty of

play05:50

little stuff that didn't make it into

play05:51

the keynote so I'll do a whole Deep dive

play05:54

just for that make sure you subscribe to

play05:56

be among the first to see that I believe

play05:58

we are catching up to Apple and

play06:00

subscribers be kind of nice if we pass

play06:03

them that'd be sick so then airpods got

play06:05

minor updates like voice isolation

play06:07

during phone calls spatial audio during

play06:09

games and the ability to respond to a

play06:12

prompt just by nodding or shaking your

play06:14

head taken right from the Sony

play06:16

headphones I kind of like it though

play06:17

controlling it without using your voice

play06:19

is nice then Apple TV gets this new

play06:21

feature where you swipe down on the

play06:23

remote at any point during a show and it

play06:25

just shows you all the actors and

play06:26

character names of the people on the

play06:27

screen and any song that's playing in

play06:30

that moment in real time and there's

play06:31

also a feature that boosts people's

play06:32

voices so you can always hear them over

play06:34

the music and then watch OS they got

play06:36

this little training mode that sort of

play06:38

balances the trends in your training

play06:39

over time and evaluates how hard a

play06:41

workout was versus how hard it could

play06:43

have been and then iPad OS so this was

play06:46

supposed to be Apple's big chance to

play06:49

really convince us that the iPad is it's

play06:51

something special that's got a little

play06:53

something to it that would make us

play06:55

convinced that we'd want to get the

play06:57

newest one the M4 one that just came out

play06:59

over

play07:00

just your phone or over a Mac and I'll

play07:03

say it did get one incredible

play07:06

feature but it didn't really do much

play07:09

more than that so the iPad it you know

play07:11

gets all the stuff I talked about with

play07:12

the iPhone right full home screen

play07:14

customization customizable control

play07:16

center the new photos app Etc it's all

play07:19

great there's also a feature in share

play07:21

playay that lets you go in and actually

play07:23

remotely control someone's iPad when

play07:26

they allow it which seems like a small

play07:28

thing but I promise you that is massive

play07:30

for family tech support you know who you

play07:32

are but the one massive actually

play07:35

impressive new feature on the iPad in

play07:38

iPad OS 18 and you think I'm joking but

play07:41

I'm dead serious when I say this it's

play07:44

the calculator app it's the new

play07:46

calculator I promise you I was so ready

play07:47

to dunk on this like I had had a tweet

play07:50

like drafted up as they were talking

play07:51

about it we finally brought the

play07:52

calculator the iPad and there were

play07:54

screenshots of it and it looked just

play07:55

like the iPhone app and I was like

play07:57

really this is this is what you were so

play07:58

hyped about had that clip CED up ready

play08:00

of Craig federi being like yes we had to

play08:02

do something super special to finally

play08:04

bring their calculator to the iPad but

play08:07

then then they pulled the apple pencil

play08:09

off the side and they pulled up what's

play08:12

called math notes and it was pretty sick

play08:15

so now on the iPad you can actually

play08:17

write down equations in handwriting and

play08:20

it will understand what you wrote and

play08:22

it'll answer the question in your

play08:25

handwriting and then if you adjust the

play08:27

equation or add new information or

play08:29

something it automatically updates the

play08:31

answer which was so sick I don't know

play08:34

why I'm so impressed with this but it

play08:35

was really cool to play with and look at

play08:37

so if that wasn't impressive enough it

play08:39

also supports variables so you can have

play08:41

variables written all over the page so

play08:43

look at this it has G and X and A and H

play08:47

and then it's a labeled y as the height

play08:50

here so you can ask for an equation

play08:52

using these variables and it can give

play08:54

you an answer and if you want you can do

play08:57

a y equals equation and it'll give you a

play09:00

graph with real time adjustment of any

play09:02

of the variables in your equation I mean

play09:05

I I wish I was in sixth grade again so

play09:08

this could be my full-time calculator

play09:09

this is sick now at this point in the

play09:10

keynote they haven't even actually said

play09:13

the word like AI a single time yet I

play09:16

think this is pretty clearly AI this is

play09:17

like handwriting recognition this is

play09:19

like semantic understanding of all the

play09:21

things happening on the page it's good

play09:23

AI well played Craig you did it okay but

play09:26

this is before the actual AI section but

play09:29

also this wasn't mentioned on stage but

play09:31

this is also coming to the iPhone's

play09:33

calculator app as well but then Mac OS

play09:36

Mac OS has its newest version It's

play09:38

called Sequoia and it does also get a

play09:40

nice little grab bag of new features

play09:42

there's uh automatic window snapping now

play09:45

finally built-in you don't need a third

play09:46

party app to do it anymore sherlocked uh

play09:49

there's built-in backgrounds for any app

play09:51

that uses the webcam feed there's also a

play09:53

new password app that basically just

play09:54

takes what was buried in the settings

play09:56

before and just makes it its own

play09:57

Standalone app so it's actually on Mac

play10:00

iPad and iPhone but probably the biggest

play10:03

thing is iPhone mirroring so this is

play10:06

another continuity feature that

play10:08

basically just lets you wirelessly

play10:10

always see your iPhone on your Mac it

play10:13

merges your notifications and audio with

play10:15

your Macs and lets you drag and drop

play10:18

things back and forth between your phone

play10:19

that's sitting next to you and your Mac

play10:21

I kind of wonder if this hits your phone

play10:22

battery harder than normal they didn't

play10:24

really say Obviously so I'm going to

play10:25

have to test this but I imagine if

play10:26

you're just sitting on a wireless

play10:27

charger then it won't matter but I'll be

play10:29

checking that out but then we arrived

play10:32

they did all the sections with all the

play10:33

other operating systems and now we got

play10:35

to the part where Apple's going to talk

play10:36

about AI stuff kind of now I don't know

play10:40

if you remember this but a couple months

play10:41

ago not that long ago I did an entire

play10:43

video on all of these phrases that it

play10:45

seems like apple refused to say on stage

play10:49

they just would not say them and AI is

play10:52

one of them they just didn't say it

play10:54

they'd say anything else neuron Nets

play10:56

machine learning all sorts of other

play10:58

things like that

play10:59

but the times are the times people want

play11:01

to hear Apple talk about AI so they

play11:03

finally did and they also like I said

play11:06

they they rebranded it just for

play11:08

themselves just to just comedere the AI

play11:11

name and so now it's called Apple

play11:14

intelligence in apple land so here's

play11:16

basically what you need to know about

play11:17

Apple intelligence right so Apple has

play11:19

already had AI features on their devices

play11:22

before they've had the neural engine

play11:24

inside of their chips and they've done

play11:26

things like you know smartly cutting

play11:28

subjects out of photos they've done

play11:29

things like autocomplete on the keyboard

play11:32

that's already existed but this new

play11:34

Apple intelligence is basically a bucket

play11:37

of these new generative models and what

play11:39

they do on your devices so there's these

play11:42

new diffusion models generative models

play11:45

and large language models that are all

play11:47

built by Apple that bring new

play11:49

functionality to the supported devices

play11:52

and actually I'll just get that out the

play11:53

ra right off the bat these are only

play11:55

supported on the highest end versions of

play11:57

currently available Apple silicon so

play12:00

that just means iPhone 15 Pro and any

play12:04

iPad with M1 or later and any Mac with

play12:08

M1 or later so what does that look like

play12:11

well basically starting with these new

play12:12

os's there's a small Suite of tools

play12:16

that's kind of sprinkled across

play12:18

everything it's not like there's one

play12:19

apple intelligence app or something like

play12:21

that they're just kind of sprinkled

play12:22

throughout so here's an example writing

play12:24

tools you know we all know how powerful

play12:26

these large language models can be so

play12:29

anytime you're writing in you know Pages

play12:31

or keynote or basically anywhere where

play12:33

there's a cursor you can use the writing

play12:35

tools to summarize or rewrite something

play12:39

that you've already written it can

play12:40

change the writing style or just

play12:42

proofread just basic useful stuff here's

play12:44

another one remember the Magic Eraser

play12:46

Tool in Google photos and these Android

play12:48

phones that use it Apple's finally doing

play12:50

that too built into their own photos app

play12:52

is a cleanup tool and it's basically the

play12:54

same idea this will identify background

play12:57

items it'll let you Circle items you

play12:58

don't like in your photos and just get

play13:01

rid of them fill in the background with

play13:02

gener to fill super quick and there's

play13:04

also gen emojis generative emojis and

play13:09

this may feel really old cuz I would

play13:11

never use this but apparently there's a

play13:13

whole group of people who go through

play13:14

searching for emojis and then they find

play13:16

that there's one that doesn't exist and

play13:18

they're like dang I wish I could just

play13:20

make an emoji for this moment right now

play13:24

and for those people yeah now now you

play13:26

can you can generate a new Emoji you can

play13:28

literally type it fit in like a prompt

play13:30

and the diffusion model will create that

play13:32

new emoji from scratch in the style of

play13:34

all the other emojis and they had an

play13:36

entire thing called the image playground

play13:39

that's built into a bunch of Apple's

play13:41

apps but also has its own separate app

play13:42

that lets you create these nice little

play13:44

square images with prompts in three

play13:47

different styles sketch illustration and

play13:51

animation and yes there are also Siri

play13:53

improvements that's using the large

play13:54

language models to generally understand

play13:57

context better and just generally be

play14:00

better and more natural at being an

play14:02

assistant that isn't garbage and later

play14:04

in the year it will also be able to pull

play14:06

info from inside of apps and take

play14:08

actions inside of apps for you too I

play14:11

remember when this was like a huge Bixby

play14:13

feature on Samsung phones so that's cool

play14:16

to see plus there's also this like big

play14:18

pretty new full screen animation when

play14:20

you're triggering Siri to tie it all

play14:21

together its vo is apparently slightly

play14:23

updated and you can now also type to

play14:26

Siri instead of talking to it out loud

play14:28

every time which is long overdue but

play14:30

also nice there's Notes app summaries

play14:33

there's phone call summaries just all

play14:35

kinds of you know features sprinkled

play14:37

around like I said definitely I want to

play14:39

I think I'll end up making a video just

play14:40

summarizing or testing or reviewing all

play14:43

of the Apple intelligence stuff cuz it's

play14:46

kind of all over the place but now you

play14:48

know what it is but one question that's

play14:49

been floating around the internet is

play14:51

what stuff is happening on device versus

play14:55

things that have to go to the cloud and

play14:58

this is also come up a lot because you

play14:59

might have also heard about Apple

play15:01

partnering specifically with open AI to

play15:03

integrate chat GPT 40 into this apple

play15:08

intelligence stuff so it's a big

play15:10

question everyone's wondering so I got

play15:11

the official answers from Apple and the

play15:13

answer is basically almost everything

play15:16

happens on device intentionally and

play15:19

those are from Apple built models so

play15:20

that should be the fastest stuff that

play15:22

happens but in the chance that there are

play15:25

things that are too complex or just

play15:28

outside of the area of expertise of

play15:30

Apple's models then it can basically go

play15:32

one of two ways one is it will go to a

play15:35

larger server-based model that's on

play15:37

servers that Apple has built with apple

play15:40

silicon using what they call Private

play15:42

Cloud compute so basically the info is

play15:44

never stored or sent to Apple it's still

play15:47

going to have the downsides of having to

play15:49

go off of the device up to the cloud it

play15:51

might take a bit longer if you're in an

play15:52

area with terrible internet might not

play15:54

work at all but in the chance that this

play15:56

is like a big complex thing that could

play15:58

benefit from those models that's what

play16:00

it'll try to do but the other is when

play16:01

you specifically ask it for something

play16:03

that chat GPT would be good at and if

play16:06

that happens then it will specifically

play16:09

ask you hey is it cool if I ask chat GPT

play16:14

for an answer to this question and then

play16:15

you can give it a yes or no on the spot

play16:18

so anytime it wants to do this whether

play16:20

it's to upload a photo that you're

play16:21

asking something about or just a complex

play16:24

prompt in general then this little

play16:25

dialogue box pops up and you have to say

play16:27

yes every time and then you can tap into

play16:30

everything that open AI model is capable

play16:32

of or generate even more realistic or

play16:35

varied random different styles of images

play16:37

that Apple's diffusion models would

play16:39

never make this is all free without an

play16:41

account um at no point is open aai

play16:43

allowed to ever store any of these

play16:45

requests and Apple has also said that

play16:47

they will obscure your IP address so you

play16:49

can't even open AI can't even connect

play16:52

multiple requests together to form a

play16:54

profile of you there's just a lot of

play16:56

thought that's gone into ideally making

play16:58

this as secure and private of a version

play17:01

of going to the cloud for AI features as

play17:03

they possibly can so yeah it's really

play17:04

interesting a lot of interesting stuff

play17:06

going on here I think my overall take

play17:09

with a lot of this WWDC announcements

play17:11

and with the the Apple intelligence

play17:13

stuff is that first of all is that like

play17:18

the Humane pin and the rabbit R1 they

play17:21

were so doomed from the start like

play17:23

there's no even if they were good up to

play17:25

this point there's just no way they

play17:27

could be as good as

play17:29

this stuff on your phone with all the

play17:31

personalization all the info that they

play17:33

already know about you so I guess that's

play17:35

confirmed but also it's it just kind of

play17:37

it does feel like we've entered a new

play17:39

age with apple I think the AI stuff is

play17:43

so important that it very much is what

play17:45

we're most interested in and it

play17:46

overshadows like honestly what what

play17:48

could possibly be your favorite non- aai

play17:50

feature from the past couple things

play17:53

moving home screen apps and icons

play17:55

everywhere like that might be the

play17:57

biggest thing but it's up to this point

play17:59

now all about what this intelligent

play18:02

stuff can actually do for you and what

play18:04

it can bring you so that's what I'm

play18:05

really excited about I'll be working on

play18:06

some videos very soon about a lot of

play18:08

this stuff so definitely like I said get

play18:09

subscribed if you haven't already but

play18:11

this has been your overview your what

play18:13

you need to know thanks for watching

play18:16

catch you guys in the next one peace

Rate This

5.0 / 5 (0 votes)

Связанные теги
Apple WWDCAI FeaturesiOS 18Vision OSMacOS SequoiaiPadOS 18watchOS UpdateSpatial MediaHome ScreenAI Personalization
Вам нужно краткое изложение на английском?