Apple WWDC 2024 keynote in 18 minutes

The Verge
10 Jun 202417:46

Summary

TLDRApple's WWDC unveils innovative updates across its ecosystem, including visionOS 2 with advanced photo capabilities, iOS 18 offering enhanced customization and privacy features, watchOS 11 with new health insights, iPadOS 18 introducing new app functionalities, and macOS Sequoia with iPhone mirroring and advanced writing tools powered by Apple Intelligence. The event also highlights integration with external AI models like ChatGPT, promising a seamless and intelligent user experience.

Takeaways

  • 🌐 Introduction of visionOS 2 with advanced machine learning to create spatial photos from 2D images.
  • 📲 Enhancements in user interaction with Apple Vision Pro, including hand gestures for navigation.
  • 🖥 Mac Virtual Display improvements, including higher resolution and an ultra-wide display option.
  • 🚆 Expansion of train support in travel mode within visionOS 2.
  • 🎥 New immersive video content and availability on the TV app.
  • 📅 Launch schedule for Apple Vision Pro in eight countries, starting with China, Japan, and Singapore, followed by Australia, Canada, France, Germany, and the UK.
  • 📱 iOS 18 brings more customization options for iPhone, including app icons and widgets that can frame wallpapers.
  • 🔒 New security features in iOS 18, such as the ability to lock and hide apps, and control over app access to contacts.
  • 💬 Innovations in Messages, including tap backs with any emoji or sticker, scheduled messages, and text formatting options.
  • 🌍 Utilization of satellite capabilities on iPhone 14 for off-grid texting via the Messages app.
  • 🗺️ Maps updates with topographic maps, detailed trail networks, and hiking routes for US National Parks.
  • 🎉 Event tickets redesign with new features like an event guide and integration with Apple apps.

Q & A

  • What is the new feature in visionOS 2 that allows users to create spatial photos from 2D images?

    -visionOS 2 introduces a feature that uses advanced machine learning to derive both a left and right eye view from a 2D image, creating a spatial photo with natural depth.

  • How does the new SharePlay feature in the Photos app enhance user experience?

    -The SharePlay feature in the Photos app allows users to experience panoramas, spatial photos, and videos with others, making it easier to share and enjoy these moments with loved ones.

  • What improvements are coming to Mac Virtual Display later this year?

    -Mac Virtual Display will see improvements such as higher display resolution and size, and the ability to expand into an ultra-wide display equivalent to two 4K monitors side by side.

  • Which countries will be getting Apple Vision Pro starting from June 28th and July 12th?

    -Apple Vision Pro will be introduced in China, Japan, and Singapore on June 28th, followed by Australia, Canada, France, Germany, and the United Kingdom on July 12th.

  • What new customization options does iOS 18 offer for app icons and widgets?

    -iOS 18 allows users to arrange apps and widgets to frame their wallpaper perfectly, place them along the bottom or off to the side for easy access, and tint app icons with color in dark mode.

  • How is Control Center being enhanced in iOS 18?

    -Control Center in iOS 18 is enhanced with the ability to swipe to multiple new groups of controls for media playback and home controls. Users can also customize the layout and resize controls through a new controls gallery.

  • What new feature in iOS 18 allows users to protect sensitive apps and information?

    -iOS 18 introduces the ability to lock an app, requiring authentication via Face ID, Touch ID, or passcode to access it, and to hide an app in a new hidden apps folder that's locked.

  • What is the new feature for managing incoming emails in iOS 18?

    -iOS 18 introduces on-device categorization for managing incoming emails, which organizes messages and helps users stay up to date across all accounts, categorizing them into transactions, updates, and promotions.

  • How does the new Maps feature in iOS 18 enhance outdoor activities?

    -The new Maps feature in iOS 18 provides topographic maps with detailed trail networks and hiking routes, including all 63 US National Parks, which can be saved for offline access with turn-by-turn voice guidance.

  • What is the new Tap to Cash feature in iOS 18, and how does it work?

    -Tap to Cash is a quick and private way to exchange Apple Cash without sharing phone numbers or email addresses. Users can pay someone back by simply holding their phones together.

  • How has the Photos app been redesigned in iOS 18?

    -The Photos app in iOS 18 has been unified into a single view with a photo grid at the top and library organized by theme below. It includes a filter button for specific content types and a carousel for highlighting favorite and featured photos.

  • What new interaction capabilities are being introduced for AirPods in the script?

    -New interaction capabilities for AirPods include the ability to nod your head for 'yes' or shake your head for 'no' to interact with Siri, and voice isolation to ensure clear voice sound in any environment.

  • What is the InSight feature for watching TV, and what does it offer?

    -InSight is a new feature that enhances the TV watching experience by showing actors and their character names in real time when watching an Apple original show or movie. It also allows users to quickly see and add the song playing to an Apple Music playlist.

  • What new health tracking features are introduced in watchOS 11?

    -watchOS 11 introduces training load to measure the impact of workout intensity and duration over time, and a new Vitals app that tracks key vitals like heart rate, respiratory rate, and rest temperature while sleeping, providing deeper insights into daily health status.

  • How does the Smart Stack feature in watchOS 11 improve user experience?

    -The Smart Stack in watchOS 11 becomes more intelligent by automatically adding new widgets when needed, such as a precipitation widget or a translate widget, and more capable with live activities for favorite events.

  • What new features are introduced in iPadOS 18 for app interaction and customization?

    -iPadOS 18 introduces a new floating tab bar that morphs into a sidebar, customizable tab bars, and the ability to share the screen and remotely control another device during screen sharing.

  • What is the new Math Notes experience in iPadOS 18, and how does it work?

    -The Math Notes experience in iPadOS 18 allows users to write out expressions with the Apple Pencil, and Calculator immediately solves them and shows the result in the user's handwriting style. Changes update the results live, and this feature also works within the Notes app.

  • What is the new iPhone mirroring feature in macOS Sequoia, and what does it allow?

    -iPhone mirroring in macOS Sequoia allows users to see and control what's on their iPhone directly from their Mac, including custom wallpapers and icons, and using the phone normally for swiping through home screen pages.

  • What updates are introduced in macOS Sequoia for window arrangement and video calls?

    -macOS Sequoia introduces automatic window tiling suggestions when dragging a window to the screen edge, and a presenter preview feature for video calls that lets users see what they're about to share before sharing it.

  • What is the new Passwords app in macOS Sequoia, and what does it offer?

    -The Passwords app in macOS Sequoia provides a secure and organized way to access and store credentials, including passwords, verification codes, and security alerts, and is available across all Apple devices and Windows with iCloud for Windows app.

  • How does Safari's new Highlights feature enhance browsing experience in macOS Sequoia?

    -Safari's Highlights feature uses machine learning to automatically detect and highlight relevant information on web pages as users browse, and integrates summaries into a redesigned Reader for a distraction-free reading experience.

  • What is the Viewer feature in Safari for video on the web, and what does it do?

    -The Viewer feature in Safari brings a distraction-free experience to video on the web by putting the video front and center while providing full access to system playback controls, and automatically moving videos into Picture in Picture if the user clicks away.

  • What is Apple Intelligence, and how does it enhance user experience across devices?

    -Apple Intelligence is a personal intelligence system that enables devices like iPhone, iPad, and Mac to understand and create language and images, and take actions to simplify interactions across apps. It prioritizes notifications, powers new writing tools, and can take action across apps based on user requests.

  • How does Apple ensure privacy with Apple Intelligence, and what is Private Cloud Compute?

    -Apple ensures privacy with Apple Intelligence by processing requests on-device when possible and, when greater computational capacity is needed, using Private Cloud Compute to send only relevant data to be processed on Apple Silicon servers without storing or making the data accessible to Apple.

  • What is the integration of ChatGPT in Apple's ecosystem, and what does it offer?

    -The integration of ChatGPT in Apple's ecosystem allows Siri to tap into ChatGPT's expertise when helpful for users. Users can access ChatGPT for free without creating an account, with requests and information not being logged, and subscribers can access paid features within Apple's experiences.

Outlines

00:00

😎 Introducing visionOS 2 and iOS 18 Features

Apple introduces visionOS 2 with advanced machine learning capabilities that transform 2D photos into spatial images with natural depth. The Photos app now supports SharePlay for shared experiences. Vision Pro's interface is simplified with hand gestures for navigation. Mac Virtual Display is enhanced with higher resolution and an ultra-wide display option. visionOS 2 also adds train support for travel mode and new immersive video content for the TV app. Apple Vision Pro will launch in eight countries with different rollout dates. iOS 18 offers more iPhone customization options, including app icons and widgets that can frame wallpapers. Dark mode gets a new look for app icons, and Control Center is revamped with more customization and lock screen accessibility. New security features include the ability to lock and hide apps, and control over app access to contacts. Additionally, messages can now be scheduled, and text formatting options have been expanded. Satellite capabilities allow for off-grid texting via the Messages app.

05:01

🗺️ Enhancements in iOS 18, Maps, and Apple Cash

iOS 18 brings an overhaul to the Photos app with a unified view, new filters, and collections for easier browsing. The People & Pets section now includes groups, and a new carousel highlights favorite and featured photos. AirPods gain a head gesture control for Siri and voice isolation feature for clarity. Spatial audio is personalized for gaming. A new feature called InSight enhances TV watching by providing real-time information about actors and songs. watchOS 11 introduces training load, a metric to measure workout intensity and duration over time using a new algorithm. The Fitness app on iPhone allows customization of the summary tab. The Vitals app on watchOS 11 uses sleep tracking data to provide daily health status and insights. The Smart Stack on Apple Watch becomes more intelligent by adding relevant widgets automatically and includes live activities.

10:03

📲 iPadOS 18 and macOS Sequoia Innovations

iPadOS 18 improves the app experience with a floating tab bar that morphs into a sidebar and allows customization. SharePlay's screen sharing feature now includes the ability to draw and remotely control devices. The Calculator app comes to iPad with a new Math Notes feature that solves handwritten expressions in real time. macOS Sequoia introduces iPhone mirroring for controlling the iPhone from a Mac, bringing iPhone notifications to the Mac, and updates to window arrangement with a new presenter preview. The Passwords app provides a secure and organized way to store credentials across Apple devices and Windows via iCloud. Safari's new Highlights feature uses machine learning to detect and highlight relevant information on web pages. The Reader feature is redesigned with a summary and table of contents, and Viewer offers a distraction-free video experience.

15:04

🤖 Apple Intelligence and AI Integration in Future OS

Apple Intelligence is a new feature that uses on-device processing and Private Cloud Compute to understand and create language and images, simplifying app interactions without collecting personal data. It can prioritize notifications, assist with tasks, and create original images for messages. Apple plans to integrate external AI models like ChatGPT from OpenAI, allowing Siri to tap into its expertise without the need for an account, ensuring privacy with no logging of requests or information. The integration will be available in iOS 18, iPadOS 18, and macOS Sequoia later this year, with support for other AI models in the future.

Mindmap

Keywords

💡visionOS

visionOS is the fictitious name of Apple's newest operating system introduced in the script. It represents a significant technological advancement, particularly with the introduction of visionOS 2, which enables the creation of spatial photos from 2D images using machine learning. This showcases the theme of innovation and the integration of AI into user experiences.

💡Machine Learning

Machine Learning is a subset of artificial intelligence that allows systems to learn from data and improve over time without being explicitly programmed. In the context of the video, it is used to create spatial photos from 2D images, demonstrating the application of advanced technology to enhance user capabilities.

💡Spatial Photo

A Spatial Photo, as mentioned in the script, is a new type of image that has natural depth derived from a standard 2D photo using visionOS 2's machine learning capabilities. It represents a breakthrough in photo technology, allowing users to experience depth in their photos, which ties into the video's theme of immersive and innovative user experiences.

💡SharePlay

SharePlay is a feature that enables users to share their screen and interact with others in real time. In the script, it is highlighted as a way to experience panoramas, spatial photos, and videos with loved ones, emphasizing the social aspect of Apple's technology.

💡Mac Virtual Display

Mac Virtual Display is a feature that allows for an expanded and immersive display experience. The script mentions improvements to this feature, including higher resolution and an ultra-wide display option, which underscores the video's focus on enhancing visual experiences and productivity.

💡iOS 18

iOS 18 is the latest version of Apple's mobile operating system for iPhones, as introduced in the script. It signifies a major update with new customization features, privacy controls, and messaging enhancements, reflecting the ongoing theme of user-centric design and innovation.

💡App Locking

App Locking is a security feature that allows users to protect sensitive apps and the information within them by requiring authentication to access them. This feature, mentioned in the script, highlights Apple's commitment to user privacy and security.

💡Hidden Apps Folder

The Hidden Apps Folder is a new feature in iOS 18 that allows users to hide apps they do not want others to see installed on their device. This ties into the broader theme of privacy and personalization in the video.

💡Control Center

The Control Center is a feature in iOS that provides quick access to device settings and controls. The script discusses new customization levels and capabilities for the Control Center in iOS 18, illustrating the theme of enhanced user control and personalization.

💡Tap to Cash

Tap to Cash is a new feature introduced in the script that allows for quick and private exchange of Apple Cash without sharing personal contact information. It exemplifies the video's focus on便捷 and secure financial transactions.

💡watchOS 11

watchOS 11 is the updated operating system for the Apple Watch, as mentioned in the script. It introduces new health and fitness tracking features, such as training load and the Vitals app, which align with the video's overarching theme of health consciousness and technological integration into daily life.

Highlights

Introduction of visionOS 2, enabling creation of spatial photos with natural depth from 2D images using advanced machine learning.

SharePlay integration in the Photos app for shared experiences of panoramas and spatial media.

Hand gesture controls in Vision Pro for navigating home view and accessing Control Center.

Enhanced Mac Virtual Display with higher resolution, larger size, and ultra-wide display capabilities.

Expansion of train support in travel mode within visionOS 2.

Upcoming Apple immersive video content distribution through the TV app.

Apple Vision Pro's international rollout to eight countries with specific launch dates.

iOS 18's new features for iPhone customization, including app icons and widgets framing wallpapers.

Dark mode enhancements with color-tinted app icons for iOS 18.

New customization options and control groups in the Control Center for iOS 18.

Locking and hiding of sensitive apps with enhanced privacy controls in iOS 18.

Control over app access to contacts and pairing of accessories in iOS 18.

Tap backs feature expansion with limitless emoji and sticker options in Messages.

Scheduled messaging and enhanced text formatting options in Messages for iOS 18.

Introduction of text effects for visual amplification of Messages.

Satellite communication capabilities for iPhone 14 and later for off-grid texting.

On-device email categorization for better inbox management in iOS 18.

New topographic maps in Maps app with detailed trail networks and offline access.

Tap to Cash feature for quick and private Apple Cash exchanges without sharing personal information.

Redesigned event tickets with an integrated event guide in iOS 18.

Photos app redesign in iOS 18 with unified view, photo grid, and theme-based organization.

New interaction methods with Siri on AirPods using head nods and voice isolation feature.

Personalized spatial audio expansion to gaming and updates to watching TV experience with InSight.

Introduction of training load in watchOS 11 for measuring workout intensity and duration impacts.

Vitals app in watchOS 11 for tracking key health metrics and understanding daily health status.

Smart Stack enhancements in watchOS 11 with automatic widget addition and live activities.

iPadOS 18 updates including floating tab bar, Calculator app, and Math Notes experience.

macOS Sequoia's new continuity feature, iPhone mirroring, for controlling iPhone from Mac.

macOS Sequoia updates with improved window arrangement, presenter preview, and Passwords app.

Safari enhancements in macOS Sequoia with Highlights, Reader redesign, and Viewer for distraction-free video.

Apple Intelligence's role in personal context understanding and privacy-respecting data processing.

Integration of external AI models like ChatGPT into Apple's ecosystem for enhanced capabilities.

Transcripts

play00:00

- Good morning.

play00:01

Welcome to Apple Park.

play00:02

Let's start with our newest operating system: visionOS.

play00:07

- Now visionOS 2 lets you do something truly amazing

play00:10

with the photos already in your library.

play00:13

With just the tap of a button,

play00:14

advanced machine learning derives both a left

play00:17

and right eye view from your beautiful 2D image,

play00:20

creating a spatial photo with natural depth.

play00:23

And now you can experience all your panoramas

play00:26

and spatial photos and videos together

play00:28

with the people you love using SharePlay in the Photos app.

play00:31

People are amazed at how easy it is

play00:33

to navigate Vision Pro.

play00:35

Now you can just hold your hand up and tap to open home view

play00:40

or flip your hand over to bring up time and battery level,

play00:44

and tap again to open Control Center.

play00:46

People love Mac Virtual Display.

play00:48

Later this year,

play00:48

it gets even better with higher display resolution and size

play00:52

and it can be expanded even further

play00:54

into an ultra wide display that wraps around you,

play00:57

equivalent to two 4K monitors side by side.

play01:00

With visionOS 2,

play01:01

we're adding train support to travel mode.

play01:04

- And there's new Apple immersive video content on the way.

play01:07

These titles and more will be available on the TV app.

play01:10

- [Instructor] We're bringing Apple Vision Pro

play01:12

to these eight countries next,

play01:14

starting with China, Japan, and Singapore on June 28th

play01:19

and Australia, Canada, France, Germany,

play01:22

and the United Kingdom on July 12th.

play01:24

- iOS 18 is a big release that delivers more ways

play01:28

to customize your iPhone, stay connected

play01:31

and relive special moments.

play01:33

And now your app icons and widgets can add even more.

play01:38

I have this photo I love as my wallpaper,

play01:41

and now I can continue to enjoy it when I unlock my iPhone

play01:45

because I can arrange my apps

play01:46

and widgets to frame it perfectly.

play01:48

I can select them all

play01:50

and easily place them along the bottom, right above the dock

play01:53

for easy access or even off to the side.

play01:59

We have an awesome new look for app icons

play02:02

when we go into dark mode.

play02:04

I can bring up a new customization sheet

play02:07

and now I can tint them all with color.

play02:11

We're also bringing new levels of customization

play02:14

and capability to Control Center.

play02:16

When I swipe from the top right corner,

play02:19

I can see Control Center

play02:21

with all my controls organized in one place.

play02:24

And now Control Center isn't limited

play02:26

to just the controls you see here.

play02:28

I can swipe to multiple new groups of controls,

play02:31

like for media playback, and here are my home controls.

play02:36

To add more controls, I can open up the new controls gallery

play02:41

where I have so many options to choose from.

play02:44

I can adjust how my controls are laid out

play02:46

and resize them too.

play02:47

These new controls are also available from the lock screen,

play02:51

so you can swap a camera

play02:52

and flashlight for different controls,

play02:54

like taking a note when an idea strikes,

play02:57

and you can even use the action button on iPhone 15 Pro

play03:01

to invoke these new controls.

play03:03

So this year, we're giving you a new way

play03:05

to protect sensitive apps

play03:07

and the information inside them by letting you lock an app.

play03:11

When you choose to lock an app, if someone else tries

play03:13

to tap it, they will be required

play03:15

to authenticate using Face ID, Touch ID or your passcode

play03:20

and information from inside the app

play03:22

won't appear in other places across the system.

play03:24

There may also be occasions when you wanna hide an app

play03:27

that you don't want others

play03:28

to know is installed in your device.

play03:30

Well, now you can hide it

play03:33

and put it in a new hidden apps folder that's locked.

play03:36

In iOS 18, we're putting you in control

play03:40

by letting you decide which contacts an app can see.

play03:44

We're also putting you in control when you pair accessories.

play03:47

- This is a huge year for tap backs.

play03:50

We've not only redesigned your favorites,

play03:52

we're now giving you limitless ways to express yourself

play03:55

by letting you tap back with any emoji or sticker.

play03:58

We're bringing one

play03:59

of your most requested features to messages.

play04:01

You can schedule your message to send later.

play04:05

We're also giving you more ways to express your tone

play04:07

with text formatting, bold, italicize, underline

play04:11

or strike through any text.

play04:13

We're introducing a new way

play04:15

to visually amplify your messages with text effects.

play04:18

Some words and phrases automatically surface a suggestion

play04:21

so you can quickly select one and send it.

play04:25

And you can also add one of the many new effects

play04:28

to any text.

play04:30

Now you can use the satellite capabilities on iPhone 14

play04:33

and later to connect to satellites hundreds of miles

play04:36

above the Earth to text your friends

play04:37

and family when you're off the grid,

play04:39

all right from the Messages app.

play04:42

Once you're connected,

play04:43

you'll be able to use key iMessage features, like sending

play04:45

and receiving messages, emoji and tap backs.

play04:49

We're supporting SMS messaging via satellite too.

play04:52

This year we're giving you a new way to stay in control

play04:55

and manage incoming email with on-device categorization

play04:59

that organizes your messages

play05:01

and helps you stay up to date across all

play05:03

of your accounts, like transactions for receipts

play05:06

and order confirmations, updates for newsletters

play05:09

and social media notices and promotions.

play05:11

Maps delivers new topographic maps

play05:14

with detailed trail networks

play05:15

and hiking routes, including all 63 US National Parks

play05:19

that can be saved to your phone

play05:21

and accessed offline with turn-by-turn voice guidance

play05:24

and the ability to create your own hikes.

play05:27

We are introducing Tap to Cash, a quick

play05:30

and private way to exchange Apple Cash

play05:33

without sharing phone numbers or email addresses.

play05:36

With Tap to Cash, you can pay someone back for dinner

play05:38

just by holding your phones together.

play05:40

And event tickets are getting a beautiful new design

play05:44

and new features, including an all-new event guide,

play05:47

combining helpful information about the venue

play05:50

with smart recommendations from your favorite Apple apps.

play05:53

iOS 18 brings the biggest redesign ever to the Photos app.

play05:58

- The app has been unified into a single view

play06:01

with the photo grid at the top

play06:03

and your library organized by theme below.

play06:05

This filter button lets me quickly narrow it down

play06:07

to specific types of content,

play06:10

and now I can even filter out screenshots

play06:13

to enjoy my photos clutter free.

play06:15

With collections, you can browse

play06:16

by topics, like time, people,

play06:20

my favorite memories, new ones, like trips, and more.

play06:25

When I wanna find a specific person in my library,

play06:28

I head to People & Pets,

play06:30

and it now includes my favorite groups of people

play06:32

for the first time.

play06:34

If you swipe right from the grid,

play06:36

you'll find the new carousel,

play06:37

which highlights your best content

play06:39

in a beautiful poster-like view.

play06:42

Photos you've marked as favorites are here

play06:45

and so are featured photos surfaced by the app.

play06:47

- So that's iOS 18.

play06:50

Let's start off with AirPods.

play06:52

This year we're making it even easier to interact with Siri.

play06:55

We've created the ability to simply nod your head yes

play06:59

or gently shake your head no to interact.

play07:01

So to ensure your voice will sound crystal clear,

play07:03

no matter your environment,

play07:05

we're bringing voice isolation to AirPods Pro.

play07:08

We're expanding personalized spatial audio to include gaming

play07:12

so that you'll be in the middle of the action

play07:14

like never before.

play07:15

This year we're introducing some updates

play07:17

that make watching TV even more enjoyable.

play07:20

It's called InSight.

play07:21

When you're watching an Apple original show or movie,

play07:24

just swipe down on the remote

play07:25

and InSight will show the actors

play07:27

and their character names in real time.

play07:30

And if you're curious about the song playing,

play07:33

you can quickly see the track

play07:34

and add it to an Apple Music playlist to enjoy later.

play07:38

InSight will also be available

play07:40

when using iPhone as your remote.

play07:41

- In watchOS 11, we're introducing training load,

play07:44

an insightful way to measure

play07:46

how the intensity and duration

play07:47

of your workouts are impacting your body over time.

play07:50

Using calorimetry data, like heart rate, pace,

play07:53

and elevation, plus your personal data, like age and weight,

play07:57

a powerful new algorithm automatically translates

play07:59

our sensor data into an estimate of your effort rating.

play08:03

After your workout, you can review the rating

play08:05

on the summary page, ranging from one, easy, to 10, all out,

play08:10

and you can even adjust your effort rating up or down

play08:13

to get it just right.

play08:15

Your effort rating and workout duration are then used

play08:18

to calculate your training load.

play08:20

You'll be able to see if you're holding steady,

play08:22

above your average and can safely progress and improve

play08:26

or when you're well above your average

play08:27

and should pay close attention

play08:29

to better avoid exhaustion or injury.

play08:31

And we've now made it even easier for everyone

play08:34

to gain more insights from the fitness app on iPhone

play08:37

by giving you the ability to customize the summary tab

play08:39

to show the information you wanna see.

play08:42

- Because Apple Watch can track key vitals while you sleep,

play08:44

like heart rate, respiratory rate,

play08:46

and rest temperature, it can give you a deeper understanding

play08:49

of your body.

play08:50

So with watchOS 11, these metrics are the foundation

play08:53

of the insightful new Vitals app

play08:56

where you can check in on your daily health status

play08:58

and explore your most important health metrics

play09:01

with just a glance.

play09:02

For additional insights,

play09:03

your metrics will be highlighted when they're outside

play09:06

of your typical range

play09:07

with details on what's changed over the last week.

play09:11

And when multiple metrics are out of range,

play09:12

you'll be notified with a tailored message

play09:15

to help you understand how these changes may be linked

play09:18

to other aspects of your life, such as alcohol,

play09:20

elevation changes or even illness.

play09:23

- And last year, we introduced the Smart Stack.

play09:25

This year it becomes even more intelligent

play09:27

by automatically adding new widgets

play09:29

right when you need them,

play09:30

like the precipitation widget to alert you

play09:32

before it rains or the translate widget

play09:35

for when you're traveling somewhere new.

play09:36

The Smart Stack also becomes more capable

play09:39

with live activities coming to Apple Watch.

play09:41

So you'll have all the details for your favorite events.

play09:44

That's what's coming in watchOS 11.

play09:47

- Next, let's talk about iPadOS.

play09:50

Apps are fundamental to the iPad experience.

play09:53

In iPadOS 18, we're making them even better,

play09:56

starting with a new floating tab bar.

play09:59

When you wanna explore more,

play10:00

the tab bar morphs into the sidebar.

play10:03

If you use a specific tab often,

play10:05

you can customize the tab bar.

play10:07

One of SharePlay's best features is screen sharing.

play10:10

Now you can tap

play10:12

and draw on your screen to point out

play10:14

what they should do on theirs.

play10:16

And if you need to assist more directly, you can ask

play10:19

for permission to remotely control their iPad or iPhone.

play10:22

Next, I wanna talk about a feat

play10:24

that some may have concluded

play10:26

must be a mathematical impossibility.

play10:29

That's right, we are bringing Calculator to iPad.

play10:32

- I'm so excited to show you the new Math Notes experience.

play10:36

I get to it by just tapping

play10:38

the new Calculator button right here.

play10:40

And with my Apple Pencil,

play10:42

I'll just start writing out expressions like I would

play10:45

on a piece of paper.

play10:47

As soon as I write an equal sign,

play10:49

Calculator immediately solves it for me

play10:52

and even shows me the result in handwriting like my own.

play10:56

When I make a change, the results update live.

play11:00

- And this all works in Notes too.

play11:02

When you need to crunch numbers,

play11:03

notes has all the new math capabilities from Calculator.

play11:07

We use a powerful on-device machine learning model

play11:10

to recreate your handwriting style from your notes,

play11:14

which unlocks new capabilities.

play11:16

Just scribble your thoughts as fast as you have them

play11:19

and Smart Script refines your handwriting as you go.

play11:23

And that's iPadOS 18.

play11:26

Welcome to macOS Sequoia.

play11:29

There's a brand new continuity feature

play11:31

called iPhone mirroring.

play11:34

With iPhone mirroring on Mac, I can see what's on my iPhone

play11:37

and can control it too, all while barely lifting a finger.

play11:41

I can see my custom wallpaper.

play11:43

My icons are right where they belong,

play11:45

and I can use my phone normally, like swiping through pages

play11:49

of my home screen.

play11:50

We're bringing iPhone notifications to Mac.

play11:53

They appear alongside my Mac notifications

play11:56

and I can even interact with them

play11:57

when I don't have my iPhone handy.

play11:59

Watch how easy it is to use my devices together.

play12:05

I can grab the exported video

play12:08

and just drop it right into the template.

play12:11

And macOS Sequoia has fantastic updates

play12:14

to how you arrange your windows.

play12:15

Now when you drag a window to the edge of the screen,

play12:18

macOS automatically suggests a tiled position

play12:21

on your desktop.

play12:22

When you're on a video call, say goodbye to oversharing

play12:26

with the new presenter preview.

play12:28

It lets you see what you're about to share

play12:30

before you share it.

play12:32

And now we're introducing the Passwords app.

play12:35

Passwords makes it easy to access your credentials

play12:38

and have them securely stored, all in one place.

play12:42

Everything is organized for you, from your passwords

play12:45

to verification codes, to security alerts.

play12:48

You can find the app on Mac, iPad, iPhone, Vision Pro,

play12:52

and on Windows with the iCloud for Windows app.

play12:55

- When you're on a site,

play12:56

Safari can now help you discover more

play12:58

about the page with Highlights.

play13:01

Safari uses machine learning

play13:02

to automatically detect relevant information

play13:05

and highlight it for you as you browse.

play13:07

Summaries are also integrated into a redesigned Reader.

play13:11

Reader instantly removes distractions from articles,

play13:15

and now it can provide a table of contents

play13:17

and includes a helpful summary,

play13:19

right next to the article.

play13:21

We're bringing a distraction-free experience

play13:23

to video on the web as well with Viewer.

play13:26

When Safari detects a video on the page,

play13:28

Viewer helps you put it front and center

play13:31

while still giving you full access

play13:33

to system playback controls,

play13:34

like Airplay and Picture in Picture.

play13:36

And video automatically moves

play13:38

into Picture in Picture if you click away.

play13:40

- macOS Sequoia, developer betas will be available today.

play13:45

Public betas will be available next month,

play13:47

and all of our OS releases will be available

play13:50

to users this fall.

play13:52

Apple Intelligence will enable your iPhone, iPad,

play13:55

and Mac to understand and create language, as well as images

play13:59

and take action for you

play14:00

to simplify interactions across your apps.

play14:03

For example, your iPhone can prioritize your notifications

play14:06

to minimize unnecessary distractions

play14:09

while ensuring you don't miss something important.

play14:12

Apple Intelligence also powers brand new writing tools

play14:15

that you can access system-wide

play14:17

to feel more confident in your writing.

play14:20

Writing tools can rewrite, proofread,

play14:22

and summarize text for you,

play14:23

and now you can create totally original images

play14:26

to make everyday conversations even more enjoyable.

play14:29

So when you wish a friend a happy birthday,

play14:32

you can create an image of them surrounded by cake,

play14:34

balloons, and flowers to make it extra festive.

play14:37

You can create images in three unique styles:

play14:40

sketch, illustration, and animation.

play14:45

In addition to Messages,

play14:47

this experience is built into apps throughout the system

play14:50

like Notes, Freeform, Keynote and Pages.

play14:55

Another way Apple Intelligence is deeply impactful

play14:58

is its ability to take action across your apps.

play15:01

So you can say things like, "Pull up the files

play15:04

that Joz shared with me last week,"

play15:06

or "Show me all the photos of Mom, Olivia, and me,"

play15:09

or "Play the podcast that my wife sent the other day."

play15:12

There's one more critical building block

play15:15

for personal intelligence

play15:16

and that's an understanding of your personal context.

play15:20

Suppose one of my meetings has been rescheduled

play15:22

for late in the afternoon,

play15:23

and I'm wondering if it's gonna prevent me from getting

play15:25

to my daughter's play performance on time.

play15:28

Apple Intelligence can process the relevant personal data

play15:31

to assist me.

play15:32

It can understand who my daughter is,

play15:35

the play details she sent several days ago,

play15:37

the time and location for my meeting,

play15:39

and predicted traffic between my office and the theater.

play15:43

With Apple Intelligence,

play15:44

powerful intelligence goes hand in hand

play15:47

with powerful privacy.

play15:49

We have integrated it deep into your iPhone, iPad, and Mac

play15:53

and throughout your apps, so it's aware

play15:55

of your personal data without collecting your personal data.

play15:58

When you make a request, Apple Intelligence analyzes

play16:01

whether it can be processed on device.

play16:03

If it needs greater computational capacity,

play16:06

it can draw on Private Cloud Compute

play16:08

and send only the data that's relevant to your task

play16:11

to be processed on Apple Silicon servers.

play16:14

Your data is never stored or made accessible to Apple.

play16:18

It's used exclusively to fulfill your request.

play16:21

And just like your iPhone, independent experts

play16:25

can inspect the code that runs on these servers

play16:28

to verify this privacy promise.

play16:30

There are other artificial intelligence tools available

play16:33

that can be useful for tasks

play16:34

that draw on broad world knowledge

play16:36

or offer specialized domain expertise.

play16:39

We want you to be able to use these external models

play16:41

without having to jump between different tools,

play16:44

so we're integrating them right into your experiences.

play16:47

And we're starting out with the best of these:

play16:50

the pioneer and market leader, ChatGPT from OpenAI,

play16:55

powered by GPT-4o.

play16:57

So Siri can tap into ChatGPT's expertise

play17:00

when it might be helpful for you.

play17:01

You'll be able to access ChatGPT for free

play17:04

without creating an account.

play17:07

Your requests and information will not be logged.

play17:10

And for ChatGPT subscribers, you'll be able

play17:12

to connect your account

play17:14

and access paid features right within our experiences.

play17:17

ChatGPT integration will be coming to iOS 18, iPadOS 18

play17:22

and macOS Sequoia later this year.

play17:24

We also intend to add support

play17:26

for other AI models in the future.

play17:28

- Thank you so much for joining us.

play17:30

Let's have a great WWDC.

play17:34

(plane roaring) (lively music)

play17:39

♪ Whoa, yeah ♪

play17:42

♪ Be there ♪

Rate This

5.0 / 5 (0 votes)

Related Tags
Apple ParkvisionOS 2Machine LearningSharePlayMac Virtual DisplayiOS 18CustomizationControl CenterApp LockingSatellite Messaging