Intel's Crazy Plan for AI Chips IS WORKING! (Supercut)

Ticker Symbol: YOU
29 Feb 202428:18

Summary

TLDRIntel CEO Pat Gelsinger outlines the company's bold vision to become the world's leading chip manufacturer and foundry. He announces major advancements like the Intel 18A and 14A processes, extending Moore's Law into the angstrom era, as well as partnerships with Microsoft and Arm. Other Intel leaders then detail plans to revolutionize the foundry business through advanced 3D packaging to enable new 'systems of chips', immersion cooling, and other innovations to pave the way for ubiquitous AI while addressing sustainability.

Takeaways

  • 😊 Intel is investing heavily in AI compute, energy and data centers to meet demand for AI services
  • 😎 Intel believes AI will be one of the greatest tools invented, enabling abundant intelligence
  • 😏 Intel encourages cautious optimism about AI to ensure responsible development
  • πŸ€“ Intel is focused on delivering 5 leading edge nodes in 4 years to regain process leadership
  • πŸ‘·β€β™‚οΈ Intel aims to become the #2 semiconductor foundry in the world
  • 🌎 Intel wants to build the world's most resilient and sustainable foundry supply chain
  • πŸš€ Intel is venturing into the angstrom era with new transistor architectures
  • πŸ“ˆ Intel is expanding and enhancing its process nodes roadmap to ensure customer access
  • πŸ”Œ Intel offers advanced assembly, test and packaging technologies for AI systems
  • ✨ Intel aims to optimize systems-on-chip and build interconnected systems-of-chips for AI

Q & A

  • What is the main purpose of Intel Foundry Services?

    -The main purpose is to establish Intel as a leading foundry provider that can enable the development of advanced semiconductors and help build resilient, sustainable, and trusted supply chains.

  • Why does the industry need more 'resilient' supply chains?

    -Because currently 80% of semiconductors are produced in a small, concentrated area in Asia. This centralization creates risks, so there is a need for more geographically distributed capacity to improve resilience.

  • What is 'angstrom era' referring to?

    -The angstrom era refers to the next generation of process nodes that measure features in the atomic-scale range of angstroms (less than 1 nanometer), including Intel nodes 20A and 18A.

  • How will new transistor architectures benefit computing?

    -The new transistor architectures like 'ribbonFET' will enable faster, more efficient computing at the atomic scale to power things like AI and advanced workloads.

  • Why is advanced packaging becoming so important?

    -Because monolithic chips are hitting limitations in terms of yield, cost and thermal constraints. Advanced multi-chip packaging allows for greater flexibility and performance by combining different chips/chiplets.

  • What is the 'UCIe' interconnect Intel mentioned?

    -UCIe is an open chiplet-to-chiplet interconnect standard Intel introduced, aiming to provide high-speed connectivity comparable to a PCI Express-like interface for multi-chip packages.

  • How will Intel Foundry Services help enable more efficient AI systems?

    -By developing advanced packaging, cooling, memory and interconnect solutions tailored for AI workloads that allow customers to build lower cost and more power efficient systems of chips.

  • Why did Intel partner with Arm?

    -Because Arm CPU and GPU IP is ubiquitous in the semiconductor industry. The partnership helps provide Arm customers with access to Intel's leading foundry capabilities.

  • What is CSS from Arm?

    -CSS stands for Compute Subsystem and refers to Arm providing full verified and validated subsystems incorporating CPUs, GPUs, interconnects etc. rather than just separate IP blocks.

  • How will AI change engineering design cycles?

    -AI will significantly enhance engineers' productivity by automating time-consuming tasks, reducing errors, and amplifying creativity to accelerate innovation.

Outlines

00:00

πŸ˜€ Introducing the video and key questions

The first paragraph is an introduction to the video, welcoming Sam and asking him a few key questions about the $7 trillion investment in AI, why we should be optimistic about AI, and how to address concerns people may have about AI.

05:01

😊 Discussing Intel's progress with process technology

The second paragraph discusses Intel's progress in advancing its process technology, detailing the multiple new nodes and process improvements the company has made and will make down to the angstrom era with ribbons and transistors.

10:01

🏭 Presenting the strategy for becoming a leading foundry

The third paragraph presents Intel Foundry Services' strategy for becoming the number two foundry in the world, discussing the need for resilient and sustainable supply chains and Intel's unique packaging and interconnect capabilities.

15:02

πŸ’‘ Explaining the concept of a systems foundry

The fourth paragraph explains the concept of a systems foundry, detailing how it involves breaking up monolithic devices into chiplets and tiles across advanced nodes and packaging them together to enable customers to optimize and scale AI systems.

20:03

πŸ”‹ Addressing efficiency and costs to make AI ubiquitous

The fifth paragraph discusses how making AI ubiquitous will require greatly improved efficiency and reduced costs for AI compute, detailing estimates for massive future power needs and Intel's 5 year roadmap to improve efficiency.

25:04

πŸ‘₯ Partnering with Arm to fuel innovation

The sixth paragraph discusses Intel's new partnership with Arm to fuel innovation through co-investments, joint programs, IP and shuttle scaling to support the growth of AI and advanced packaging.

Mindmap

Keywords

πŸ’‘Moore's Law

Moore's Law refers to the observation by Intel co-founder Gordon Moore that the number of transistors on an integrated circuit doubles about every two years. In the video, this concept is mentioned several times in relation to Intel's relentless pursuit of more efficient, capable and scalable computing to meet the growing demands of AI. For example, the CEO asserts that despite concerns, "Moore's Law is alive and well" thanks to innovations like new materials and molecules.

πŸ’‘AI

AI or artificial intelligence is presented as a major driving force behind the growing demand for advanced semiconductors. The video emphasizes how AI is enabling new innovations and intelligence that will "reshape significant parts of the way we live and work." Intel aims to support the AI explosion through its foundry capabilities and advanced process technologies.

πŸ’‘Foundry

In the semiconductor industry, a foundry refers to a factory where chips are manufactured or "fabricated" for other companies. A key theme in the video is Intel's vision to become the world's leading foundry through its advanced fabrication processes and packaging technologies that can meet the exponential capacity needs of AI systems.

πŸ’‘Packaging

As transistor scaling slows down, advanced semiconductor packaging is emerging as a key technology ingredient. The video mentions how packaging innovation allows integration of chiplets and continues to get more significant as AI workloads require systems of chips connected together.

πŸ’‘Nodes

"Nodes" refers to the manufacturing process nodes, defined by the smallest feature size that can be produced on a chip. The CEO emphasizes Intel's roadmap of bringing five leading-edge nodes - processes - to market in four years as part of its plan to regain process leadership.

πŸ’‘EUV

EUV or extreme ultraviolet lithography is mentioned as an advanced manufacturing technique used for Intel's most cutting-edge 3nm and 20A process technologies, requiring additional complexity and steps.

πŸ’‘Chiplets

Chiplets refers to the concept of breaking up a large monolithic chip into smaller tiles that can be packaged together using advanced integration. The video presents chiplets and chiplet standardization as key to enabling large-scale AI systems spanning over 100,000 CPUs.

πŸ’‘Sustainability

The video emphasizes the need for sustainable and energy-efficient chip manufacturing and data center solutions to bring AI capabilities to fruition without exponentially growing electricity consumption beyond what's viable.

πŸ’‘Resilience

There is strong focus on resilience - via distributed manufacturing capacity and supply chain diversity - to ensure reliable access to leading-edge chips, unlike the current concentration of production in Asia.

πŸ’‘Standards

Common standards are presented as necessary not only between chiplets but also inside them to enable interoperability between AI system components (CPUs, memory, fabric, etc.) across cloud vendors. Intel positions their role as a standards leader.

Highlights

Investing a lot of money in AI compute, energy data centers is going to be important to deliver the services people want

This is a worldwide investment to help many many different efforts many different people, and not just chips

AI could soon be one of the greatest tools humans have yet invented

People are right to be cautious about AI. I think this is going to be an extraordinarily powerful technology

Getting AI systems out there early so people can adapt and think and provide input

Announcing Intel 14a, venturing deeply into the angstrom era with 1.4 nanometer technology

AI era needs advanced wafers but it even needs more systems and packaging capabilities, an area Intel is the clear leader in

You can no longer do just monolithic devices, you have to break it up for thermal profiles, costs and flexibility

To train models with 100,000 CPUs now and potentially up to 10 million in future requires standards everywhere from chips inside to chips outside

Argonne National Lab used a 66,000 chip system to model fusion reactions and cancer curing drugs at the molecular level

Bringing AI everywhere requires figuring out how to do it cost effectively

Announcing partnership with ARM to bring design capability and education out to all their customers

Time waits for no one. Reducing design times through partnerships is hugely beneficial

The only limitation to what we can do with AI is your imagination

Change from AI will only accelerate as it impacts your work, business and life

Transcripts

play00:00

hey Sam thanks so much for joining us of

play00:02

course and uh Hey a couple of quick

play00:04

questions you know the first one is 7

play00:06

trillion what's this all about anyway

play00:09

look uh as as I'm sure you all know you

play00:11

shouldn't believe everything you read in

play00:12

the Press really we do think the the

play00:16

kernel of Truth is that we do think that

play00:17

investing a lot of money in AI compute

play00:20

energy data centers is going to be

play00:22

important to deliver the the amount of

play00:25

services people want and the tools that

play00:27

we all are going to really I think get a

play00:30

huge amount of value out of to help

play00:31

create better Futures mhm so there's a

play00:33

lot of investment to be made here I

play00:35

think so but it's across a lot of stuff

play00:37

it's not I mean it's a this is like a

play00:39

worldwide investment to help many many

play00:41

different efforts many different people

play00:43

and not just chips of course but sort of

play00:45

the whole infrastructure stack around it

play00:47

okay second question you and I are both

play00:50

Tech optimists a little bit so why

play00:52

should we be Tech optimists about AI I

play00:55

think this is going to be one of the

play00:56

greatest tools humans have yet invented

play00:58

if if you think about what we we can do

play01:00

with more intelligence available to us U

play01:03

more abundant intelligence cheaper

play01:05

prices things that humans on their own

play01:06

are not capable of uh we will all be

play01:08

able to invent new things for each other

play01:10

that astonish us that's how the future

play01:12

gets better making things more

play01:14

intelligent I like it when you say that

play01:16

uh third question our founder Andy Grove

play01:19

famously said the paranoid survive right

play01:22

paranoid about yourself your success but

play01:24

also paranoid about competition and

play01:26

things that could go wrong and there are

play01:28

those who are a little bit paranoid

play01:30

about AI today what do you say to them I

play01:32

think people are right to

play01:35

be cautious about AI I think this is

play01:37

going to be an extraordinarily powerful

play01:39

technology I think it's going to reshape

play01:41

significant parts of the way we live and

play01:42

work and that our economy runs and part

play01:46

of our strategy what we call iterative

play01:48

deployment is that we want to put these

play01:50

things out into the world early so that

play01:53

people can adapt and think and provide

play01:56

input and that uh we can be ready for

play01:59

the man of change that will come over

play02:01

time so I think that's great yeah

play02:03

getting them out there early people test

play02:05

them that's how things get better yeah

play02:07

making them itely better well Sam you've

play02:09

honored Us by joining Intel Foundry date

play02:11

right the partnership that we have with

play02:13

you is tremendous we're going to do

play02:14

great science together great AI machines

play02:17

together and uh just fundamentally make

play02:19

the world a better place thank you so

play02:21

much thank you for having

play02:22

[Music]

play02:24

me Moors law alive and well until the

play02:30

periodic table is exhausted we are not

play02:33

done with Mo's law we Bend physics we

play02:35

create molecules we do amazing things

play02:39

and Moore's Law is alive and well but we

play02:41

have to do it a different way we have to

play02:43

enable globally resilient sustainable

play02:46

and trusted Supply chains and at the end

play02:49

of our conference today I'm joined by

play02:51

Sam Altman and he's going to challenge

play02:53

the capacity needs of the industry and

play02:56

the system of chips needs new

play02:57

capabilities new tests and packaging

play03:00

capabilities and that's what a systems

play03:02

Foundry does and as we describe this

play03:04

Vision to become the number two Foundry

play03:07

of the world we realized there's only a

play03:08

few companies that can do this that have

play03:11

the capital capacity that have the R&D

play03:13

the longevity to go do this and now as

play03:15

we're in an economic downturn ah welcome

play03:18

to semiconductors and then the AI

play03:20

explosion and the cyclicality of the

play03:22

industry and we've seen the Geo

play03:24

instability and active Wars in Israel

play03:27

and Ukraine and the tensions and Taiwan

play03:29

on Straits this is anything but a

play03:33

resilient supply chain today and for

play03:36

that get to be a large meaningful the

play03:38

second largest Foundry but become the

play03:41

world's most sustainable Foundry the

play03:44

world's most resilient Foundry because

play03:47

that's exactly what the world requires

play03:49

but stunningly you know in 1990 80% of

play03:52

the semiconductors are built in us and

play03:55

Europe today 80% in a small concentrated

play03:58

area in Asia you know we've seen this

play04:00

long steady decline right in terms of

play04:03

our supply chains for the world nothing

play04:06

should be reliant on a single port to a

play04:09

single country a single place in the

play04:11

world we need resilience a resilient

play04:14

access to supply chains and capacity in

play04:18

the right regions at the right time and

play04:21

thus the choice the opportunity to drive

play04:23

systemic change in where and how we

play04:26

drive the most important aspect of our

play04:29

future where the technology Supply

play04:31

chains are what aspect of your life is

play04:34

not becoming more

play04:35

digital well everything is your

play04:37

Healthcare your financial you're social

play04:40

and with that we simply call it silicon

play04:42

ofy silicon and the economy becoming

play04:45

fused together in an inextricable way

play04:47

and as stewards of Moore's Law we see

play04:50

this Relentless pursuit of more

play04:52

efficient more capable more scalable

play04:54

Computing and for that we've been on

play04:56

this journey we also announced that

play04:59

we're we're going to get five nodes in

play05:00

four years we're going to do something

play05:01

unheard of in the industry to return

play05:04

Intel to process technology leadership

play05:07

and while we're not finished today we

play05:10

see the end is soon in front of us on

play05:12

that journey and Intel 7 shipping and

play05:15

ramping and volume Intel 4 with our cor

play05:17

ultr launch shipping and ramping and

play05:19

volume Intel 3 is production certified

play05:22

and we'll be with our server products

play05:24

launching in the first half of the Year

play05:26

going into volume production so with

play05:28

this we've gone on Incredible Journey

play05:30

but then it continues into what we call

play05:32

the angstrom era and for this Intel 20a

play05:36

and Intel 18a the adoption of ribbon fed

play05:39

a new transistor structure of power via

play05:42

power delivery technology the Embrace of

play05:45

the first major new transistor re

play05:47

architecting since 12 this is a Mona

play05:50

Lisa no no this is a rembrand no no no I

play05:54

think it's a Michelangelo right sculpted

play05:56

in Silicon right for these truly are

play06:00

works of art and I am thrilled for the

play06:02

progress and with that the finishes 18a

play06:05

we've already sent into Fab our first

play06:07

18a products and this is a test tiip for

play06:11

Clearwater Forest so I'm thrilled this

play06:15

is what we call a family photo so kids

play06:17

come to Papa here we go five nodes in

play06:20

four

play06:21

years and I do want to announce describe

play06:24

and give a moment to our latest newest

play06:28

18a customer

play06:29

my decades long friend Sacha Nadella

play06:32

speaking for Microsoft as the newest 18a

play06:34

customer let's hear from Sacha now thank

play06:37

you so much Pat it's great to join you

play06:39

at your launch event it's clear that we

play06:41

are in the midst of a very exciting

play06:43

platform shift that'll fundamentally

play06:46

transform productivity for every

play06:47

individual organization and the entire

play06:50

industry uh to achieve this Vision we

play06:52

will need a reliable supply of the most

play06:55

advanced high performance and

play06:56

highquality semiconductors and all of us

play06:59

at Microsoft are committed to supporting

play07:01

Intel's efforts to build a strong supply

play07:03

chain right here in the United States

play07:05

that's why we're so excited to work with

play07:07

Intel Foundry services and why we have

play07:09

chosen a chip design that we plan to

play07:12

produce on Intel's 18a process uh we

play07:15

look forward to sharing more details in

play07:16

the future and I can't wait to see all

play07:19

that we will be delivering together for

play07:21

our customers in the years ahead thank

play07:22

you so very much thank you Sacha so can

play07:26

I tell you more about what comes after

play07:28

18a today we're announcing that we're

play07:31

extending these nodes we're adding major

play07:34

and minor uh nodes to it a combination

play07:36

of older and Leading Edge nodes to

play07:38

ensure our customers have access to the

play07:40

process technology they need today we

play07:43

are announcing Intel 14a for the first

play07:46

time you think about this like four 1.4

play07:48

nanometer technology but Intel

play07:51

14a venturing deeply into the angstrom

play07:55

era 14a first

play07:58

processing

play08:02

but we're also announcing that we're

play08:04

extending our nodes as you see on here

play08:06

adding P noes enhancements to those

play08:08

existing adding performance capabilities

play08:11

adding t- noes uh through silicon via

play08:13

new feature enhancements with e noes on

play08:16

the road map filling out that road map

play08:18

of capability today we're announcing for

play08:20

the first time Intel 16e enhancements to

play08:23

our Intel 16 technology as well so we're

play08:26

filling out that full set of nodes the

play08:29

road map that we have to go beyond it

play08:31

but as we've seen as we've gone through

play08:32

this period of time this AI era

play08:35

explosion Wafers are cool packaging has

play08:39

gotten to be really cool so Intel

play08:41

Foundry offers a broad set now of

play08:44

advanced assembly and test uh

play08:46

Technologies Intel 25 years ago drove

play08:50

the standardization of organic packages

play08:52

now we're driving the next generation of

play08:55

glass based packages and with that the

play08:57

ability to directly inter with Optics

play09:00

and wave guides directly into the

play09:03

package construct for the most advanced

play09:05

system capabilities as well you know and

play09:07

Intel Foundry has added a number of

play09:09

additional AI customers to our portfolio

play09:13

of packaging offerings as well AI era

play09:16

needs Advanced Wafers but it even needs

play09:18

more systems and packaging capabilities

play09:21

an area that Intel is the clear leader

play09:23

in and this now includes as customers

play09:26

some of the largest AI leaders in the

play09:28

world as I include my time on stage

play09:31

today is a day 3 years in the

play09:36

making and I couldn't be prouder of the

play09:39

team at Intel that is ralling behind

play09:42

this rebuilding of this iconic company

play09:44

and you're going to hear from a number

play09:46

of those leaders today bringing together

play09:48

the world's first system Foundry

play09:51

capabilities for the AI era and with

play09:54

that it's my pleasure to introduce to

play09:55

the stage a friend for decades now and

play09:58

the the zealous leader of our Foundry

play10:00

Services none other than Stu pan please

play10:03

welcome Stu to the

play10:04

St our people can sense and feel this

play10:08

momentum you can hear it in their voices

play10:11

you can see it in their actions they

play10:13

know that you don't need to be in Taiwan

play10:15

to build the world's most advanced

play10:18

semiconductors theyve realized this five

play10:20

NOS in four years this audacious goal

play10:22

that Pat laid out you can see the check

play10:24

marks across all the boxes here we're

play10:26

ready to earn the right to be your

play10:29

Foundry supplier nobody's going to give

play10:30

us that we want to earn it so that's one

play10:34

perspective I want to offer up a second

play10:36

perspective and this comes from Chris

play10:39

Miller the author of the book Chip War

play10:42

this is a New York Times bestseller fin

play10:44

Financial Times book of the Year took

play10:46

Chris 10 years to write it now Chris in

play10:49

a speech in October said this quote to

play10:51

the employees said quotequote Intel is

play10:53

the most important company of the last

play10:56

50 years so I called Chris I said are

play10:58

you okay if I say this publicly it's

play11:00

yeah okay go ahead good publicity for

play11:02

the book I came back to Intel 3 months

play11:04

after pat did because I believe this

play11:07

quote to be true and I believed it long

play11:10

before Chris said it and what you're

play11:13

going to hear in the next 40 minutes or

play11:14

so is all the reasons why Chip War

play11:18

season 2 is about to begin so let's

play11:21

start from the

play11:22

beginning Gordon's original paper was

play11:25

called cramming more components on

play11:27

integrated circuits it was published in

play11:28

1965

play11:30

every time I read it I'm stunned by how

play11:32

pressing he was in the last section of

play11:34

the paper Gordon remarks we come to a

play11:35

Day of

play11:36

Reckoning quote unquote it may prove to

play11:38

be more economical to build large

play11:40

systems out of smaller functions which

play11:42

are separately packaged and

play11:44

interconnected and this is why I believe

play11:46

we're in the area of the systems Foundry

play11:48

you can no longer do just monolithic

play11:50

devices you have to break it up you have

play11:52

to adust for thermal profiles you have

play11:54

to address costs you have to have

play11:56

flexibility and this is all driving a

play11:59

new level of systems thinking Into The

play12:01

Foundry business in this systems era you

play12:04

not only have to have Open Standards

play12:06

between devices you have to have

play12:08

standards on the device think about the

play12:11

fact of to do a training model day

play12:13

requires 100,000 CPUs all running and

play12:16

concert all in the same data set the

play12:18

next round of training models will

play12:19

require a million CPUs that's something

play12:22

that requires standards everywhere from

play12:25

chips inside to chips outside this is

play12:27

what's necessary

play12:29

for our customers succeed and this is

play12:31

the fundamental reason why Intel is a

play12:33

systems company turning into a Foundry

play12:36

not the other way around so now that we

play12:38

described system thinking let's look at

play12:41

how the original Foundry model was

play12:42

created now since CC way has been kind

play12:45

enough to mention Us in his last few

play12:47

earnings calls I thought i' return the

play12:48

favor and talk about tsmc in my

play12:52

presentation now this was a presentation

play12:55

that Morris chain gave at MIT MIT last

play12:57

October and in it he describes The

play12:59

Foundry model he says it's research and

play13:01

development it's waer fabrication it's

play13:03

Advanced

play13:04

packaging and he says in the red line

play13:07

that's what tsmc does and said in the

play13:10

blue line Intel everybody else does

play13:12

everything else you might even call that

play13:14

an IDM 1.0 kind of manufacturer now tsmc

play13:18

has been incredibly successful with this

play13:20

model discipline execution discipline

play13:22

strategy consistent Innovation but to

play13:25

quote Bob Dylan The Times They are

play13:28

changing

play13:30

let me tell you

play13:32

why this there's an idea of Systems

play13:34

Technology co-optimization where you

play13:35

look at application workload Software

play13:37

System architecture memory interconnect

play13:39

all these different things what happens

play13:42

today is people focus on their layer and

play13:45

maybe the layer up on top of it in fact

play13:47

this is really what a classic Foundry

play13:48

does today but we're now in the realm of

play13:51

the exponential Sam alman's going to

play13:52

come out later on this afternoon and

play13:53

talk about he doesn't have enough

play13:55

capacity to do what he wants to do you

play13:58

have to look at all of these

play14:00

combinations you can get a couple of

play14:02

things right but to do a system that

play14:04

coordinates the activities of solving a

play14:05

training model across 100,000 CPUs

play14:08

requires you to get all the gear ratios

play14:11

right if you're mismatched in memory if

play14:13

you're mismatched in networking you wind

play14:15

up throwing away valuable cycles and

play14:17

valuable resources so we got to get 100x

play14:20

more out of what we're doing so we

play14:22

described the evolution now let's build

play14:24

out the strategy and talk about what's

play14:26

the revolution in all this we like to

play14:29

think about this in three basic

play14:32

layers first off we have to be a

play14:35

world-class foundary right Rowan Chen

play14:37

the COO of Qualcomm talks about the fact

play14:40

that silicon speaks and silicon speaks

play14:43

in four different ways performance power

play14:47

area and cost without that you're not in

play14:51

the business the next layer of the

play14:53

pyramid is all about resilient

play14:55

sustainable suppli this need to have

play14:57

capability around the world to build

play14:59

this and to build it in a sustainable

play15:02

fashion the top layer of the pyramid is

play15:04

this idea of systems of chips we're

play15:07

putting system inside a chip and we're

play15:09

working with our Foundry Partners to

play15:11

create systems of chips so let's walk

play15:14

you through what that means now I talked

play15:15

earlier about this Day of Reckoning what

play15:18

that means it's happening now we can no

play15:20

longer do designs at a monolithic level

play15:23

we are now at retical limited designs

play15:26

design sizes that are 800 square millim

play15:28

of silicon because we have to move

play15:30

Beyond Ral limits and thermal

play15:31

constraints and by the even cost

play15:33

constraints because when you're building

play15:34

these really big die sizes they're

play15:37

really expensive isn't there a better

play15:39

way to take advantage as Pat talked

play15:40

about to take smaller tiles on the more

play15:42

advanced notes get better yields out

play15:44

them package them together have more

play15:46

flexibility to do all that really

play15:48

requires if you will a system amount of

play15:50

chips so you can see in the animation

play15:51

here how we build it out and this is

play15:53

literally how we're going to build out

play15:54

in the factory the idea of a substrate

play15:56

the idea of Base dieses the idea of

play15:58

logic tiles the idea of IO tiles on the

play16:00

side why do this it gives our customers

play16:03

the ability to optimally trade for what

play16:05

they need for their design the things

play16:07

that you do for a training engine will

play16:09

be different than what you do for an

play16:11

inference engine and only by having all

play16:13

these levers to go pull can you get this

play16:16

done we learned a lot through a device

play16:19

called ponovo or as The Branding people

play16:21

call Intel data center GPU Max series

play16:24

it's ANC it's 100 billion transistor s

play16:27

so it's dozens of chiplet tiles 47 of

play16:31

them it's multiple suppliers by the way

play16:34

we coexist with tsmc in the same package

play16:38

right we develop testing techniques to

play16:39

go off and do that we do this idea of

play16:42

singulated die test what does that mean

play16:43

it means every single die that goes into

play16:46

that package is a known good die why is

play16:49

that important because you want every

play16:50

one of them to be good the assembly test

play16:52

shield on this device is 95% plus it is

play16:56

the Super Bowl of integrated design now

play17:00

what do you do with it well if you're

play17:02

argon National Labs and our partners at

play17:04

HP you build a really big supercomputer

play17:07

and they built a computer that was

play17:09

66,000 Pacos 20,000 Sapphire Rapids and

play17:13

it looks like

play17:15

this okay what do you do with something

play17:18

like that well you solve some really

play17:21

hard science problems if you want to

play17:23

model the airf flow across the wing you

play17:26

can do that on a workstation if you want

play17:28

to model the air flow across a plane you

play17:32

do it on this if you want to model

play17:34

Fusion reactions which are pretty tricky

play17:36

things to model you do it on a device

play17:38

like this if you want to model if you

play17:40

want to model cancer curing drugs at the

play17:42

molecular level you do it like

play17:44

this it's 600 tons of compute it's four

play17:48

tennis courts it is the weight of an

play17:51

Airbus it has 300 miles of optical cable

play17:55

it takes 34,000 gallons a minute to Cool

play17:59

by the way your faucet at home it's a

play18:00

gallon a minute 34,000 gallons a minute

play18:04

so when we talk about how to design the

play18:06

stuff we have to find ways to make this

play18:08

more power efficient to make this more

play18:10

cost effective this today is the second

play18:12

fastest super computer in the world by

play18:15

the way at 100,000 CPUs roughly to

play18:18

handle the demands of AI we're going to

play18:20

go far beyond that and that's why this

play18:21

idea of scalability is so

play18:23

important now let's go through the top

play18:25

of the pyramid this idea of systems of

play18:27

Chip systems of Chip require as Pat

play18:29

mentioned great packaging technology

play18:32

we've created standard called UCI which

play18:34

allows chipto chip connectivity think of

play18:37

it as the PCI Express of what we did

play18:39

back in the mid 90s this idea that you

play18:41

can add mix and match by the way you can

play18:43

mix and match different Foundry

play18:45

suppliers we like that because we're

play18:48

sort of an underdog in all this some of

play18:49

our competitors not so much

play18:52

but our customers want this kind of

play18:55

flexibility so as you can see from the

play18:57

rendering what we're doing is

play18:59

taking systems on a

play19:01

chip and Building Systems of chips why

play19:04

do you need systems of chips because

play19:06

it's the same problem I mentioned

play19:07

earlier you need to train models with

play19:09

100,000 CPUs now and a million

play19:11

potentially down the road and maybe up

play19:13

to 10 million when you're moving a

play19:15

coordinating data across all of these

play19:17

devices you need to have standards and

play19:19

connectivity and that's what we provide

play19:22

and really when you think about it what

play19:24

is what's it going to take to bring AI

play19:26

everywhere how do you make it cost

play19:28

effective how do you make it capital

play19:29

efficient yes yeah I know Sam's asking

play19:32

for trillions but we want to make sure

play19:34

he's spending all that money in the most

play19:36

costeffective manner possible so let's

play19:39

break that

play19:40

out you have data center chips doubling

play19:42

year on-ear but the efficiency needs are

play19:45

the things that are really eye-catching

play19:47

New York Times ran an article that AI

play19:49

could soon need as much electricity as

play19:51

an entire countries so I'm sure you're

play19:53

curious like which countries Sweden the

play19:55

Netherlands Argentina if you were to run

play19:58

all of the AI servers that market

play19:59

estimates have on djx2 dx100 those kind

play20:03

of devices you would take 85 to 134

play20:08

terawatt hours terawatt hours by the way

play20:11

the great state of California its entire

play20:13

power generation capability to day is 30

play20:15

tratt hours for the entire state so

play20:19

bringing AI everywhere is going to

play20:21

require us in our Foundry Partners to

play20:23

figure out how to do this cost

play20:25

effectively this is what this road map

play20:27

is going to take and this I think is

play20:28

what makes us different than other

play20:31

Foundry approaches you have to start off

play20:33

across first off with table sticks as I

play20:35

mentioned you have to start off with a

play20:37

great process add to that packaging

play20:40

which is we believe a unique differ for

play20:42

us why we build a lot of server parts

play20:46

and we're taking everything that we

play20:47

learn from our server business and

play20:49

offering up to our Foundry Partners

play20:52

these are table stakes and this is what

play20:54

it takes to be a Foundry player we have

play20:56

this planned out literally across all

play20:58

these dimensions for the next 5 years

play21:01

let's talk about cooling I mentioned

play21:03

that that argon needs 34,000 gallons a

play21:06

minute to cool it off the next wave of

play21:09

devices are going to have to be immersed

play21:10

and cooled and today Intel Zeon product

play21:12

line is the only product that offers an

play21:15

immersion cooling warranty immersion

play21:18

cooling allows us to deliver power much

play21:20

more effectively in a data center we're

play21:21

going to take what we've learned there

play21:23

and we're going to offer that up to our

play21:25

Foundry customers so that when we start

play21:26

looking at 2,000 watt devices 5 years

play21:29

from now we're going to have a way to

play21:31

cool those memory how do perhaps do we

play21:34

put memory on the device itself so it's

play21:37

more computationally cost effective and

play21:40

over the next five years you're going to

play21:41

hear us talk a lot about new

play21:42

technologies and new ways to increase

play21:44

memory bandwidth why decreasing the need

play21:47

for energy consumption a five-year kind

play21:49

of

play21:50

look

play21:52

interconnects interconnects between

play21:54

chips the idea of having high-speed

play21:55

series highspeed interconnect all the

play21:57

things that you expect from a Foundry

play21:58

provider is what we're going to give you

play22:01

and we're going to not plan out for just

play22:02

what's out there today keep in mind as a

play22:04

standards company we do this across all

play22:07

different standards and it's our job to

play22:09

make those standards available to all of

play22:11

you and last you know networking think

play22:14

about a net card that's capable of

play22:17

handling demands of AI modeling what you

play22:19

do with ethernet today isn't good enough

play22:22

so working closely with a number of

play22:23

ethernet standards Partners to figure

play22:25

out ways how do we make ethernet more

play22:27

capable

play22:28

to develop the idea of systems of chips

play22:31

and ethernet provides that lowcost high

play22:33

bandwidth potential to go off and do

play22:35

that add to that fonics add to that

play22:38

Technologies beyond that here again it's

play22:41

another 5-year road map this morning

play22:43

we're announcing a new partnership with

play22:45

arm merging business initiative how do

play22:47

we take advantage of all the programs

play22:50

that arm has to offer to bring design

play22:53

capability design education out to all

play22:55

of their customers we're doing this with

play22:57

arm we will make co-investments we'll do

play23:00

joint programs we'll provide shuttles at

play23:02

scale arm will provide IP at scale and

play23:05

this is how we're going to fuel this

play23:07

next wave of innovation and it's truly

play23:10

exciting so I'd like to now is invite R

play23:12

to come up on stage with me hello sir so

play23:14

good to have you here so Renee first off

play23:18

in what kind of universe would you have

play23:19

ever thought that you'd see arm and

play23:21

Intel standing together but you we

play23:25

rapidly came to the realization that 80%

play23:27

of the way for tsmc runs has an armed

play23:30

device in them there is no way you can

play23:33

be in The Foundry Business Without A

play23:35

partnership with arm and I think you'd

play23:38

like to probably tell us about a few of

play23:39

them starting with perhaps the

play23:40

announcements you made this morning yeah

play23:42

well thank you for having me as you said

play23:44

this is a bit of strange bedfellows I

play23:46

was trying to think of a parallel that I

play23:47

might give relative the story and only

play23:50

thing I could kind of think of is when

play23:52

Walt Mossberg asked Steve Jobs what it

play23:55

was like to see iTunes run on Windows

play23:58

and I think he said it was like an ice

play24:00

waterer in hell but I won't go that far

play24:02

I won't go that far the announcements

play24:04

that we made earlier today was around

play24:07

our neoverse product line which is the

play24:09

product line that we use for the data

play24:11

center which has just been exploding it

play24:14

was in a very very high growth

play24:16

trajectory prior to the AI wave and now

play24:19

it's become even stronger the Nee V3

play24:22

that we announced today which is 50%

play24:24

faster than the neoverse N2 and then our

play24:27

N3 which is 20% faster but also much

play24:30

more efficient and when you think about

play24:32

these AI data centers which are pulling

play24:34

hundreds of megawatts and and more

play24:36

efficiency matters so yeah today was a

play24:38

big day for arm we're working on on on

play24:40

Cutting Edge technology when you talk

play24:41

about 18a and and system foundering the

play24:44

packaging this is uh the tip of the

play24:46

spear in terms of innovation and you

play24:48

guys have been terrific uh it has been

play24:50

an absolute joy to work with your groups

play24:53

the level of engineering engagement the

play24:54

depth of the technical discussions uh

play24:57

the information that we get uh we would

play24:59

not be able to announce the partnership

play25:01

that we've forged without it we talked a

play25:03

little bit about Faraday let's talk a

play25:04

little bit about what the world faray

play25:05

plays in neoverse and CSS and why what

play25:07

maybe to find for the a what is CSS and

play25:09

why is it so important for everybody

play25:11

here in the audience yeah so we

play25:12

announced uh a new strategy some months

play25:14

ago around what we call compute

play25:16

subsystems and the way to think about

play25:18

this is essentially rather than arm

play25:20

delivering blocks of Ip uh a mesh

play25:23

Network a memory controller the CPUs

play25:26

themselves we deliver a full subsystem

play25:29

fully verified completed that is if you

play25:31

want 64 cores 96 cores 128 cores for a

play25:34

CPU we deliver everything in terms of

play25:37

that system validated verified and it

play25:40

will work now one of the big benefits of

play25:42

this is simply the fact that time waits

play25:45

for no one the classic classic quote the

play25:48

amount of time it takes to design these

play25:49

s so's is really really hard and it's

play25:51

really really long if we're delivering

play25:54

final IP to a customer they still need

play25:56

to put all those pieces together if we

play25:58

can put all of that together for them

play26:00

prior at the same date they would have

play26:01

got the block of Ip that's a huge huge

play26:03

benefit and then when you add on to it

play26:05

the processing cycle times that are

play26:07

getting longer and longer I know you

play26:09

guys are doing your best but you know

play26:11

more euv steps means more complex time

play26:14

through the Fab and that just means that

play26:17

ultimately the processing times are long

play26:19

you have complex packaging you know that

play26:21

adds a lot of time so anything you can

play26:23

do on the front end to benefit the

play26:25

design time is is really beneficial so

play26:27

we announced this program called uh arm

play26:28

total design of Which Intel is a partner

play26:31

and in that model customers can come to

play26:33

their partners and work with those folks

play26:37

to get their design out and that's what

play26:38

Faraday is so Faraday is basically doing

play26:40

that they'll be able to put their IP

play26:42

together with our blocks and something

play26:44

that just end quote works and everyone

play26:46

wins the product's out faster it's

play26:47

compliant and it's going to work

play26:49

outstanding or Rene thank you for coming

play26:50

and joining us on today today pleasure

play26:52

totally appreciate the partnership and

play26:53

everything we're doing together

play26:54

everything we're going to do together

play26:56

thanks again thanks all

play26:57

[Music]

play26:59

so to finish out my talk I'd like to go

play27:02

back to where I started this is an ad

play27:04

rolled at the Super Bowl 1997 the year

play27:07

the Green Bay Packers beat the Patriots

play27:09

the halftime show was The Blues Brothers

play27:11

and James Brown and it was eight years

play27:13

after Taylor Swift was

play27:15

born I had to do it you can't associate

play27:17

superos without Taylor Swift and this

play27:20

commercial was

play27:21

iconic but you know things have changed

play27:24

a lot over the last several years and

play27:26

that change is only only going to

play27:28

accelerate as AI impacts your work your

play27:31

business your life how AI impacted the

play27:34

design cycle AI improves the capability

play27:38

for your engineers to do so much more

play27:40

with so much less effort so we decided

play27:43

to do with this commercial was take a

play27:45

generative AI view of it so this

play27:47

commercial no buy people were harmed we

play27:50

did 100% AI rendered it was done by very

play27:53

creative director Dave Clark out of Los

play27:55

Angeles and he's a big advocate of using

play27:58

AI tools not to take away creativity but

play28:02

to amplify creativity so as you leave

play28:05

our session today remember this that the

play28:08

only imitation to what we can do with AI

play28:12

is your imagination thank

play28:14

[Applause]

play28:16

you