Intel Announces Crazy Plan For AI Chip, That Changes Everything For Nvidia & AMD, 1000 Times Better

Summary

This video script revolves around Intel's ambitious plans to establish itself as a leading force in the AI era. It highlights Intel's goal to become the world's second-largest and most sustainable foundry, unveiling a roadmap with five nodes in four years and partnerships with tech giants like Microsoft and Arm. The script emphasizes Intel's focus on developing advanced packaging, cooling, and interconnect technologies to meet the soaring computational demands of AI. Key themes include resilient and sustainable supply chains, systems co-optimization, and harnessing AI's potential to drive innovation and reshape industries. The video aims to showcase Intel's commitment to pushing the boundaries of semiconductor technology for a future powered by artificial intelligence.

Takeaways

• 🔑 Intel is investing heavily in AI compute infrastructure (data centers, chips, etc.) to deliver the services and tools people want for a better future.
• 🌐 Intel aims to become the world's most sustainable and resilient foundry, enabling globally resilient and trusted supply chains for advanced semiconductors.
• 🚀 Intel announced an ambitious goal of delivering 5 new chip nodes in 4 years to regain process technology leadership.
• ⚡ Intel is embracing new transistor architectures and fabrication techniques like RibbonFET and PowerVia for improved performance and efficiency in the 'angstrom era'.
• 🤝 Intel announced new major customers like Microsoft for their 18A node, signaling a shift towards becoming a major foundry player.
• 📐 Intel is focused on developing a 'systems foundry' approach, optimizing entire systems (chips, packaging, cooling, interconnects, etc.) for AI workloads.
• 🧱 Intel is pioneering an advanced packaging technique called 'chiplets' to build powerful 'systems on chips' by combining smaller, more efficient tiles.
• ♻️ Intel recognizes the need for sustainable and energy-efficient AI computing solutions to combat the massive power demands projected for future AI workloads.
• 🤖 Intel is leveraging generative AI tools to amplify creativity and accelerate the design cycle for new chip architectures and products.
• 🔗 Intel announced a new partnership with Arm to co-invest and enable broader access to Arm's IP and design capabilities for Intel's foundry customers.

Q & A

What is the context or main topic of the transcript?

The transcript appears to be a presentation or speech by Intel executives discussing the company's strategies and plans for foundry services, advanced chip manufacturing, and AI capabilities.

What is Intel's goal regarding the number of chip manufacturing nodes in a specific timeframe?

Intel announced a goal of achieving five new chip manufacturing nodes in four years, which is described as an "unheard of" feat in the industry. This ambitious plan aims to help Intel regain process technology leadership.

What is the significance of Intel's 18A node, and what was mentioned about a customer for this node?

Intel's 18A node, part of the 'angstrom era' of chip manufacturing, was highlighted as a significant milestone. It was announced that Microsoft has chosen a chip design they plan to produce on Intel's 18A process, signifying a key customer for this advanced node.

What is the concept of a 'systems foundry' that Intel is pursuing?

Intel is positioning itself as a 'systems foundry,' which involves not just manufacturing chips but also offering advanced packaging, interconnect technologies, and systems-level integration to enable complex AI and high-performance computing solutions.

What are some of the challenges and considerations mentioned regarding the growth of AI and its computational demands?

The transcript highlights the rapidly increasing computational demands of AI, with estimates suggesting that AI could soon require as much electricity as an entire country. Addressing power efficiency, cooling solutions, memory bandwidth, and interconnect technologies are crucial to enable cost-effective and scalable AI deployments.

What is the concept of 'systems of chips' that Intel is pursuing, and why is it important?

Intel is focusing on the concept of 'systems of chips,' which involves integrating multiple chiplets or tiles into a single package, enabling more flexibility, better thermal management, and optimized designs for specific AI workloads. This approach is necessary to handle the massive computational demands of AI training and inference.

What was mentioned about Intel's partnership with Arm?

Intel announced a new partnership with Arm, involving co-investments, joint programs, and providing design education and IP access to Arm customers. This collaboration aims to fuel innovation and address the growing demands of the AI era.

What was the significance of the AI-rendered commercial shown at the end of the presentation?

The AI-rendered commercial was presented as an example of how generative AI can be used not to replace human creativity but to amplify and enhance it. It was meant to showcase the potential of AI tools in the creative process.

What was mentioned about the resilience and sustainability of chip manufacturing supply chains?

The presentation highlighted the need for globally resilient, sustainable, and trusted supply chains for chip manufacturing. Intel aims to become the world's most sustainable and resilient foundry, addressing the concentration of semiconductor production in certain regions and the need for diversified supply chains.

What was the significance of the argon National Labs supercomputer mentioned in the presentation?

The argon National Labs supercomputer, built in partnership with HP and utilizing Intel's data center GPUs, was presented as an example of the massive computational power required for advanced scientific simulations and modeling. It showcased the scale and complexity of systems needed for cutting-edge AI and high-performance computing applications.

Outlines

00:00

🤖 Unveiling the Era of Artificial Intelligence Investment

This paragraph discusses the significance of investing heavily in AI, compute, energy, and data centers to deliver the services and tools that will create better futures. It emphasizes that this worldwide investment aims to support various efforts, people, and the entire infrastructure stack surrounding AI, not just chips alone.

05:01

🔮 The Transformative Power of AI and Tech Optimism

Here, the speaker expresses optimism about AI, describing it as one of the greatest tools ever invented. They suggest that AI will enable humans to invent astonishing new things, making the future better by providing more abundant and cheaper intelligence that surpasses human capabilities.

10:02

⚠️ Addressing Concerns about AI and Embracing Iterative Deployment

This paragraph acknowledges the valid concerns people have about AI, considering it an extraordinarily powerful technology that will reshape significant aspects of our lives, work, and economy. The strategy of iterative deployment is highlighted, where AI is introduced early to allow for adaptation, input, and preparation for the magnitude of change that will come over time.

15:05

🌐 Building Resilient, Sustainable, and Trusted Global Supply Chains

The focus here is on the need for globally resilient, sustainable, and trusted supply chains, as Moore's Law continues to drive innovation. It discusses the current concentration of semiconductor manufacturing in Asia and the importance of diversifying supply chains across regions. The paragraph also emphasizes the fusion of silicon and the economy, and the relentless pursuit of more efficient, capable, and scalable computing.

20:06

🚀 Accelerating Process Technology Leadership and Roadmap

This paragraph outlines Intel's ambitious plan to deliver five process nodes in four years, aiming to regain process technology leadership. It provides updates on the progress of various nodes, including Intel 7, Intel 4, Intel 3, and the upcoming angstrom era with Intel 20A and Intel 18A. It also mentions new partnerships, like with Microsoft for 18A, and the introduction of enhanced nodes like Intel 14A, 16E, and more.

25:08

🎥 AI-Rendered Commercial: The Future of Creativity

The final paragraph describes an AI-rendered commercial inspired by an iconic 1997 Intel ad. It emphasizes the transformative impact of AI on design cycles and the ability of engineers to achieve more with less effort. The commercial, created using generative AI, showcases how AI can amplify creativity rather than replace it, with the only limitation being human imagination.

Keywords

💡AI

AI, or Artificial Intelligence, refers to the development of computer systems capable of performing tasks that typically require human intelligence, such as learning, reasoning, and decision-making. In the context of this video, AI is presented as a transformative technology that will reshape significant aspects of how we live, work, and operate economically. The speaker emphasizes the importance of investing in AI compute, energy, and data centers to deliver the services and tools that people will increasingly value and rely on. AI is described as 'one of the greatest tools humans have yet invented,' enabling us to 'invent new things for each other that astonish us.'

💡Moore's Law

Moore's Law is the observation made by Gordon Moore, the co-founder of Intel, that the number of transistors on a microchip doubles approximately every two years, leading to a steady increase in computing power and capabilities. The video mentions that 'Moore's Law is alive and well until the periodic table is exhausted,' suggesting that despite the challenges of scaling down transistor sizes, innovative approaches like creating new molecules and bending physics will keep Moore's Law and the advancement of computing power going. This is crucial for supporting the growing demands of AI and other emerging technologies.

💡Foundry

A foundry, in the context of semiconductors, is a manufacturing facility that produces integrated circuits (chips) for other companies. The video discusses Intel's vision of becoming the world's second-largest foundry, offering foundry services to customers. This involves providing advanced manufacturing capabilities, including process technologies, packaging, and assembly services. The speaker highlights Intel's goal of becoming 'the world's most sustainable and resilient foundry,' with a focus on enabling globally resilient and trusted supply chains. This is presented as a crucial aspect of supporting the rapidly growing demands of the AI era.

💡Supply Chain Resilience

Supply chain resilience refers to the ability of a supply chain to withstand and quickly recover from disruptions, such as natural disasters, geopolitical tensions, or economic downturns. In the video, the speaker emphasizes the need for resilient and sustainable supply chains, particularly in the semiconductor industry. They highlight the current concentration of semiconductor manufacturing in a small area of Asia, which poses risks, and advocate for a more diversified and resilient global supply chain. Intel's vision of becoming the world's most resilient foundry is presented as a solution to address this issue and ensure reliable access to critical technology supply chains.

💡Systems Foundry

The concept of a 'systems foundry' is introduced in the video as a more comprehensive approach to foundry services. It involves not only manufacturing individual chips but also providing solutions for integrating multiple chips into complex systems. This includes advanced packaging technologies, interconnect standards, and co-optimization of software, system architecture, memory, and interconnects. The speaker argues that in the AI era, monolithic chip designs are no longer sufficient, and a systems-level approach is required to coordinate the activities of thousands or millions of CPUs working in concert. Intel's vision is to become a 'systems foundry,' offering these comprehensive system-level solutions to customers.

💡Chipl ets

Chiplets, or chip-level integration, is a packaging technology that involves combining multiple smaller chips (or 'tiles') into a single package. This approach addresses the challenges of building increasingly larger monolithic chips, such as thermal constraints and manufacturing costs. The video discusses Intel's use of chiplets in products like the Ponte Vecchio (or Intel Data Center GPU Max Series), which integrates dozens of chiplet tiles from multiple suppliers into a single package. Chiplets are presented as a key enabler for building the 'systems of chips' required for AI workloads, allowing for optimized trade-offs between performance, power, area, and cost.

💡Iterative Deployment

Iterative deployment is a strategy mentioned in the video for introducing AI technologies into the world gradually, allowing for adaptation, feedback, and preparation for the magnitude of change that will come over time. The speaker suggests that by putting these technologies out early, people can adapt, think, and provide input, enabling readiness for the significant transformations that AI will bring. This iterative approach is presented as part of Intel's strategy, recognizing the profound impact that AI will have on various aspects of life and work.

💡Energy Efficiency

Energy efficiency is a critical concern highlighted in the video, particularly in the context of the growing energy demands of AI systems. The speaker cites an estimate that AI could soon require as much electricity as an entire country, such as Sweden, the Netherlands, or Argentina. With the potential need for millions of CPUs for training AI models, the video emphasizes the importance of finding ways to make AI more energy-efficient and cost-effective. This includes exploring technologies like immersion cooling, on-chip memory integration, and improved interconnects and networking technologies. Addressing energy efficiency is presented as a key challenge that Intel and its foundry partners must tackle to enable the widespread adoption of AI.

💡Generative AI

Generative AI refers to artificial intelligence systems capable of generating new content, such as text, images, audio, or video, based on the data they have been trained on. In the video, the speaker showcases an AI-rendered commercial, created entirely using generative AI tools. This example is used to illustrate how AI can amplify human creativity and imagination, rather than replace it. The speaker suggests that 'the only limitation to what we can do with AI is your imagination,' highlighting the transformative potential of generative AI technologies.

💡Sustainability

Sustainability is a recurring theme in the video, particularly in the context of Intel's foundry vision. The speaker emphasizes the goal of becoming 'the world's most sustainable foundry,' recognizing the environmental impact of semiconductor manufacturing and the need for more eco-friendly practices. This includes efforts to enable globally resilient and trusted supply chains, reducing reliance on concentrated manufacturing regions, and exploring technologies that improve energy efficiency and reduce resource consumption. Sustainability is presented as a critical consideration alongside technological advancements, reflecting the need to balance innovation with responsible stewardship of the planet's resources.

Highlights

Intel's strategy to invest heavily in AI compute, energy, and data centers to deliver services and tools that create better futures.

Intel's view that AI will be one of the greatest tools invented, enabling humans to create astonishing new things through abundant, cheaper intelligence.

Intel's approach of "iterative deployment" to put AI out early for people to adapt and provide input on the magnitude of change coming.

Intel's goal to become the world's most sustainable and resilient foundry, with globally resilient and trusted supply chains.

Intel's announcement of achieving 5 nodes in 4 years to return to process technology leadership, with Intel 7, 4, and 3 already shipping or certified.

Intel's introduction of the angstrom era with Intel 20A and 18A, featuring new transistor structures and power delivery technologies.

Microsoft's commitment to work with Intel Foundry Services on its 18A process for high-performance, high-quality semiconductors.

Intel's announcement of Intel 14A and extensions like 16E, filling out its node roadmap for customer needs.

Intel's advanced packaging capabilities, including organic and glass-based packages for direct optical interfacing.

Intel's collaboration with AI leaders as packaging customers, highlighting the importance of advanced packaging for the AI era.

Intel's vision of becoming a systems foundry, enabling systems thinking and co-optimization across the entire stack.

Intel's approach to "systems of chips," combining smaller tiles on advanced nodes for better yields, flexibility, and optimization.

Intel's use of singulated die testing and high assembly test yields in its Ponte Vecchio GPU, showcasing its chiplet integration capabilities.

Intel's partnership with Arm to co-invest, provide design education, and offer IP and shuttle services at scale.

Intel's AI-rendered commercial showcasing its commitment to using AI to amplify creativity and push the boundaries of what's possible.

Transcripts

you know the first one is seven trillion

what's this all about anyway look uh as

as I'm sure you all know you shouldn't

believe everything you read in the Press

really we do think the the kernel of

Truth is that we do think that

uh investing a lot of money in AI

compute energy data centers is going to

be important to deliver the the amount

of services people want and the tools

that we all are going to really I think

get a huge amount of value out of to

help create better Futures mhm so

there's a lot of investment to be made

here I think so but it's across a lot of

stuff it's not I mean it's a this is

like a worldwide investment to help many

many different efforts many different

people and not just chips of course but

sort of the whole infrastructure stack

around it okay second question you and I

are both Tech optimists a little bit so

why should we be Tech optimists about

AI uh I mean I think this is going to be

one of the greatest tools humans have

yet invented if if you think about what

we can do with more intelligence

available to us more abundant

intelligence cheaper prices things that

humans on their own are not capable of

uh we will all be able to invent new

things for each other that astonish us

that's how the future gets better that's

great yeah yeah making things more

intelligent I like it when you say that

uh third question uh you know our

founder Andy Gro famously said the

paranoid survive right paranoid about

yourself your success but also paranoid

about competition and things that could

go wrong and there are those who are a

little bit par annoyed about AI today

what do you say to them I think people

are right to

be cautious about AI uh I think that

this

is I think this is going to be an

extraordinarily powerful technology I

think it's going to reshape significant

parts of the way we live and work and

that our economy runs and part of our

strategy what we call iterative

deployment is that we want to put these

things out into the world early so that

people can adapt and think and provide

inp put and that uh we can be ready for

the magnitude of change that will come

over time so I think that's great Mo's

law alive and well until the periodic

table is exhausted we are not done with

Mo's law we Bend physics we create

molecules we do amazing things and

Moore's Law is alive and well but we

have to do it a different way we have to

enable globally resilient sustainable

and trusted Supply chains and at the end

of our conference today I'm joined by

Sam Alman and he's going to challenge

the capacity needs of the industry and

the system of chips needs new

capabilities new test Advance and

packaging capabilities and that's what a

systems Foundry does and as we describe

this Vision to become the number two

Foundry of the world we realize there's

only a few companies that can do this

that have the capital capacity that have

the R&D the longevity to go do this and

now as we're in an economic downturn ah

welcome to semiconductors and then the

AI explosion and the cyclicality of the

industry and we've seen the Geo

instability and active Wars in Israel

and Ukraine and the tensions and Taiwan

Straits this is anything but a resilient

supply chain today and for that we get

to be a large meaningful the second

largest Foundry but become the world's

most sustainable Foundry the world's

most resilient Foundry because that's

exactly what the world requires

but stunningly you know in 1990 80% of

the semiconductors are built in us and

Europe today 80% in a small concentrated

area in Asia you know we've seen this

long steady decline right in terms of

our supply chains for the world nothing

should be reliant on a single port a

single country a single place in the

world we need resilience a resilient

access to supply chains and capacity in

the right region at the right time and

thus the choice the opportunity to drive

systemic change in where and how we

drive the most important aspect of our

future where the technology Supply

chains are what aspect of your life is

not becoming more

digital well everything is your health

care your financial your social and with

that we simply call it silicon silicon

and the economy becoming fused together

in an inextricable way and as stewards

of more law we see this Relentless

pursuit of more efficient more capable

more scalable Computing and for that

we've been on this journey we also

announced that we're going to get five

nodes in four years we're going to do

something unheard of in the industry to

return Intel to process technology

leadership and while we're not finished

today we see the end is soon in front of

us on that journey and Intel 7 shipping

and ramping in volume Intel 4 with our

cor ultr launch shipping and ramping and

volume Intel 3 is production certified

and will'll be with our server products

launching in the first half of the Year

going into volume production so with

this we've gone on an incredible journey

but then it continues into what we call

the angstrom era and for this Intel 20a

and Intel 18a the adoption of ribbon fed

a new transistor structure of power via

power delivery technology the Embrace of

the first major new transistor re

architecting since 12 this is a Mona

Lisa no no this is a rembrand no no no I

think it's a Michelangelo right sculpted

in Silicon right forward these truly are

works of art and I am thrilled for the

progress and with that the finishes 18a

we've already sent into Fab our first

18a products and this is a test tiip for

Clearwater Forest so I'm thrilled this

is what we call a family photo so kids

come to Papa here we go five nodes in

four

years and I do want to announce describe

and give a moment to our latest newest

18a customer my decades long friend

Sacha Nadella speaking for Microsoft as

the newest 18a customers let's hear from

Sacha now thank you so much Pat it's

great to join you at your launch event

it's clear that we are in the midst of a

very exciting platform shift that'll

fundamentally transform productivity for

every individual organization

in the entire industry uh to achieve

this Vision we will need a reliable

supply of the most advanced high

performance and high quality

semiconductors and all of us at

Microsoft are committed to supporting

Intel's efforts to build a strong supply

chain right here in the United States

that's why we're so excited to work with

Intel Foundry services and why we have

chosen a chip design that we plan to

produce on Intel's 18a process uh we

look forward to sharing more details in

the future and I can't wait to see all

that we will be delivering together for

our customers in the years ahead thank

you so very much thank you Sacha so can

I tell you more about what comes after

18a today we're announcing that we're

extending these nodes we're adding major

and minor uh nodes to it a combination

of older and Leading Edge nodes to

ensure our customers have access to the

process technology they need today we

are announcing Intel 14a for the first

time you think about this like four 1.4

Nan meter technology but Intel

14a venturing deeply into the angstrom

era 14a first

processes but we're also announcing that

we're extending our nodes as you see on

here adding P nodes enhancements to

those existing adding performance

capabilities adding T nodes uh through

silicon via new feature enhancements

with e noes on the road map filling out

that road map of capability today we're

announcing for the first time Intel 16e

enhancements to our Intel 16 technology

as well so we're filling out that full

set of nodes in the road map that we

have to go beyond it but as we've seen

as we've gone through this period of

time this AI era explosion Wafers are

cool packaging has gotten to be really

cool so Intel Foundry offers a a broad

set now of advanced assembly and test uh

Technologies Intel 25 5 years ago drove

the standardization of organic packages

now we're driving the next generation of

glass based packages and with that the

ability to directly interface with

Optics and wave guides directly into the

package construct for the most advanced

system capabilities as well you know an

Intel Foundry has added a number of

additional AI customers to our portfolio

of packaging offerings as well AI era

needs Advanced Wafers but it even needs

more more systems and packaging

capabilities an area that Intel is the

clear leader in and this now includes as

customer some of the largest AI leaders

in the world as I conclude my time on

stage today is a day three years in the

making and I couldn't be prouder of the

team at Intel that is rallying behind

this rebuilding of this iconic company

and you're going to hear from a number

of those leaders today bringing together

the world's first system Foundry

capabilities for the AI era and with

that it's my pleasure to introduce to

the stage a friend for decades now and

the zealous leader of our Foundry

Services none other than Stu pan please

welcome

St our people can sense and feel this

momentum you can hear it in their voices

you can see it in their actions they

know that you don't need to be in Taiwan

to build the world's most advanced

semiconductors

theyve realized this five NOS in four

years this audacious goal that Pat laid

out you can see the check marks across

all the boxes here we're ready to earn

the right to be your Foundry supplier

nobody's going to give us that we want

to earn it so that's one perspective I

want to offer up a second

perspective and this comes from Chris

Miller the author of the book Chip War

this is a New York Times bestseller fin

Financial Times book of the Year took

Chris 10 years to write it now Chris in

a speech in October said this quote to

the employees said quotequote Intel is

the most important company of the last

50 years so I called Chris I said are

you okay if I say this publicly said

yeah okay go ahead good publicity for

the book I came back to Intel 3 months

after pat did because I believe this

quote to be true and I believed it long

before Chris said it and what you're

going to hear in the next 40 minutes or

so is all the reasons why Chip War

season 2 is about to begin so let's

start from the

beginning Gordon's original paper was

called cramming more components on

integrated circuits it was published in

1965 every time I read it I'm stunned by

how pressing he was in the last section

of the paper Gordon remarks we come to a

Day of

Reckoning quote unquote it may prove to

be more economical to build large

systems out of smaller functions which

are separately packaged and

interconnected and this is why I believe

we're in the area of the systems Foundry

you can no longer do just monolithic

devices you have to break it up you have

to adjust for thermal profiles you have

to address costs you have to have

flexibility and this is all driving a

new level of systems thinking Into The

Foundry business in this systems era you

not only have to have Open Standards

between devices you have to have

standards on the device think about the

fact of to do a training Model A Day

requires 100,000 CPUs all Running in

concert all in the same data set the

next round of training models will

require a million CPUs that's something

that requires standards everywhere from

chips inside to chips outside this is

what's necessary for our customers

succeed and this is the fundamental

reason why Intel is a systems company

turning into a Foundry not the other way

around so now that we described system

thinking let's look at how the original

Foundry mod was created now since CC way

has been kind enough to mention Us in

his last few earnings calls I thought to

return the favor and talk about tsmc in

my presentation now this was a

presentation that Morris chain gave at M

MIT last October and in it he describes

The Foundry model he says it's research

development it's waer fabrication it's

Advanced

packaging and he says in the red line

that's what tsmc does and he said in the

blue line Intel everybody else does

everything else you might even call that

an IDM 1.0 kind of manufacturer now tsmc

has been incredibly successful with this

model discipline execution discipline

strategy consistent Innovation but to

quote Bob Dylan The Times They are

changing let me tell you

why this there's an idea of Systems

Technology co-optimization where you

look at application workload Software

System architecture memory interconnect

all these different things what happens

today is people focus on their layer and

maybe the layer up on top of it in fact

this is really what a class Foundry does

today but we're now in the realm of the

exponential Sam alman's going to come

out later on this afternoon and talk

about he doesn't have enough capacity to

do what he wants to do you have to look

at all of these combinations you can get

a couple of things right but to do a

system that coordinates the activities

of solving a training model across

100,000 CPUs requires you to get all the

gear ratios right if you're mismatched

in memory if you're mismatched in

networking you wind up throwing away

valuable cycles and valuable resources

so we got to get 100x more out of what

we're doing so we described the

evolution now let's build out the

strategy and talk about what's the

revolution in all

this we like to think about this in

three basic

layers first off we have to be a

worldclass foundary right Rowan Chen the

COO of Qualcomm talks about the fact

that silicon speaks and silicon speaks

in four different ways performance power

area and cost without that you're not in

the business the next layer of the

pyramid is all about resilient

sustainable Supply this need to have

capability around the world to build

this and to build it in a sustainable

fashion the top layer of the permid is

this idea of systems of chips we're

putting system inside a chip and we're

working with our Foundry Partners to

create systems of chips so let's walk

you through what that means now I talked

earlier about this Day of Reckoning what

that means it's happening now we can no

longer do designs at a monolithic level

we are now at retical limited designs

die sizes that are 800 square millim of

silicon because we have to move Beyond

Ral limits and thermal constraints and

by the even cost constraints because

when you're building these really big

die sizes they're really expensive isn't

there a better way to take advantage as

Pat talked about to take smaller tiles

on the more advanced noes get better

yields out them package them together

have more flexibility to do all that

really requires if you will a system am

of Chip so you can see in the animation

here how we build it out and this is

literally how we're going to build out

in the factory the idea of a substrate

the idea of Bas dieses the idea of logic

tiles the idea of IO tiles on the side

why do this it gives our customers the

ability to optimally trade for what they

need for their design the things that

you do for a training engine will be

different than what you do for an

inference engine and only by having all

these levers to go pull can you get this

done we learned a lot through a device

called ponovo or as The Branding people

call Intel data center GPU Max series

it's ANC it's 100 billion transistor s

so it's dozens of chiplet tiles 47 of

them it's multiple suppliers by the way

we coexist with tsmc in the same package

right we develop testing techniques to

go off and do that we do this idea of

singulated die test what does that mean

it means every single die that goes into

that package is a known good die why is

that important because you want every

one of them to be good the assembly test

shield on this device is 95% plus it is

the Super Bowl of integrated design now

what do you do with it well if you're

argon National Labs and our partners at

HP you build a really big supercomputer

and they build a computer that with

66,000 Pacos 20,000 Sapphire Rapids and

it looks like

this okay what do you do with something

like that well you solve some really

hard science problems if you want to

model the air flow across a wing you can

do that on a workstation if you want to

model the airf flow across a plane you

do it on this if you want to model

Fusion reactions which are pretty tricky

things to model you do it on a device

like this if you want to model if you

want to model cancer curing drugs at the

molecular level you do it like

this it's 600 tons of compute

it's four tennis courts it is the weight

of an

Airbus it has 300 Mi of optical cable it

takes 34,000 gallons a minute to Cool by

the way your faucet at home it's a

gallon a minute 34,000 gallons a minute

so when we talk about how to design this

stuff we have to find ways to make this

more power efficient to make this more

cost effective this today is the second

fastest super computer in the world by

the way at 100,000 CPUs roughly to

handle the demands of AI we're going to

go far beyond that and that's why this

idea of scalability is so

important now let's go through the top

of the pyramid this idea of systems of

Chip systems of Chip require as Pat

mentioned great packaging technology

we've created standard called U which

allows chipto chip connectivity think of

it as the PCI Express of what we did

back in the mid 90s this idea that you

can add mix and match by the way you can

mix and match different Foundry

suppliers we like that because we're

sort of an underdog in all this some of

our competitors not so much

but our customers want this kind of

flexibility so as you can see from the

rendering what we're doing is

taking systems on a

chip and Building Systems of chips why

do you need systems of chips because

it's the same problem I mentioned

earlier you need to train models with

100,000 CPUs now and a million

potentially down the road and then maybe

up to 10 million when you're moving a

coordinating data across all of these

devices is you need to have standards

and connectivity and that's what we

provide and really when you think about

it what is what's it going to take to

bring AI everywhere how do you make it

cost effective how do you make it

capital efficient yes you I know Sam's

asking for trillions but we want to make

sure he's spending all that money in the

most cost-effective manner possible so

let's break that

out you have data center chips doubling

year on-ear but the efficiency needs are

the things that are really eye-catching

New York times ran an article that AI

could soon need as much electricity as

an entire country so I'm sure you're

curious like which countries Sweden the

Netherlands Argentina if you were to run

all of the AI servers that market

estimates have on dgx 2 dx100 those kind

of devices you would take 85 to 134

terawatt hours terawatt hours by the way

the great state of California its entire

power generation capability today is 30

tatt hours for the entire state state so

bringing AI everywhere is going to

require us and our Foundry Partners to

figure out how to do this cost

effectively this is what this road map

is going to take and this I think is

what makes us different than other

Foundry approaches you have to start off

across first off with table sticks as I

mentioned you have to start off with a

great process add to that packaging

which is We Believe unique D for us why

we build a lot of server parts and we're

taking everything that we learn from our

server business and offering up to our

Foundry Partners these are table stakes

and this is what it takes to be a

Foundry player we have this planned out

literally across all these dimensions

for the next 5 years let's talk about

cooling I mentioned that that argon

needs 34,000 gallons a minute to cool it

off the next wave of devices are going

to have to be immersion cooled and today

Intel Zeon product line is the only

product that offers an immersion cooling

warranty emersion cooling allows us to

deliver power much more effectively in a

data center we're going to take what

we've learned there and we're going to

offer that up to our Foundry customers

so that when we start looking at 2,000

watt devices 5 years from now we're

going to have a way to cool those memory

how do perhaps do we put memory on the

device itself so it's more

computationally cost effective and over

the next 5 years you're going to hear us

talk a lot about new technologies and

new ways to increase memory bandwidth

why decreasing the need for energy

consumption a 5-year kind of

look

interconnects interconnects between

chips the idea of having highp speed

certies highspeed interconnect all the

things that you expect from a Foundry

provider is what we're going to give you

and we're going to plan out for just

what's out there today keep in mind as a

standards company we do this across all

different standards and it's our job to

make those standards available to all of

you and last you know networking think

about a net card that's capable of hand

handing demands of AI modeling what you

do with ethernet today isn't good enough

so working closely with a number of

ethernet standards Partners to figure

out ways how do we make ethernet more

capable to develop the idea of systems

of chips and ethernet provides that

lowcost high bandwidth potential to go

off and do that add to that fonics add

to that Technologies beyond that here

again it's another five-year road map

this morning we're announcing a new

partnership with arm merging business

initiative how do we take advantage of

all the programs that Army has to offer

to bring design capability design

education out to all of their customers

we're doing this with arm we will make

co-investments we'll do joint programs

we'll provide shuttles at scale arm will

provide IP at scale and this is how

we're going to fuel this next wave of

innovation and it's truly exciting so

I'd like you now is invite R to come up

on stage with me hello sir so good to

have you here so Renee first off

in what kind of universe would You' have

ever thought that you'd see arm and

Intel standing together but you we

rapidly came to the realization that 80%

of the Wafers tsmc runs has an armed

device in them there is no way you can

be in The Foundry Business Without A

partnership with arm and I think you'd

like to probably tell us about a few of

them starting with perhaps the

announcements you made this morning yeah

well thank you for having me as you said

this is a bit of strange bed fellows I

was trying to think of a par that I

might give relative the story and only

thing I can kind of think of is when

Walt Mossberg asked Steve Jobs what it

was like to see iTunes run on

Windows and I think he said it was like

an ice waterer in hell but I won't go

that far I won't go that far the

announcements that we made earlier today

was around our neoverse product line

which is the product line that we use

for the data center which has just been

exploding it was in a very very high

growth trajectory

prior to the AI wave and now it's become

even stronger the neoverse V3 that we

announced today which is 50% faster than

the neoverse N2 and then our N3 neoverse

which is 20% faster but also much more

efficient and when you think about these

AI data centers which are pulling

hundreds of megawatts and and more

efficiency matters so yeah today was a

big day for arm we're working on on on

Cutting Edge technology when you talk

about 18a and and system foundering the

packaging this is uh the tip of the

spear in terms of innovation and you

guys have been terrific uh it has been

an absolute joy to work with your groups

the level of engineering engagement the

depth of the technical discussions uh

the information that we get uh we would

not be able to announce the partnership

that we've forged without it we talked a

little bit about faay let talk a little

bit about what the role faray plays in

newe and CSS and why what maybe Define

for the audence what is CSS and why is

it so important for everybody here in

the audience yeah so we announced uh a

new strategy some months ago around what

we call compute subsystems

and the way to think about this is

essentially rather than arm delivering

blocks of Ip uh a mesh Network a memory

controller the CPUs themselves we

deliver a full subsystem fully verified

completed that is if you want 64 cores

96 cores 128 cores for a CPU we deliver

everything in terms of that system

validated verified and it will work now

one of the big benefits of this is

simply the fact that time waits for no

one the classic a quote the amount of

time it takes to design these s soc's is

really really hard and it's really

really long if we're delivering final IP

to a customer they still need to put all

those pieces together if we can put all

of that together for them prior at the

same date they would have got the block

of Ip that's a huge huge benefit and

then when you add on to it the

processing cycle times that are getting

longer and longer I know you guys are

doing your best but you know more euv

steps means more complex time through

the Fab and that just means that

ultimately the processing times are long

you have complex packaging you know that

adds a lot of time so anything you can

do on the front end to benefit the

design time is is really beneficial so

we announced this program called uh arm

total design of Which Intel is a partner

and in that model customers can come to

their partners and work with those folks

to get their design out and that's what

Faraday is so Faraday is basically doing

that they'll be able to put their IP

together with our blocks and something

that just end quote works and everyone

wins the products out fast

it's compliant and it's going to work

outstanding or Rene thank you for coming

and joining us on stage today pleasure

totally appreciate the partnership and

everything we're doing together

everything we're going to do together

thanks again thanks

all so to finish out my talk I'd like to

go back to where I started this is an ad

rolled at the Super Bowl 1997 the year

the Green Bay Packers beat the Patriots

the halftime show was The Blues Brothers

and James Brown and it was eight years

after Taylor Swift was

born I had to do you can't associate

superos without Taylor swi and this

commercial was

iconic but you know things have changed

a lot over the last several years and

that change is only going to accelerate

as AI impacts your work your business

your life how ai's impacted the design

cycle how AI improves the capability for

your engineers to do so much more with

so much less effort so we decided to do

with this commercial was take a

generative AI view of it

so this commercial no buy people were

harmed we did 100% AI rendered it was

done by very creative director Dave

Clark out of Los Angeles and he's a big

advocate of using AI tools not to take

away creativity but to amplify

creativity so as you leave our session

today remember this that the only

imitation to what we can do with AI is

your imagination thank you