NVIDIA CEO Jensen Huang Reveals Keys to AI, Leadership

Columbia Business School
16 Oct 202362:45

Summary

TLDRJensen Huang, co-founder and CEO of NVIDIA, chronicles the company's 30-year journey pioneering accelerated computing to solve complex problems. He outlines NVIDIA's strategy focusing on challenging technical domains rather than commodity markets to attract exceptional talent. Huang forecasts AI driving tremendous productivity growth across industries. He advocates maximizing education, citing insatiable curiosity as the wellspring of innovation. Ultimately, with compassion and wisdom, Huang concludes that realizing humanity's potential requires transcending geopolitical differences through mutual understanding.

Takeaways

  • 👌 Jensen Wong co-founded Nvidia over 30 years ago and has led its transformation into a leader in graphics processing and AI.
  • 👍 Accelerated computing focuses on specialized hardware/software to accelerate key applications rather than general purpose computing.
  • 📈 Nvidia rode the waves from gaming to crypto mining to AI computing through strategic adaptations while retaining focus on accelerated computing.
  • 💰 Investing in AI computing infrastructure generates value - it takes raw data as input and produces intelligent tokens as output.
  • 😎 To build something special, work on problems nobody else has solved rather than competing directly.
  • 🤝 Nvidia collaborates with all major cloud/hardware providers by providing a flexible accelerated computing platform.
  • 🔬 AI will unlock huge advances - from protein engineering to automated design - not take away jobs.
  • 📚 Stay in school and keep learning - statistically the best path to success.
  • ✨ As a CEO, lead with strong character and strategic thinking.
  • 😀 The passion and expertise for the company's key craft should be embodied in its leadership.

Q & A

  • How did Nvidia get its start and what was the original vision?

    -Nvidia was founded in 1993 to pursue accelerated computing - the idea of specialized hardware and software accelerating key applications rather than relying solely on general purpose computing. The initial application targeted was 3D graphics for video gaming.

  • How has Nvidia navigated major technology shifts over its history?

    -Through sustained focus on accelerated computing, Nvidia has successfully rode waves from gaming to crypto mining and now AI. It has continued to adapt its strategy while retaining its core advantage in specialized parallel processing.

  • How does accelerated computing help drive advances in AI?

    -Accelerated computing infrastructure like Nvidia GPU clusters allows AI models to be trained on vastly larger datasets. This has enabled breakthroughs like large language models that were previously not computationally feasible.

  • Does AI represent a threat in terms of eliminating jobs?

    -No, AI will drive major productivity advances and create new opportunities. Organizations that utilize AI well will grow faster. The key is having ideas and opportunities to productively invest the benefits rather than resort to layoffs.

  • What is the best path to success in business?

    -Statistically, staying in school as long as possible to deeply learn gives the best foundation. But there are also many entrepreneurs without formal education who succeed through grit and learning on the job.

  • What are the most critical capabilities for a CEO?

    -A CEO needs strong character to guide the difficult choices companies face. Additionally, top CEOs have superior strategic thinking abilities - anticipating trends, making connections and mobilizing action better than peers.

  • How does Nvidia balance collaboration and differentiation?

    -Nvidia provides an accelerated computing platform that technical partners can build on top of flexibly. This expands Nvidia's reach tremendously while the core specialty in accelerated computing remains its key advantage.

  • Where will AI drive the biggest advances in the near future?

    -AI will unlock major advances in domains like protein engineering, automated design and language interfaces. It represents a general purpose capability to transfer learning across modalities.

  • How has Nvidia cultivated its culture of innovation?

    -By tackling extremely difficult problems at the cutting edge, Nvidia has attracted world-class talent driven to push boundaries and create new capabilities previously unimagined.

  • What does Jensen see as the next platform beyond accelerated computing?

    -There likely won't be a singular next platform. As needs emerge, additional specialized co-processors will augment CPU + accelerated computing as the appetite for more complex applications continues rising over time.

Outlines

00:00

🎓 Introduction by the hosts

The hosts William McLain and Rpneit introduce the event and speakers - Jensen Huang the CEO of Nvidia and Rpneit the Dean of Columbia Business School. They talk about Jensen's background and achievements in building Nvidia into a leading company in graphics processing and now artificial intelligence.

05:07

🏙 Nvidia's founding story and early focus on gaming

Jensen describes how Nvidia was founded in 1993 with the idea of specialized 'accelerated computing' focused on 3D graphics for video games. He acknowledges this was an unlikely idea at the time with many challenges, but they were able to get funding and make it work, establishing gaming as their first 'killer app'.

10:07

⛏️ The crypto mining chapter

Rpneit asks about the period when crypto mining became a big application for Nvidia GPUs. Jensen explains how the parallel processing capabilities of GPUs were very useful for crypto mining algorithms like Bitcoin and Ethereum. This opened up new possibilities for 'mining' digital assets.

15:08

🧠 AI and neural networks

Jensen discusses how GPUs are powerful for training neural networks and AI models given their ability to process huge datasets in parallel. He emphasizes that building the infrastructure for AI does not have to be expensive.

20:08

⛓ Supply chain and manufacturing

In response to Rpneit's question, Jensen explains why Nvidia chooses not to manufacture its own chips. He states their priority is creating an environment to attract talented people by working on hard, unsolved problems - not competing for market share in commodity businesses.

25:12

🤖 The future of AI

Jensen shares his optimism about AI not taking away jobs but empowering people who use it. He predicts huge advances in areas like protein engineering. Overall he emphasizes that AI will transform productivity and capabilities across many domains.

30:14

🧑‍💻 Nvidia's platform strategy

Jensen elaborates on Nvidia's platform strategy - creating software, algorithms and architecture to accelerate applications across many domains, while collaborating widely rather than being a fully integrated vertical company.

35:14

🔀 Training AI models

Jensen gives details about how deep learning works by compressing huge datasets into compact neural network models. He notes the scale of computation required but emphasizes that it is quite affordable given Nvidia's business.

40:14

🚀 The future of generative AI

Jensen talks about groundbreaking techniques like word2vec that learn vector representations capturing semantics. This will enable generative applications like translating between modalities (text, images, video).

45:16

🌱 Biotech revolution with proteins

Jensen predicts one of the most impactful AI applications will be engineering proteins and enzymes for goals like bioremediation and agriculture. He positions this generation to lead a revolution in protein engineering.

50:18

📈 Moore's Law and innovating on computing

In response to an audience question, Jensen explains why Moore's Law is slowing while accelerated computing offers a path to continue rapidly innovating. He emphasizes focussing on solving problems rather than attachment to any specific computing tool.

55:18

🌎 Geopolitics and globalization

Answering another audience question, Jensen acknowledges the real challenges of geopolitics and tensions. However, he expresses hope that solutions will be found allowing continuing prosperity and openness while addressing valid national security concerns.

00:21

🎓 Advice for students

Jensen encourages the student audience to maximize their time at Columbia, soak up the knowledge, and not rush through education. He reflects on skills like strategic thinking that are useful in business while emphasizing the primacy of personal character.

Mindmap

The video is abnormal, and we are working hard to fix it.
Please replace the link and try again.

Keywords

💡accelerated computing

Accelerated computing refers to using specialized hardware like GPUs to accelerate certain computing tasks, rather than relying solely on general-purpose CPUs. It is a key theme in the video, as Jensen Huang discusses how Nvidia focused on accelerated computing to improve performance for graphics, AI, and other applications. He contrasts it with general computing and argues it is necessary to meet the rising computing demands.

💡AI

AI or artificial intelligence is discussed extensively, as a major application area benefiting from accelerated computing. Jensen talks about how GPUs are ideal for training neural networks and powering AI algorithms. He predicts AI will bring many productivity benefits and new capabilities across industries like design, materials science, etc.

💡deep learning

Deep learning is an AI technique mentioned where neural networks are trained on large datasets to perform tasks like image recognition. Jensen explains how deep learning was a breakthrough enabled by GPU accelerated computing, as training models requires processing huge datasets.

💡Moore's law

Moore's law predicted that transistor density on chips would double every 18 months. Jensen argues this law has slowed for general-purpose CPUs, while accelerated computing on GPUs continues rapid gains. This drives Nvidia's growth.

💡parallel processing

Parallel processing or distributing work across multiple processors is key to improved performance with accelerated computing. Jensen notes GPUs excel at parallel processing cryptographic and AI workloads.

💡generative AI

Generative AI models like DALL-E 2 and GPT-3 are discussed as a recent breakthrough in large neural networks enabled by accelerated computing. Jensen argues these models illustrate the future capabilities of AI.

💡software platforms

Jensen emphasizes that accelerated computing is dependent on both hardware and a software platform to make it accessible. Nvidia focused on building CUDA and integrations so developers could easily leverage GPU acceleration.

💡data centers

Data centers with thousands of GPUs are required to train and run modern AI models. Jensen talks about Nvidia's business model of providing accelerated computing capabilities inside cloud data centers like AWS and GCP.

💡flywheel effect

Jensen describes Nvidia's flywheel of improved GPU performance leading to more adoption, which funds more R&D, further improvement, and so on. This self-reinforcing cycle drives their rapid growth.

💡strategic thinking

Jensen emphasizes strategic thinking is critical for CEOs to set vision and direction. He argues they must spot trends early, connect dots, and mobilize action around strategies.

Highlights

The future of design is going to be very different. The future of everything will be very different.

You join companies where they have more ideas than they can afford to fund so that when AI automates their work, it's going to shift.

When productivity increases, meaning we embed AI all over Nvidia, Nvidia is going to become one giant ai. We already use AI to design our chips.

The future is going to be about AI factories and then video gear, will be powering these AI factories.

Somehow we've taught computers how to learn to represent information in numerical ways.

The next 10 years is going to be unbelievable. We were the computer, the chip engineering generation. You'll be a protein engineering generation.

Accelerated computing is first understanding what are the domains, what are the applications that matter to you?

The CEO's uniquely, uniquely in the right place to be the chief strategy officer.

The geopolitical challenges are real and national security concerns are real. So are all of the other economic market.

I would stay here and pig out on knowledge for as long as I can. If I could do it again, I'd still be here. Dean and me sitting next to each other. I'm the oldest student here.

Building companies hard, there's nothing easy about it. There's a lot of pain and sufferings, a lot of hard work.

I think CEOs first need second, but you're close. So join companies where they have more ideas, more ideas than they have money to invest.

Strategy matters. Obviously. Business matters are very different things. Finance matters, very different things. And so you got to learn all these different things in order to build a company.

The CEO should know the craft. You don't have to have founded the craft, but it's good that you know the craft. There's a lot of crap that you can learn.

If you believe in statistics, stay school. Yeah, go through the whole thing.

Transcripts

play00:01

I am the William v McLain professor of business in the decision and operations

play00:05

division here at the Columbia Business School.

play00:08

I want to thank you all for joining us this evening for tonight's program,

play00:11

which features Jensen Wong, co-founder and c e O of Nvidia Corporation,

play00:16

as well as our own ris, the Dean of Columbia Business School,

play00:20

and David and Lynn Sip, the professor of business.

play00:23

Our two speakers tonight have much in common. In fact,

play00:26

they both graduated from Stanford in electrical engineering nearly the same

play00:30

time, maybe even not possibly overlapping. Jensen is the co-founder,

play00:34

president officer of Nvidia. He is a businessman,

play00:38

entrepreneur and electrical engineer.

play00:41

And over the last 30 years through his work at nvidia,

play00:44

he has revolutionized first the graphics processing unit industry and now more

play00:49

recently, the artificial intelligence industry.

play00:52

He's been named the world's best,

play00:53

c e o by Harvard Business Review and Brand Finance as well as Fortune Magazine's

play00:57

business person of the year, and one of time magazine's,

play01:00

100 most influential people.

play01:03

Our fireside chat today has been made possible through both the David and Lynn

play01:07

Discipline Leadership series, as well as the digital finance, sorry, excuse me,

play01:11

the Digital Future Initiative. And additionally,

play01:14

I serve on the leadership of the Digital Future Initiative, the D F I.

play01:17

Here at C V s,

play01:20

the Digital Future Initiative is C V S'S new think tank,

play01:23

focusing on preparing students to lead for the next century of digital

play01:26

transformation,

play01:27

as well as helping organizations governances and communities better understand

play01:31

leverage and prosper from future ways digital structure.

play01:34

Now I would like to hand it over to.

play01:44

Thank you.

play01:44

Very much. Thank you all for coming. So.

play01:50

This an exciting topic and a topic that is near and dear,

play01:54

certainly to my heart.

play01:59

And it's a topic where the school,

play02:01

everything that we do at the school is changing so fast, trying to keep up,

play02:05

trying to change curricula,

play02:06

trying to create opportunities for our students to actually

play02:12

learn about technologies and how they're changing the world and be honest,

play02:16

prepare for the future and there is no better person to be having to

play02:21

talk about AI than Jensen Pond. Jensen,

play02:25

thank you so much for making the time and coming here. Welcome.

play02:30

Sun. Sun. Yes. I just love hearing

play02:38

talk here. I think the expectation's going to be pretty high,

play02:42

but say something smart. Well,

play02:47

good luck with you. So I want to start.

play02:53

By having you walk us through a little bit the history of Nvidia

play02:58

and then I talk a little bit about that leadership thing you just mentioned,

play03:01

but you launched that company 30 years ago and

play03:06

you have led it through a transformation,

play03:10

different applications, different type of products.

play03:15

Walk us through a little bit that journey.

play03:18

Yeah, one of the most proud moments, I'll start with the proud moment,

play03:23

what happened recently,

play03:25

the c e O of Denny's where with my first company,

play03:30

and they learned that Vidia, not only was I dishwasher,

play03:36

bus boy and worked my way up corporate ladder and became waiter

play03:42

at Denny's, and they were my first company

play03:48

that I still know how to take. I still done the menu well,

play03:53

super, by the way, anybody know what a superbird is?

play03:57

What kind of College Street were you?

play04:01

Denny's is America's Diner Go.

play04:05

And that Nvidia was founded by

play04:11

outside our home in San Jose there.

play04:16

And so they contacted me recently and the booth that I sat at is now

play04:22

in Nvidia Booth and my name is Nvidia.

play04:26

This is where a trillion dollar company was founded.

play04:31

And so

play04:34

Nvidia was founded during a time when

play04:39

the EC revolution and the microprocessor

play04:44

was capturing

play04:47

just above the entire industry and

play04:53

the world properly solved that the CPU of micro

play04:57

processor revolution. And it really reshaped how the IT

play05:06

companies that were successful before the micro processor revolution,

play05:10

revolution and companies successful.

play05:14

We started with our company during that time and our perspective was that

play05:18

general purpose computing,

play05:20

as incredible as it's can't sensibly be the solution for,

play05:25

we wanted to believe that a way of doing computing,

play05:28

we call accelerated computing,

play05:31

where you would add a specialist next to the generalist.

play05:36

The CPU is a generalist. If you well could do anything,

play05:38

it could do everything however you can.

play05:40

Obviously if you can do everything and anything,

play05:43

then obviously you can't do anything very well.

play05:46

And so there are some problems we felt that were not solvable,

play05:51

not good solutions or not the problems to be solved by what we call.

play05:58

And so we started this accelerated computing company. The problem is

play06:02

if you want to create a computing platform company,

play06:07

you want to create a computing platform one hasn't created since 1960,

play06:12

a year after I was the b m system 360

play06:17

beautifully described what the computer is in 1964,

play06:21

I B M described that the System 360 had a central processing unit,

play06:27

IO subsystem, direct memory access, virtual memory,

play06:33

binary compatibility across a scalable architecture.

play06:38

It described everything that we described computers to this day 60 years later.

play06:43

And we felt that there was a new form of computing that could solve some

play06:47

problems At the time it wasn't completely pure what problems we could solve,

play06:51

but we felt that we felt that accelerated comput. So nonetheless,

play06:56

we went out to start this company and we made a great first

play07:01

decision that frankly is un to this day,

play07:06

if somebody were to come up to you and said, one,

play07:09

we are going to invent a new technology that the world doesn't have. Everybody

play07:14

wants to go build a computer company around cpu.

play07:17

We want to build the computer company around something else connected to c p

play07:21

number one and the killer app.

play07:23

The killer app is a video three D video game in

play07:28

1993

play07:31

and that application doesn't exist. And the companies who we built,

play07:35

this company doesn't exist and the technology that we're trying to build doesn't

play07:38

exist.

play07:39

And so now you have a company that has a

play07:44

technology challenge and a market challenge and an

play07:49

ecosystem challenge.

play07:51

And so the odds of that company succeeding is approximately 0%.

play07:55

But nonetheless,

play07:57

we were fortunate this because two very important people frankly,

play08:03

that I had worked with and Kristen Curtis, the three of us I've worked with

play08:10

were incredibly important people in the technology industry at the time called

play08:14

up the most important ship capital in the world,

play08:17

Valenti at the time and told Don Don and his name

play08:22

was Gu, wanted to

play08:26

industry don give this kid money and then figure out along the way what it's

play08:31

going to work. And fortunately they did.

play08:35

But that business plan,

play08:36

I wouldn't fund myself today and it just has too

play08:41

many dependencies and each one of them has some profitability of success.

play08:45

And when you compound all of these together, we multiply all these together.

play08:50

And so nonetheless,

play08:53

we imagined that there would be this market called video games and this

play08:58

market would be the largest entertainment industry in the world at the

play09:02

time it was zero

play09:05

and three D graphics we oscillated with would be

play09:10

used for telling the stories of almost a sport any game.

play09:14

And so in virtual world, you could have any game, any sport,

play09:19

and as a result everybody would be a gamer. And so Don Valentine asked me,

play09:23

so how big is this market going to be? And I said, well,

play09:27

every human will be a gamer someday. Every human would be a gamer. Someday.

play09:31

Also the wrong answer, quite frankly for starting a company.

play09:35

So these are horrible habits, these are horrible skills.

play09:38

I'm not advocating them for you, but nonetheless,

play09:42

it turned out to have been true video games turned out to be the largest

play09:45

entertainment industry in three D graphics.

play09:48

And we've found first Pillar app for accelerating,

play09:52

which brought us the time to use accelerated Comput to solve a whole bunch of

play09:57

other problems, which eventually led to.

play10:02

This is fantastic. Sorry. So before we go to ai,

play10:07

I would like to ask a little bit about the crypto period.

play10:12

So gaming was a huge

play10:16

obviously journey for Nvidia.

play10:19

And then at some point in time the killer app became crypto and mining.

play10:24

What was that chapter?

play10:28

It's already computing can solve problems that normal computers can,

play10:32

and all of our GPUs, even though you use it for designing cars,

play10:35

designing buildings, designing, use it for molecular dynamics,

play10:39

use it for playing video games,

play10:41

it has this programming model called Kuda that we invented.

play10:44

And Kuda is the only computing model sits that exists today

play10:49

that is as popular as an exit. It's used by the vault Boeing.

play10:54

And so anyways, one of the things that Kuda can do is process

play11:00

parallel processing incredibly fast.

play11:02

And obviously one of the algorithms that we would do very nicely on is

play11:06

cryptography. And so when Bitcoin first came out,

play11:10

there were no Bitcoin asics.

play11:12

And the obvious thing is to go find the fastest supercomputer in the world.

play11:17

And the fastest supercomputer that also has the highest volume is Nvidia you

play11:21

use,

play11:22

it's available in hundreds of millions of gamers' homes. And so

play11:27

by downloading an application,

play11:30

you could do some mining at your house. Well,

play11:36

the fact that you could buy one of our GPUs, one of our computers,

play11:42

and you plug it into the wall and money starts squirting out,

play11:49

that was a day that my mom figured out what I did for a living.

play11:52

And so she called me one day and she said, son,

play11:56

I thought you were doing something about video games.

play12:00

And I finally figured out what you do. You buy NVIDIA's products,

play12:02

you plug it in and money courts out. And I said, that's exactly what I do.

play12:06

And that's the reason why that's the, so many people bought it,

play12:12

Bitcoin works led to Ethereum.

play12:16

But the idea that you would use a supercomputer,

play12:19

use a super processing system like via GPUs to

play12:24

either encode or compress or do something to refine data and

play12:30

transfer it, transform it into a valuable token.

play12:35

You guys know what that sounds like to generate valuable tokens,

play12:39

Chad should bet. And so today, really one of the things that's happening,

play12:45

if you extend the sensibility about Ethereum and

play12:50

crypto mining,

play12:53

it's kind of sensible in the sense that all of a sudden we created this new type

play12:57

of industry where raw data comes in,

play13:00

you apply energy to this computer and literally money comes sporting out.

play13:06

And the currency is of course tokens.

play13:10

And that token is int intelligence tokens.

play13:14

This is one of the major industries of the future.

play13:16

Now I'll describe something else and it makes perfect sense to us today,

play13:21

but back then it looks strange. You take water and you move it into a building,

play13:26

you apply fire to it.

play13:27

And what comes out is something incredibly valuable and invisible called

play13:31

electricity.

play13:33

And so today we're going to move data into a data center that's going to refine

play13:37

it and it's going to work on it and it's going to harness the capability of it

play13:41

and produce a whole bunch of digital tokens that are going to be valuable

play13:44

digital biology, it'll be valuable in physics, it'll be valuable in it.

play13:49

All kinds of computing areas and social media and all kinds of things.

play13:52

Computer games and all kinds of things. And it comes out in tokens.

play13:56

So the future is going to be about AI factories and then video gear

play14:01

will be powering these AI factories.

play14:04

So we have jumped into the neural networks and I want to,

play14:08

and we talked about power computing, how we render graphics,

play14:12

let's say on a monitor, how we play games,

play14:16

how we solve cryptographic problems for Bitcoin.

play14:23

Talk to us a little bit about how the G P U is useful in training

play14:28

your own networks.

play14:30

But then what I wanted us to do for this audience,

play14:35

tell us a little bit about what it takes to train a model like J G P T,

play14:39

what it takes in terms of hardware, what it takes in terms of data,

play14:42

what in terms of the size of the cluster that you're using,

play14:46

the amount of money that you need to spend. Because these are huge problems.

play14:50

And I think giving us a glimpse of the scale would be

play14:55

fun. Well,

play14:57

everybody wants you to think that it's a huge problem. It's super expensive.

play15:01

It's not. It's not. And let me tell you why.

play15:08

It costs our company about five,

play15:12

6 billion of engineering costs to design a trip.

play15:17

And then at 1.2 years, three years later,

play15:20

I had enter and I sent an email to T SS M C

play15:26

and I F T P, basically a large positive TS M C. And they fab it.

play15:30

And that process costs our company something along the lines of the half a

play15:34

billion dollars. So five and a half billion dollars, I get a chip.

play15:38

And that chip of course is valuable to us, but it's no big deal.

play15:41

I do it all the time. And so if somebody were to say, Hey Jensen,

play15:46

you need to build a billion dollar data center and once you plug it in,

play15:50

money will start squirting out the other side. I'll do it in a heartbeat.

play15:54

And apparently a lot of people do.

play15:56

And the reason for that is because who doesn't want to build a factory for

play16:00

generating intelligence now? So a billion dollars is not that much money,

play16:03

frankly,

play16:05

the world spends about 250 billion a year in infrastructure computing

play16:10

infrastructure and none of it's generating money. It's just storing our files,

play16:13

passing our email around. And that's already 250 billion.

play16:17

And so one of the reasons why our growth we're growing so fast is because after

play16:21

60 years,

play16:24

general purpose computing is on decline because it is not sensible to

play16:29

invest another 250 billion to build another general purpose computing data

play16:33

center. It's too through force in energy,

play16:37

it's too slow in computation. And so now accelerated computing is here,

play16:42

that 250 billion goes to build accelerated computing data centers.

play16:45

And we're very, very happy to support customers to do that. And in addition to

play16:51

that, accelerated computing,

play16:52

you now have an infrastructure can to AI for all of the things that we're just

play16:56

talking about.

play16:57

Basically the way it works is you take a whole lot of data and you compress

play17:02

it, you compress it.

play17:04

Deep learning is like a compression algorithm and you're trying to figure out,

play17:08

you're trying to learn the mathematical representation of mathematical

play17:13

representation, the patterns and relationships of the data that you're studying,

play17:17

and you compress it into a neural network.

play17:19

So what goes in is say trillions of

play17:24

bytes, trillions of pokes. So let's say a few trillion,

play17:28

trillion bytes,

play17:29

what comes out of it is a hundred gigabytes.

play17:35

And so you've taken all of that data and you've compressed it into this little

play17:38

tiny funnel. A hundred gigabytes is like two DVDs.

play17:41

Two DVDs you could download on your phone and you can watch it. So you could

play17:45

download this giant neural network on your phone.

play17:48

And now that all of this data has been compressed into it,

play17:52

the data that's compressed, your network model is a semantic model,

play17:56

meaning you can interact with it,

play17:57

you could ask questions and it would go back into its memory and understand what

play18:02

you meant and generate text, read, have a conversation.

play18:06

So at the core is kind of like that. It sounds magical,

play18:10

but for all the computer scientists in a room, it's very sensible.

play18:15

And don't let anybody convince you it costs a lot of money.

play18:18

I'll give you a good break. Everybody go Bill aids. Go bill,

play18:23

as.

play18:27

The scale. If I press you a little bit on that scale,

play18:33

do you need a computer that is essentially a data center to estimate

play18:38

these models?

play18:39

16,000 GPUs is what it took to build a g, PT four,

play18:43

which is the largest one that anybody's using today. It's a billion,

play18:49

and that's a check. It's not even a very big check.

play18:54

Don't be afraid. Don't let anybody talk you how to building a company,

play19:00

build your.

play19:00

Dreams.

play19:01

Let me ask you a question about the billion dollar check and the

play19:06

growth that you've been experiencing.

play19:11

I think you were named the best C e O by H B R.

play19:15

That's entertainment. That's.

play19:17

Entertainment.

play19:17

I'll keep repeating it and then eventually I appreciate that and then eventually

play19:22

we'll end with that line. But in some sense,

play19:28

you are leading a company right now through a period of extreme growth,

play19:32

hypergrowth,

play19:34

something that most companies have not experienced in their life.

play19:39

And I want to perhaps.

play19:42

Tell us.

play19:42

A little bit about what does it look like? I mean,

play19:48

doubling in size in under a year or

play19:52

managing supply chains, managing customers, managing growth, managing money.

play19:59

How do you actually add to that?

play20:03

I love the management money part of it. Just counting is fun.

play20:08

You just wake up in the morning and just roll around all the cash.

play20:15

Isn't that what you guys are all here to do? My understanding is.

play20:21

That's the end goal.

play20:23

That's the end goal, yeah.

play20:31

Let's see. Building companies hard,

play20:37

there's nothing easy about it. There's a lot of pain and sufferings,

play20:40

a lot of hard work. If it was easy, everybody would do it.

play20:45

And the truth about all companies, big or small,

play20:48

ours or others in technology, you're always dying.

play20:55

And the reason for that is because somebody's always trying to leapfrog you.

play20:57

So you're always on the wave of business.

play21:01

And if you don't internalize that sensibility,

play21:05

don't internalize that belief. You will go out of business.

play21:10

So I started at Denny's, as you guys know,

play21:14

and Nvidia was built out of very unlikely odds.

play21:19

And it took us a long time to be here. I mean, we're a 30 year old company,

play21:23

and when Nvidia first found it,

play21:27

the PC Windows nine five had come out 1993,

play21:32

and that was the first usable pc. We didn't have email.

play21:37

And so there were no such laptops or smartphones,

play21:42

none of that stuff existed.

play21:43

And so you could just imagine the world that we were started in and the world,

play21:48

we didn't have cd, everything was CRTs. And so the world was very,

play21:53

very different. Cd ROS didn't exist. We just to put it in perspective,

play21:57

all this stuff,

play21:57

that was the era we were founded in and it took this long for our company

play22:03

to be recognized as heavy reinvented for the first time in 60 years

play22:09

growing fast. Growing fast is all about people.

play22:13

Obviously companies is all about people. Whether you,

play22:16

if the right systems in place, you get right,

play22:18

your surrounded by amazing people like I am

play22:22

and the company has craft skills.

play22:25

It doesn't really matter whether you ship a hundred billion dollars or 200

play22:29

billion. Now the truth is that the supply chain is not easy. People think,

play22:34

does anybody know what a GForce graphics card looks like?

play22:36

And just show me as a hand, anybody knows what Nvidia graphics card looks like.

play22:42

And so you have a feeling that the graphics card is like a cartridge that you

play22:45

put into a pc, PC express slide pc.

play22:50

But our graphics chips these days,

play22:53

what is used in these deep lining systems is 35,000

play22:57

parts. It weighs 70 pounds.

play23:00

It takes robots to build 'em because they're so heavy.

play23:04

It takes a supercomputer to test it because it's a supercomputer itself

play23:10

and it costs $200,000. And for $200,000,

play23:14

you buy one of these computers,

play23:15

you replace several hundred general purpose processors that cost several million

play23:20

dollars. And so for every $200,000 you save,

play23:23

you say for every $200,000 you spent with Nvidia,

play23:27

you save two and a half million dollars in computing.

play23:31

And that's the reason why I tell you, the more you buy, the more you save

play23:38

and early, it's working out really well. People are really lining up.

play23:44

So that's it. That's what we do for a living.

play23:47

And the supply chain is complicated.

play23:49

We build the most complicated computers the world's ever seen,

play23:52

but hard can it be really? And

play23:58

it's really hard. It's really hard.

play24:04

But at the core of it, if you're surrounded by amazing,

play24:06

the simple truth is that it's all about people.

play24:10

And I'm lucky to be surrounded by a great management team.

play24:15

You have.

play24:16

And then the CEO E O says things like, make a So number one, something.

play24:20

Like that. Yeah, make it work.

play24:21

Make it work, make it. So.

play24:26

I want to go back to AI trends and what you think about the

play24:30

future, but you mentioned the word platform earlier on.

play24:36

You mentioned your software environment.

play24:41

So you have the hardware infrastructure,

play24:44

you have a software environment that is actually pervasive in training neural

play24:47

networks. Right now

play24:51

you're building in data centers or you're creating environments within data

play24:54

centers that are sort of clusters of Nvidia hardware,

play24:59

software and

play25:03

public communication between these resources,

play25:07

how important it is to be sort of a whole platform solution versus a

play25:12

hardware play.

play25:13

And how core is that into Nvidia Drive?

play25:20

Unlike first of all, before you could build something,

play25:22

you have to know what you're building and

play25:26

what is the reason the first principles for its existence.

play25:30

Accelerated computing is not a chip, that's why it's not called an accelerator.

play25:35

Accelerated computing is about understanding how can you accelerate everything

play25:40

in life? If you can accelerate everything in life,

play25:42

if you can accelerate every application, that's called really fast computing.

play25:47

And so accelerated computing is first understanding what are the domains,

play25:51

what are the applications that matter to you?

play25:53

And to understand the algorithms and the computing systems and the architecture

play25:57

necessary to accelerate that application.

play26:00

So it turns out that general purpose computing is a sensible

play26:05

idea. Accelerating an application is a sensible idea.

play26:09

So we'll give you an example. There's, you have DVD decoders,

play26:13

you play DVDs or H two sixty four decoders on your phone.

play26:18

It does one job and one job only,

play26:20

and it does it incredibly well. Nobody knows how to do it better.

play26:23

Accelerated computing is kind of this weird middle.

play26:27

There are many applications that you can accelerate. So for example,

play26:31

we can accelerate all kinds of image processing stuff, particle physics stuff.

play26:35

We can accelerate all kinds of things. That includes literary algebra.

play26:38

We can accelerate, we can accelerate many,

play26:41

many domains of applications. That's a hard problem.

play26:47

Accelerating one thing is easy.

play26:49

Generally running everything under A is easy.

play26:52

Accelerating enough domains such that if you accelerate too many

play26:57

domains, so those of you accelerate every domain,

play26:59

then you're back to a general purpose processor.

play27:01

What makes them so dumb that they can't build just a faster chip?

play27:05

And so on the one hand, on the other hand,

play27:09

if you only accelerate one application,

play27:11

then the market size is not big enough to fund your r d.

play27:16

And so we had to find that slippery middle. And that is the

play27:21

strategic journey of our company. This is where strategy meets reality.

play27:26

And that's the part that Nvidia got right,

play27:29

that no other company in the history of computing ever got, right?

play27:33

To find a way to have a sufficiently large domain of applications that we can

play27:37

accelerate that is still a hundred times, 500 times faster than the C P U

play27:43

and such that the economics, the flywheel,

play27:46

the flywheel of number of domains expanding the number of customers,

play27:51

expanding the number of markets, expanding the sales,

play27:55

which creates larger r d, which allows us to create even more amazing things,

play27:59

which allows us to stay well ahead of the c p. Does that make sense?

play28:03

That flywheel is insanely hard to create. Nobody's ever done it.

play28:07

It's only been done just one time.

play28:09

And so that is the capability. And in order to do that,

play28:14

you have to understand the algorithms,

play28:15

you have to understand a lot about the domains of applications. You have to

play28:20

select it, right? You have to create the right architecture for it.

play28:23

And then the last thing that we did right,

play28:25

was that we realized that in order for you to have a computing platform,

play28:29

the applications you develop for Nvidia should run on all of video.

play28:33

You should have to think, does it run on this chip?

play28:35

Is it going to run on that chip? It should run on every chip.

play28:38

It should run on every computer with Nvidia in it.

play28:40

That's the reason why every single G p that's ever been created in our company,

play28:44

even though we had no customers from Kudo a long time ago,

play28:46

we stayed committed to it.

play28:48

We were determined to create this computing platform since the very beginning.

play28:52

Customers were not. And that was the pain and suffering.

play28:56

It cost the company decades and billions of dollars getting here. And if

play29:01

not for all the video gamers in the room here, we would be here.

play29:05

You were our day jobs.

play29:07

And then at night we can go solve digital biology.

play29:11

Those help people with quantum chemistry.

play29:14

They'll help people with artificial intelligence and robotics and such.

play29:18

And so we realized, number one,

play29:19

that we were accelerating computing a software problem.

play29:22

The second thing is AI is a data center, data center infrastructure problem.

play29:27

And it's a very obvious, because you can't train an AI model on a laptop,

play29:32

you can't train it on a cell phone. It's not big enough of a computer.

play29:35

The amount of data is measured in trillions of bytes,

play29:39

and you have to process that trillions bytes billions of times.

play29:43

And so obviously that's going to be a large scale computer distributing the

play29:47

problem across millions of GPUs.

play29:50

The reason why I say millions is 16,000 inside the 16,000 or thousands.

play29:56

And so we're distributing the workload across millions of processors.

play30:00

There are no applications in the world today that can be distributed across

play30:04

millions of processors. Excel works on one processor.

play30:08

And so that computer science problem was a giant breakthrough,

play30:13

utterly giant breakthrough.

play30:14

And this reason why it enabled generative AI enabled large language models.

play30:18

So we observed two things. One, accelerated computing is a software problem,

play30:22

algorithm problem, and AI is a data center problem.

play30:26

And so we're the only company that went out and built all of that stuff.

play30:30

And the last part that we did was a business model choice.

play30:34

We could have been a data center company ourselves and be completely vertically

play30:38

integrated. However, we would recognize that no computer company,

play30:42

no matter how successful will be the only computer company in the world and it's

play30:47

better to be a platform computing company because we love developers. It's

play30:52

better to be a platform computing company that serves every computing company in

play30:55

the world than to be a computing company all by ourselves.

play30:58

And so we took this data center, which is the size of this room,

play31:01

whole bunch of wires and a whole bunch of switches and networking and a bunch of

play31:04

software.

play31:04

We disaggregated all of that and we integrated into everybody else's data

play31:09

centers that are all completely different.

play31:12

So a w Ss and G C P and Azure and Meta and so on and so forth,

play31:17

data centers all over the world, that's an insane complexity problem.

play31:21

And we figured out a way to have enough standardization where it was necessary

play31:26

enough flexibility so that we could accommodate enough collaboration with all

play31:30

the world's computer companies. As a result,

play31:33

N v's architecture has now graft, if you will,

play31:37

into every single computer company in the world.

play31:40

And that has created a large footprint, larger,

play31:43

larger install base, more developers, better applications,

play31:48

which makes customer happier customers provide them more chips,

play31:53

which increases the install base, which increases our r d budget,

play31:57

so on and so forth. The flywheel, the positive feedback system.

play32:00

And so that's how it works. Nice and easy. So one thing you haven't done.

play32:06

And I wanted you explain to us why if you haven't invested in

play32:10

fabricating your own chips

play32:14

and why.

play32:15

Is that? That's an excellent question.

play32:19

The reason for that is

play32:22

as a matter of strategic choice, the core values of our company,

play32:27

my own core values, the core values of our company is about choosing.

play32:33

The most important thing in life is choosing. How do you choose?

play32:38

How do you choose? Well, everything. How do you choose what to do tonight?

play32:43

How do you choose? Well,

play32:45

our company decides to choose projects for one fundamental goal.

play32:52

My goal is to create the environment and environment by which

play32:56

amazing people in the world will come and work.

play33:01

Amazing environment for the best people in the world who want to pursue this

play33:06

field of computing and computer science and artificial intelligence to create

play33:10

the conditions by which they will come and do their lives work. Well,

play33:16

if I say that then now the question is how do you achieve that?

play33:21

So lemme give you an example of how not to achieve that.

play33:25

Nobody that I know wakes up in the morning and say, you know what?

play33:30

My neighbor is doing that, and you know what I want to do?

play33:33

I want to take it from them. I can do it too.

play33:38

I want to take it from them. I want to capture their share.

play33:44

I want to pumble them on price. I want to kick 'em in.

play33:50

I want to take their share. It turns out,

play33:54

no great people do that.

play33:58

Everybody wakes up in the morning and says,

play33:59

I want to do something that has never been done before.

play34:01

That's incredibly hard to do that if successful makes it great impact in the

play34:06

world. And that's what greatest core values are. One, how do we choose,

play34:10

do something that the world's never done before?

play34:13

Let's hope that's insanely hard to do.

play34:16

The reason why you choose something insanely hard to do by the way,

play34:18

so that you have lots of time to go learn it.

play34:20

If something is insanely easy to do, like tic-tac dough,

play34:26

I wouldn't buss over it.

play34:28

And the reason for that obviously is highly competitive. And so you got to

play34:32

choose something that's incredibly hard to do and that thing that's hard to do

play34:36

discourages a whole bunch of all by itself because the person who's willing to

play34:41

suffer the longest wins. And so we choose things that are incredibly hard to do,

play34:46

and you've heard me say,

play34:47

pain is suffering a lot and it's actually a positive attribute.

play34:52

People who can suffer are ultimately the ones that are the most successful,

play34:57

number one. Number two,

play34:58

you should choose something that's somehow you're destined to do.

play35:02

Either a set of qualities about your personality or your expertise or the people

play35:07

you're surrounded by, your scale, whatever your perspective,

play35:10

whatever you're somehow destined to do. The number three,

play35:13

you better love working on that thing so much because unless so,

play35:17

the pain and suffering is too great. Now, I just described to you,

play35:22

I just described to you Invidia's core values. It's that simple as that.

play35:26

And if that's the case, what am I doing? Making a cell phone check.

play35:31

How many companies in the world can make a cell phone a lie?

play35:34

Why am I making a C P U? How many more CPUs do we need?

play35:39

Does that make sense? We don't need all those things.

play35:42

And so we naturally selected ourselves out of commodity markets.

play35:47

We naturally selected ourselves out of commodity markets.

play35:51

And because we selected amazing markets, amazingly hard to do things,

play35:56

amazing people joined us.

play35:58

And because amazing people joined us and because we had the patience and let

play36:02

them go succeed to go and do something amazing,

play36:06

have the patience to let 'em do something amazing, they do something amazing.

play36:11

The equation is that simple. The equation is literally that simple.

play36:15

It turns out it's simple to say, it takes incredible character to do.

play36:20

Does that make sense? That's why it's the most important thing to learn.

play36:25

It turns out great success and greatness is all about character.

play36:28

And no fabrication.

play36:30

The reason why we don't do fabrication is because T SS m C does it so well,

play36:34

and they're already doing it. For what reason do I go take their work?

play36:38

I like the people at t c, they're great friends of mine.

play36:40

Cc's a great friend of mine,

play36:41

Mark's a great friend of mine just because I've got business,

play36:43

I can drive into it. So what, they're doing a great job for me.

play36:46

Let's not squander my time to go repeat what they've already done.

play36:50

Let's go squander my time on something that nobody has done.

play36:54

Does that make sense? Nobody has done, that's how you build something special.

play36:59

Otherwise you're only talking about market share.

play37:02

Thinking about the future, what do you think

play37:07

when we're thinking about these decade.

play37:09

Are these right answers? By the way,

play37:14

I don't have an M B A and I didn't get a finance degree.

play37:17

I read some books and I watched a lot of YouTubes. I got to tell you,

play37:22

nobody watches more business YouTubes than I do.

play37:26

And so you guys have nothing on me.

play37:29

Are these right answers professor

play37:34

version?

play37:39

But yes, they're the right answers. And best, c e o. Yeah, right?

play37:44

And what.

play37:47

Do you think about ai?

play37:48

What are you thinking about AI applications and where we're going to

play37:53

see change in our lives, let's say over the next 3, 5, 7 years?

play37:57

Where do you see that going and in places where we

play38:02

will all potentially be affected in our daily experience?

play38:08

Yeah, first of all, I'm going to go to the punchline.

play38:10

AI is not going to take your jobs.

play38:15

The person who used AI is going to take your job. You guys agree with that?

play38:20

Okay?

play38:21

So use AI as fast as you can so then you can stay gainfully employed.

play38:26

Let me ask you a second thing. When productivity increases,

play38:32

when productivity increases, meaning we embed AI all over Nvidia,

play38:37

Nvidia is going to become one giant ai. We already use AI to design our chips.

play38:40

We can't design our chips, we can't write our optimizing compilers without ai.

play38:44

So we use AI all over the place.

play38:46

When AI increases the productivity of your company, what happens next?

play38:51

Layoffs Or you hire more people,

play38:57

you hire more people.

play38:57

And the reason for that is give me an example of one company that had earnings

play39:01

growth because of productivity gains that said, guess what?

play39:06

My gross margins just went up time for a layoff.

play39:11

So why is it that people think about losing jobs?

play39:15

If you think you have no new ideas, then that's the logical thing.

play39:19

Does that make sense?

play39:20

If you don't have any more ideas to invest your incremental earnings,

play39:25

then what are you going to do? When the work is replaced? It's automated.

play39:30

You lay people off.

play39:32

And so join companies where they have more ideas than they can

play39:37

afford to fund so that when AI automates their work,

play39:42

it's going to shift. Of course, it's going to change the style of working,

play39:46

AI's going to come after CEOs right away. Deans and CEOs

play39:51

we're so toast.

play39:56

I think CEOs first need second, but you're close.

play40:02

So you join companies where they have more ideas,

play40:05

more ideas than they have money to invest. And so naturally,

play40:09

when earnings improve, you're going to hire more people. Ai.

play40:14

So first of all, this is the giant breakthrough.

play40:16

Somehow we've taught computers how to learn to

play40:21

represent information in numerical ways. Okay,

play40:25

so you guys, has anybody heard of this thing called word to back?

play40:28

It's one of the best things I've ever word to back a word.

play40:32

You take words and you learn from the words studying every single word.

play40:35

It's relationship to every other word. And you learn,

play40:39

read a whole lot sentences of paragraphs,

play40:41

and you try to figure out what's the best number vector,

play40:45

what's the best number to associate with that word?

play40:48

So mother and father are close together numerically,

play40:52

oranges and apples are close together. Numerically,

play40:56

they're far from mom and dad. Dogs and cats are far from mom and dad,

play41:00

but closer probably to mom and dad than they are from

play41:04

oranges and apples chair and tables and chair.

play41:08

Hard to say exactly where they lie,

play41:10

but those two numbers are close to each other, far away from mom and dad,

play41:13

king and queen, close to mom and dad. Does it make sense?

play41:17

Imagine doing this for every single number and every time you test it, you go,

play41:20

son, a gun. That's pretty good.

play41:23

And when you subtract something from something else, it makes sense. Okay?

play41:26

That's basically learning the representation of information.

play41:30

Imagine doing this for English. Imagine doing this for every single language.

play41:34

Imagine doing this for anything with structure,

play41:36

meaning anything with predictability. Images have structure.

play41:41

Because if there are no structure, it'd be white noise.

play41:43

Physically it'd be white noise. And so there must be structure.

play41:46

That's the reason why you see a cat, I see a cat, you see a tree, I see a tree.

play41:50

You can identify where the tree is, you can identify where the coastline is,

play41:54

where the mountains are where. And so we could learn all of that.

play41:58

So obviously you could take that image and turn it into a vector.

play42:02

You could take videos and turn into vector three D into vectors,

play42:05

proteins into vectors, because there's obviously structure and protein,

play42:09

chemicals into vectors. Genes eventually into vectors.

play42:13

We can learn the vectors of everything. Well,

play42:15

if you can learn everything into numbers and its meaning,

play42:18

then obviously you can take ca word, c a t,

play42:24

translated to the image c a t image of ca.

play42:27

Obviously this is the same meaning if you can go from words to images,

play42:32

that's called mid journey staple diffusion. If you can go from images to words,

play42:36

that's called captioning video,

play42:39

YouTube videos to words underneath videos. And so one of you went from,

play42:45

what do you call it, if you go from say,

play42:49

amino acids to proteins, that's called the Nobel Price.

play42:54

And the reason for that is because that's alpha alcohol. Incredible.

play42:57

Isn't that right? And so this is the amazing time,

play43:01

the amazing time in computer science where we can literally take information

play43:06

one kind and convert it, transfer it

play43:11

generated into information of another kind.

play43:14

And so you can go text to text a large body of text, P D F,

play43:20

small body of text, a summarization of archive, which I really enjoy, right?

play43:24

And so instead of reading every single paper,

play43:27

I can ask it to summarize the paper.

play43:30

And it has to understand images because in the archive,

play43:33

the papers have a lot of images and charts and things like that. So you can take

play43:37

all of that to summarize it.

play43:38

And so you can now imagine all of the productivity benefits and in fact the

play43:43

capabilities you can't possibly do without it. So in the near future,

play43:47

you do something like this, you say, hi, I would like to design,

play43:52

give you some options of a whole bunch of cars. I work for Mercedes,

play43:56

I really care about the brand. This is the style of the brand.

play43:58

Lemme give you a couple of sketches and maybe a couple of photographs of the

play44:01

type of car I like to build. It's a four wheel,

play44:05

s u v four wheel drive, SS u v, let's say, so on and so forth.

play44:09

And all of a sudden it comes up with 20 10,

play44:13

200 completely fully three D design

play44:16

cab.

play44:17

Now the reason why you want that instead of just finishing the car is because

play44:20

you might want to select one of them and you say,

play44:22

iterate on this one another 10 times,

play44:24

and you might find select one and then modify it yourself. And so the future of

play44:29

design is going to be very different.

play44:31

The future of everything will be very different. Now,

play44:34

if you gave that capability to designers, they would go in the same,

play44:38

they would love you so much. They would love you so much.

play44:41

And that's the reason why we're doing this. Now,

play44:43

what's the long-term impact of this?

play44:46

One of my favorite areas is if you could use language to describe a

play44:51

protein and you could use language to figure out a way to synthesize protein in

play44:55

the future of protein engineering is near us. And protein engineering,

play44:59

as you know, creating enzymes to eat plastic,

play45:01

creating enzymes to catch a carbon,

play45:03

creating enzymes of all kinds to grow vegetables better,

play45:07

all kinds of different enzymes could be created during your generation.

play45:11

And so the next 10 years is going to be unbelievable. We were the computer,

play45:15

the chip engineering generation. You'll be a protein engineering generation.

play45:19

Something that we couldn't imagine doing just a few years ago.

play45:28

I think we're going to open it up for q and a to the audience.

play45:31

So questions,

play45:33

and maybe I'll point and we have some mics that will be running okay

play45:38

over there. We'll start there.

play45:48

Thank you for coming tonight. Thank you.

play45:52

So are you worried that Moore's law business schools are students are so

play45:56

serious,

play46:01

I understand that the graduates of Columbia ends up being

play46:06

investment bankers and stock traders. I'm actually, look, computer science,

play46:09

is that right? Is that right? And one computer science, you'll be,

play46:15

and so that's what I understand. So I'm here selling stock

play46:20

in the future. In the future, if somebody asks you what stock to buy and video,

play46:26

go ahead. A question for you is,

play46:28

are you worried that Moore's law might actually catch up to GP industry as it

play46:33

did for companies like,

play46:35

and can you also explain the difference between Moore's law and CO's law?

play46:40

I didn't phrase Wong's law and it wouldn't be likely me to do so.

play46:45

The very simple thing is this,

play46:50

Moore's Law was twice the performance every year and a half approximately.

play46:55

The easier math to do is 10 times every five years.

play46:58

So every 10 years is about a hundred times, if that's the case.

play47:03

In general, purpose computing microprocessors,

play47:05

the general purpose computing was increasing in performance at 10 times every

play47:09

five years, a hundred times every 10 years.

play47:12

Why change the computing method a hundred times every 10 years?

play47:16

Not fast enough. Are you kidding me?

play47:18

If cars would go a hundred times every five years when life be good?

play47:21

And so the answer is it's in fact, Moore's law is very good,

play47:25

and I benefited from it. The whole industry benefited from it.

play47:28

The computer industries here because of it,

play47:30

but eventually set general purpose computing. Moore's law.

play47:34

It is not about the number of transistors in computing,

play47:37

it's about the number of transistors, how you use it for CPUs,

play47:40

how you translate it ultimately to performance.

play47:42

That curve is no longer 10 times every five years. That curve,

play47:47

if you're lucky, is two or four times every 10 years.

play47:52

Well, the problem is if that curve is two or four times every 10

play47:57

years,

play47:58

the demand for computing and our aspirations of using computers to solve

play48:02

problems, our aspirations,

play48:06

our imagination for using computers to solve problem,

play48:09

it's greater than four times every 10 years. Isn't that right?

play48:12

And so our imagination, our demand,

play48:15

the world's consumption of all exceeds that. Well,

play48:20

you could solve that problem by just buying more CPUs. You could buy more.

play48:23

But the problem is these CPUs consume so much power because of general purpose.

play48:28

It's like a generalist. A generalist is not as efficient.

play48:33

The craft is not as great.

play48:35

They're not as productive as a specialist.

play48:39

If I'm ever going to have an open chest wound, I don't send me a generalist.

play48:44

You guys know what I'm saying? If you guys are around, just call a specialist.

play48:49

Alright? Yeah,

play48:54

he's a vet, he's a generalist.

play48:59

Look or do wrong specialist.

play49:03

So generalist is too brute forced.

play49:07

And so today it costs the world too much energy.

play49:10

It costs too much to just brute force general purpose computing. Now,

play49:13

thankfully, we've been working on accelerating computing for a long time,

play49:16

and accelerating computing, as I mentioned, is not just about the processor,

play49:20

it's really about understanding the application domain and then creating the

play49:25

necessary software and algorithms and architecture and chips.

play49:29

And somehow we figured out a way to do it behind one architecture.

play49:33

That's the genius of the work that we've done,

play49:37

that we somehow found this architecture that is both incredibly

play49:42

fast. It has to accelerate the C P U a hundred times, 500 times,

play49:46

sometimes a thousand times.

play49:50

And yet it is not so specific that it's only used for

play49:54

one singular activity. Does that make sense?

play49:58

And so you need to be sufficiently broad so that you have large markets,

play50:03

but you need to be sufficiently narrow so you can accelerate the application.

play50:08

That fine line,

play50:10

that razor's edge is what caused the video to be here.

play50:14

It's almost impossible, if I can explain the 30 years ago,

play50:17

nobody would've believed it. And in fact, if you did, to be honest,

play50:22

it took a long time and we just stuck with it and stuck with it and stuck with

play50:24

it. And we started with a seismic processing,

play50:29

molecular dynamics, image processing, of course, computer graphics.

play50:33

And we just kept working on and working on and working on weather simulation,

play50:37

fluid dynamics, particle physics, quantum chemistry,

play50:41

and then all of a sudden one day and deep learning

play50:44

and then transformers,

play50:47

and then the next will be some form of reinforcement learning transformers,

play50:51

and then there'll be some multi-step reasoning systems. And so all of these

play50:55

things are we just one application,

play50:58

somehow we figured out a way to create an architecture and solve all.

play51:01

And so will this new law end.

play51:06

And I don't think so. And the reason for that is this.

play51:09

It doesn't replace the C P U, it augments the cpu.

play51:14

And so the question is, what comes next to augment us?

play51:17

We'll just connect it next to it. We're just connect it next to it.

play51:20

And so when the time comes, we'll know,

play51:22

we'll know that there's another tool that we should be using to solve the

play51:26

problem because we are in service of the problems we're trying to solve.

play51:30

We're not trying to build a knife and make everybody use it.

play51:33

We're not trying to build a acquire, make everybody use it.

play51:35

We're in service of accelerated computings in service of the problem.

play51:39

And so this is one of the things that all of you learn.

play51:41

Make sure your mission is right.

play51:44

Make sure that your mission is not build trains,

play51:48

but enable transportation. Does that make sense?

play51:51

Our mission is not build GPUs.

play51:56

Our mission is to accelerate applications,

play51:59

solve problems that normal computers cannot.

play52:01

If your mission is articulated right and you're focused on the right thing,

play52:04

it'll last forever. Thank you. Okay.

play52:10

Up there. Someone? Yes,

play52:14

that guy right there is Tony. Go ahead. Tony.

play52:17

Am I, Tony? What's Tony say?

play52:21

Where's Tony? Tony was that guy in the middle, right? Yeah. See,

play52:27

I met him just now. I'm just kidding. Straight.

play52:31

My memory.

play52:34

Take my chance.

play52:34

I wasn't, I wasn't trying to give Tony the mic.

play52:38

I was just demonstrating my incredible memory for Tony.

play52:43

Go ahead.

play52:45

Thanks again.

play52:46

Now there's a push for onshoring,

play52:50

the supply chains for semiconductors.

play52:54

Then there are also restrictions on the export supply countries.

play52:58

How do you think that would affect Nvidia in the short term,

play53:02

but also how would that affect us as consumers in the long term?

play53:06

Yeah, really excellent question. You guys all heard a question.

play53:09

It's all repeated relates to geopolitics and geopolitical tension and such.

play53:14

The geopolitical tension,

play53:16

the geopolitical challenges will affect every industry will affect every human.

play53:22

We deeply, we the company deeply believed in national security.

play53:27

We are all here because our countries are known for security.

play53:31

We believe in national security,

play53:32

but we also simultaneously believe in economic security.

play53:36

The fact of the matter is most families don't wake up in the morning and say,

play53:40

good gosh, I feel so vulnerable because of the lack of military.

play53:44

They feel vulnerable because of economic survivability.

play53:48

And so we also believe in human rights and the

play53:52

ability to be able to create a prosperous life is part of human rights.

play53:57

And as you know,

play53:58

the United States believe in the human rights of the people that live here as

play54:00

well as the people that don't live here. And so the country believes in all of

play54:05

those things simultaneously. And we do too.

play54:08

The challenge with the geopolitical tensions,

play54:11

the immediate challenge is that if we're too unilateral about deciding

play54:16

that we decide on the prosperity of others, then there will be backlash.

play54:21

There'll be unintended consequences. But I am optimistic.

play54:26

I want to be hopeful that the people who are thinking through this are thinking

play54:29

through all the consequences and unintended consequences.

play54:33

But one of the things that has done is that it has caused every country to

play54:37

believe to deeply internalize

play54:41

its sovereign rights.

play54:44

Every country is talking about their own sovereign rights.

play54:47

And that's another way of saying everybody's thinking about themselves and

play54:52

as it applies to us. On the one hand,

play54:55

it might restrict the use of our technology in China and the export control

play54:59

there. On the other hand,

play55:01

because of sovereignty and every country wanting to build its own sovereign AI

play55:05

infrastructure, and not all of them are enemies of the United States,

play55:09

and not all of 'em have a difficult relationship with the United States,

play55:14

we would help 'em build AI infrastructure everywhere. And so in a lot of ways,

play55:18

this weird thing about geopolitical,

play55:20

it limits the market opportunities for us in some way.

play55:24

It opens the market opportunities in other ways. But for people,

play55:28

for people, I am just really hopeful.

play55:33

I really hope not hopeful. I really hope that

play55:39

we don't allow our tension with China result

play55:43

into tension with Chinese.

play55:47

That we don't allow our tension with the Middle East turn into tension with

play55:51

Muslims. Does that make sense? We are more sophisticated than that.

play55:56

We can't allow ourselves to fall into that trap. And so

play56:02

a little bit about that. I worry about that as a slippery slope.

play56:05

One of our greatest sources of intellectual property for our country as

play56:11

foreign students. I see many of 'em here. I hope that you stay here.

play56:17

It is one of our country's single greatest advantage.

play56:21

If we don't allow foreign students in the brightest minds in the world to come

play56:24

to Columbia and keep you here in New York City,

play56:29

we're not going to be able to retain the great intellectual property of the

play56:31

world. And so this is our fundamental core advantage.

play56:35

And I really do hope that we don't ruin that. So as you can see,

play56:40

the geopolitical challenges are real and national security concerns are real.

play56:44

So are all of the other economic market. Social technology matters, technology,

play56:49

leadership matters, market leadership matters. All that stuff matters.

play56:53

The world's just a complicated place.

play56:55

And so I don't have a simple answer for that. We will all be affected.

play57:02

So we'll take one more question there.

play57:08

But in the meantime, stay focused on your school. Do a good job,

play57:14

just study.

play57:17

Hi there.

play57:17

So I actually started off working as an engineer at a semiconductor company at

play57:22

Houston in entrepreneurship.

play57:24

And now I'm here as someone like yourself that is fundamentally technologist,

play57:28

an engineer, started a company,

play57:29

very successfully learned finance from YouTube videos.

play57:33

What do you think of MBAs?

play57:36

Oh, I think it's terrific. You should be, first of all,

play57:41

you'll likely live until you're a hundred. And so that's the problem.

play57:48

What are you going to do for the last 70 years or 60 years?

play57:52

And this isn't something I'm telling you,

play57:54

it's something I tell everybody care about. Look to the best of your ability.

play58:00

Education. When you come here, you're forced by education.

play58:02

How good can that be after you leave? Like me?

play58:05

I got to go scour the planet for knowledge

play58:09

and I've got to go through a lot of junk.

play58:13

That gets to some good stuff. You're in school,

play58:16

you've got all these amazing professors who are curating the knowledge for you

play58:19

and present it to you in a platter. My goodness,

play58:21

I would stay here and pig out on knowledge for as long as I can.

play58:27

If I could do it again, I'd still be here.

play58:31

Dean and me sitting next to each other. I'm the oldest student here.

play58:36

I'm just preparing for that big step function when I graduate,

play58:39

just go instantaneously. Success.

play58:44

I'm just a little kidding about that.

play58:45

You have to leave at some point and your parents won't appreciate it.

play58:50

But don't be in a hurry, I think. Learn as much as you can.

play58:54

There's no one right answer to getting there.

play58:56

Obviously I have friends who never graduated from college and they're

play59:01

insanely successful. And so there are multiple ways to get there.

play59:05

But statistically, I still think this is the best way to get there,

play59:09

statistically. And so if you believe in stat in math and statistics,

play59:14

stay school. Yeah, go through the whole thing.

play59:19

And so I got a.

play59:20

Virtual b a by working through it, not because of choice.

play59:25

When I first graduated from school, I thought I was going to be an engineer.

play59:28

Nobody says, Hey, Jensen, here's your diploma. You're going to be a c e O.

play59:33

And so I didn't know that. So when I got there, I learned

play59:39

M B A. And there's a lot of different ways to learn. Business strategy matters.

play59:43

Obviously. Business matters are very different things. Finance matters,

play59:47

very different things.

play59:48

And so you got to learn all these different things in order to build a company.

play59:51

But if you're surrounded by amazing people like I am,

play59:54

they end up teaching you along the way.

play59:55

And so there's some things that depending on what role you want to play,

play60:01

that's critical. Yours, okay? And so for a C e O,

play60:07

there are some things that are critically, it's not only my job,

play60:11

but it's critical that I lead with it. And that's character.

play60:16

There's something about your character, about the choices that you make,

play60:21

how you deal with success, how you deal with failure.

play60:24

And Norma said that how you make choices,

play60:28

those kind of things matter a lot. Now,

play60:31

from a skill and craft perspective,

play60:33

the most important thing for a C is strategic thinking.

play60:36

There's just no alternative. The company needs you to be strategic.

play60:40

And the reason for that is because you see the most.

play60:43

You should be able to look around corners better than anybody.

play60:45

You should be able to connect dots better than anybody.

play60:49

And you should be able to mobilize. Remember what a strategy is, action.

play60:52

It doesn't matter what the rhetoric says, it matters what you do.

play60:55

And so nobody can mobilize the company better than the CEO O. And so therefore,

play60:59

the CEO's uniquely,

play61:01

uniquely in the right place to be the chief strategy officer, if you'll,

play61:05

and so those two things, I would say, from my perspective,

play61:10

two of the most important things.

play61:12

The rest of it has a lot of skills and things like that.

play61:15

And you'll learn the skills. And maybe if I could just add one more thing.

play61:20

I do believe that a company is about some

play61:25

particular craft. You make some unique contribution to society.

play61:29

You make something and you make something. You ought to be good at it.

play61:36

You should appreciate the craft. You should love the craft.

play61:38

You should know something about the craft, where it came from,

play61:42

where it is today, and where it's going to go. Someday.

play61:45

You should try to embody the passion for that craft.

play61:50

And I hope today I get a little bit embodying the passion and the expertise of

play61:54

that craft. I know a lot about the space that I'm in,

play61:58

and so if it is possible,

play62:02

the CEO should know the craft. You don't have to have founded the craft,

play62:07

but it's good that you know the craft. There's a lot of crap that you can learn.

play62:10

And so you want to be an expert in that field.

play62:14

But those are some of the things you can learn that here. Ideally,

play62:18

you can learn on the job, you can learn that from friends.

play62:20

You can learn that a lot of different ways to do it. But stay in school.

play62:25

So before I thank the best c e o,

play62:30

I want to thank the Digital Future Initiative, the David Hilton Speaker Series,

play62:35

but mostly thank you gentlemen for coming.

play62:38

We all understand why you were voted the best, c e o now. Thank you.