The Future of AI Is Amazing

a16z
5 Mar 202410:21

Summary

TLDRThe speaker enthusiastically discusses the transformative potential of recent advancements in AI, specifically large language models and foundation models. They explain how these models have made significant breakthroughs in areas like creativity, natural language processing, and problem-solving, at a fraction of the cost and time compared to human efforts. The speaker argues that this economic dislocation, similar to previous revolutions like the microchip and internet, will drive a new wave of innovative companies and potentially lead to economically viable artificial general intelligence. The talk invites collaboration between venture capitalists, the tech community, and policymakers to capitalize on these promising developments.

Takeaways

  • 🧠 AI has been around for decades and has made significant progress in solving various problems, but its widespread adoption has been limited due to economic factors.
  • 🚀 The emergence of large language models (LLMs) and foundation models has brought a significant economic shift, making AI solutions orders of magnitude cheaper and faster than human alternatives.
  • 💻 LLMs excel in domains like creativity, natural language understanding, and task assistance, areas traditionally considered uniquely human.
  • 💰 The drastic reduction in marginal costs enabled by LLMs is akin to previous platform shifts brought about by the microchip (compute) and the internet (distribution).
  • 🏭 While job displacement is a concern, history suggests that if demand is elastic, these technological advancements can drive overall economic growth.
  • 🦸‍♀️ The speaker envisions a wave of iconic companies emerging from this AI revolution, similar to the rise of tech giants during the internet era.
  • 🌐 LLMs have the potential to revolutionize various domains, including social interactions, creativity, productivity, and even embodied artificial general intelligence (AGI).
  • 🤝 Realizing the full potential of this AI wave will require collaboration and partnership across the venture capital, tech, and government sectors.
  • ⚡ The speaker expresses excitement about the rapid pace of change and economic opportunities presented by this AI wave.
  • 🔮 There is optimism that LLMs can solve problems previously thought unsolvable, paving the way for new applications and business models.

Q & A

  • What is the main topic discussed in the script?

    -The main topic discussed is the excitement around the recent wave of large AI models (also called foundation models or state-of-the-art models) and their potential to create a platform shift in the industry, similar to the shifts brought about by the microchip and the internet.

  • What is the key difference between traditional AI and the current wave of large AI models?

    -The key difference is the economics. Traditional AI solutions lacked broad market appeal, required significant investment for correctness, and often competed with the human brain's efficiency. However, the current wave of large AI models is more cost-effective, faster, and in some cases, outperforms humans in tasks like creativity, communication, and reasoning.

  • Can you provide an example illustrating the cost advantage of large AI models?

    -The script provides the example of creating a Pixar-style image. Using a large AI model, the inference cost is about one-hundredth of a penny, and it takes about a second. In contrast, hiring a graphic artist could cost around $100 per hour or more, making the AI solution orders of magnitude cheaper and faster.

  • How does the script compare the economic impact of large AI models to previous technological shifts?

    -The script compares the potential impact of large AI models to the microchip revolution, which brought the marginal cost of compute to near zero, and the internet revolution, which brought the marginal cost of distribution to near zero. It suggests that large AI models could bring the marginal cost of creation to near zero, potentially ushering in a new platform shift.

  • What are some potential areas where large AI models could have a significant impact?

    -The script mentions several potential areas, including creativity (generating images, music, voice imitations), natural language reasoning (conversational AI, virtual companions, therapists), and serving as co-pilots for various online tasks and activities.

  • How does the script address concerns about job dislocation due to AI?

    -The script argues that, similar to previous technological shifts, if the demand for AI-powered services is elastic (i.e., the demand increases as costs decrease), the total throughput and use of AI could increase, potentially expanding growth and creating new opportunities rather than just displacing jobs.

  • What future developments does the script envision for large AI models?

    -The script suggests that there is now a real line of sight to embodied AGI, meaning economically viable artificial general intelligence (AGI) systems that can solve problems that were previously unsolvable due to high costs.

  • How does the script characterize the potential impact of large AI models on the industry?

    -The script suggests that large AI models could lead to the fastest growing companies we've seen in the history of the internet, including by the way the internet itself, and that we should get ready for a new wave of iconic companies driven by this technological shift.

  • What role does the script suggest for various stakeholders in relation to large AI models?

    -The script mentions the need for partnerships and collaboration among the venture capital community, the tech community, and policymakers in Washington, D.C., suggesting that a concerted effort from these stakeholders will be required to fully realize the potential of large AI models.

  • How does the script describe the historical context and evolution of AI?

    -The script provides a brief historical overview, mentioning that AI has been around for about 70 years, and has steadily solved various problems that were initially thought to be challenging for computers, such as expert systems for medical diagnosis, chess, image detection, and robotics. However, the script suggests that the current wave of large AI models represents a significant departure from traditional AI in terms of economics and capabilities.

Outlines

00:00

🤖 AI's Transformative Potential and Past Achievements

This paragraph introduces the topic of artificial intelligence (AI) and its historical developments. It discusses AI's successes over the past 70 years, highlighting its ability to solve problems previously thought to be challenging for computers, such as medical diagnosis, chess, image recognition, and robotics. The speaker emphasizes that AI has added significant value to large companies through applications like search engines and personalization. However, a conundrum existed in the investment community regarding why AI had not yet led to a platform shift akin to the mobile or internet revolutions, despite its impressive capabilities.

05:01

🌊 The Emergence of Large Language Models and Economic Disruption

This paragraph discusses the recent wave of large language models (LLMs) or foundation models, which are software capable of generating text, images, or conversations based on input. The speaker highlights how these models have entered domains previously unexplored by AI, such as creativity, natural language reasoning, and acting as co-pilots for various tasks. Unlike traditional AI solutions, these models have favorable economics due to their broad market appeal, reduced emphasis on absolute correctness, and software-based nature. The speaker provides examples demonstrating the significant cost and time advantages of using LLMs compared to human experts, indicating potential for massive economic disruption akin to the microchip and internet revolutions.

10:01

🚀 The Future of AI and Call for Collaboration

In this concluding paragraph, the speaker expresses excitement about the potential value creation by AI, particularly in domains like social interaction, creativity, productivity, and embodied artificial general intelligence (AGI). The speaker acknowledges the significant challenges and the need for collaboration among venture capitalists, the tech community, and policymakers in Washington, D.C. to navigate this transformative shift successfully.

Mindmap

Keywords

💡AI (Artificial Intelligence)

Artificial Intelligence refers to the development of computer systems capable of performing tasks that typically require human intelligence, such as visual perception, speech recognition, decision-making, and language translation. The video discusses the long history and evolution of AI, its successes in solving complex problems, and its potential for transformative economic impact, particularly with the emergence of large language models (LLMs) and foundation models.

💡Large Language Models (LLMs)

Large Language Models, also known as Foundation Models, are advanced AI systems trained on massive amounts of data to understand and generate human-like text. The speaker highlights LLMs as a game-changing development, capable of tasks like natural language processing, creativity, reasoning, and acting as intelligent assistants or co-pilots across various domains. LLMs are presented as a significant economic driver due to their low marginal costs and broad applicability.

💡Economics

Economics plays a crucial role in the video's narrative. The speaker argues that while AI has achieved remarkable technological feats, its widespread adoption and impact have been limited due to unfavorable economics, such as niche market applications, hardware requirements, and competition with inexpensive human labor. However, LLMs are presented as a paradigm shift, offering orders of magnitude lower costs and faster execution compared to human alternatives, thereby enabling new economic opportunities and potential platform shifts akin to the microchip and internet revolutions.

💡Marginal Cost

Marginal cost refers to the cost of producing one additional unit of a good or service. The video emphasizes that LLMs have brought the marginal cost of creation and reasoning to near zero, making them significantly cheaper and faster than human alternatives for tasks like image creation, language understanding, and reasoning. This dramatic reduction in marginal cost is positioned as a driving force behind the potential economic disruption and platform shift enabled by LLMs.

💡Creativity

Creativity, traditionally considered a uniquely human trait, is presented as an area where LLMs excel. The speaker highlights LLMs' abilities to create images, music, poetry, and engage in creative tasks better than humans. This newfound computational creativity, combined with the low marginal cost of LLMs, is portrayed as a significant economic opportunity and a departure from traditional AI limitations.

💡Platform Shift

The video draws parallels between the potential impact of LLMs and previous platform shifts, such as the microchip revolution and the internet revolution. A platform shift refers to a technological advancement that fundamentally alters the economic landscape, enabling new business models, industries, and companies to emerge. The speaker argues that the economics of LLMs have the potential to catalyze a similar platform shift, ushering in a new wave of innovative companies and reshaping various sectors.

💡Embodied AGI

Embodied AGI (Artificial General Intelligence) refers to the concept of creating economically viable, embodied AI systems with broad capabilities akin to human intelligence. The speaker suggests that LLMs provide a line of sight to achieving embodied AGI, meaning AI systems that can solve real-world problems in a cost-effective manner, unlike previous attempts that were too expensive or impractical.

💡Venture Capital

Venture capital, the investment of money into early-stage, high-potential companies, is mentioned as a driving force behind the development and commercialization of LLM technologies. The speaker, likely a venture capitalist, expresses excitement about the rapid growth of LLM-powered companies, suggesting that venture capitalists see immense potential in this space.

💡Co-pilot

The term 'co-pilot' is used in the video to describe the role of LLMs as intelligent assistants capable of aiding humans in various tasks and domains. LLMs are portrayed as versatile co-pilots that can augment human abilities, understand context, and provide valuable assistance across a wide range of activities, from writing and analysis to coding and problem-solving.

💡Job Dislocation

Job dislocation refers to the potential displacement of human workers due to technological advancements like LLMs. The speaker acknowledges this concern but draws parallels to previous technological revolutions, suggesting that if demand for LLM-enabled services is elastic (i.e., grows with increased accessibility and lower costs), the overall economic growth could offset job losses by creating new opportunities and industries.

Highlights

AI has been around for over 70 years, solving many problems previously thought impossible for computers, such as expert systems for medical diagnosis, beating humans at chess, image detection, and robotics.

Despite AI's success, there hasn't been a platform shift like mobile or the internet because the economics were not favorable due to niche markets, the need for absolute correctness in some use cases, hardware requirements, and competition with the efficient and cheap human brain.

The emergence of large language models or foundation models is a game-changer because they can handle tasks like creativity, natural language reasoning, and serving as co-pilots for various online tasks, which traditional AI could not.

These models are much cheaper and faster than humans for tasks like image creation, language understanding, and reasoning, with costs as low as one-hundredth of a penny and near-instantaneous processing.

When marginal costs have dropped significantly in the past, such as with the microchip (compute) and the internet (distribution), it led to platform shifts and the creation of iconic companies like IBM, HP, Amazon, Google, and Salesforce.

These large models bring the marginal cost of creation to near-zero, suggesting a potential platform shift and the rise of new iconic companies.

The demand for these models' capabilities is expected to be elastic, leading to an expansion of growth rather than job dislocation, similar to the effects of the microchip and internet revolutions.

There are glimpses of the potential impacts, such as changes in the social order, real monetization of creativity, productivity improvements through co-pilot capabilities, and the possibility of economically viable embodied artificial general intelligence (AGI).

The speaker emphasizes the need for partnership between the venture capital community, the tech community, and policymakers in Washington, D.C., to harness the potential of this transformative technology.

Transcripts

play00:09

okay so I'm going to be uh covering this

play00:10

AI stuff everybody's talking about so

play00:12

I'm just going to spend about 10 minutes

play00:14

to talk about why we're so excited about

play00:16

it and then um Senator Todd young is

play00:19

going to be up here and we're going to

play00:20

have a discussion so I probably took my

play00:23

first AI course in the late '90s the

play00:25

stuff has actually been around with us

play00:26

for a very long time uh and during that

play00:30

you know 70 years um It's You Know by

play00:34

every metric has been a huge success

play00:35

it's been up and to the

play00:37

right we've solved a number of problems

play00:39

we didn't think computers were good at

play00:41

solving so for example expert systems in

play00:43

the 50s and 60s we used for medical

play00:45

diagnosis we got very good at beating

play00:46

Russians at chess in the 80s and 90s

play00:48

we're good at image detection we're good

play00:50

at robotics like we've solved a lot of

play00:52

problems that originally we thought you

play00:53

know computers were just like large

play00:55

calculators on top of just solving these

play00:58

problems for decades a lot of the

play01:00

solutions are actually better than than

play01:03

than humans like we're better than

play01:05

humans at handwriting detection we're

play01:06

better than humans at at uh identifying

play01:10

objects and

play01:12

images and and with all of this magic

play01:14

we've actually been able to add a lot of

play01:16

value to large companies right every

play01:18

time you go to Google and you get a

play01:20

search this is using AI anytime you get

play01:23

some personalization this is AI right so

play01:26

this stuff is like magic right it's been

play01:27

around for a long time it's solved all

play01:29

these problems

play01:30

so there's been this huge conundrum in

play01:33

the investment community and the

play01:35

conundrum is the following if this stuff

play01:37

is so magic and it solves all of these

play01:40

problems why haven't we seen a platform

play01:42

shift in the same way we saw a shift

play01:44

with mobile or with the internet like

play01:46

why hasn't this happened and we've

play01:48

actually done a lot of research with

play01:50

this as a firm and the answer is is that

play01:52

even though the capabilities have been

play01:54

fantastic like I talked about the

play01:56

economics just haven't been there in the

play01:57

same way there's a number of reasons for

play02:00

this I won't be exhaustive but I'll just

play02:02

cover a few of them so one of them a lot

play02:04

of the solutions just tend to apply to

play02:05

Niche markets there's not a lot of broad

play02:07

Market appeal the second one is probably

play02:09

the most important in Nuance which is a

play02:10

lot of the use cases that we apply it to

play02:13

correctness is really important like

play02:14

robotics but getting something

play02:16

absolutely correct is very very hard and

play02:18

requires a tremendous amount of

play02:20

investment so a number of the solutions

play02:22

require hardware and finally you know

play02:24

the the competition for AI it's not it's

play02:26

not another computer it's actually a

play02:28

human brain and you know maybe it'll be

play02:31

better maybe it's not as good the human

play02:32

Rin is incredibly efficient and it's

play02:33

incredibly cheap and one of the best

play02:36

examples of this is is autonomous

play02:38

vehicles or Robo taxi so when I joined

play02:40

Stanford to do my PhD in 2003 Sebastian

play02:43

thrud had just won the DARPA Grand

play02:44

Challenge right so he had driven a van

play02:47

autonomously across the desert and won

play02:49

this and we were like great news

play02:51

exciting like autonomous vehicle is a

play02:53

solved problem back in 2003 now if we go

play02:57

20 years later we've invested 75 billion

play03:00

dollars as an industry and while we do

play03:02

have autonomous vehicles on the road and

play03:03

they're great and they're solving real

play03:04

problems the unit economics are still

play03:06

worse than say Uber and lift because

play03:08

they're competing against the human

play03:09

brain so while this is very important

play03:11

technology to date it's really remained

play03:14

in the realm of large companies right

play03:16

that can sync these types of

play03:19

Investments so the AI learnings of the

play03:21

last couple of decades is not that

play03:23

technology can't be built or even that

play03:25

we can't monetize it we're actually good

play03:26

at all of that is that this is very hard

play03:29

for startups to build businesses

play03:31

around so the reason that we're so

play03:34

excited and the industry is changing so

play03:36

quickly is this wave is very very

play03:38

different on exactly this

play03:40

issue

play03:42

economics so when I talk about kind of

play03:44

this wave I'm talking about the

play03:45

emergence of what we call large models

play03:47

or Foundation models or state-of-the-art

play03:49

models these are pieces of software that

play03:51

you put in text or you put in an image

play03:53

and outc comes something out can come an

play03:54

image or text or a conversation right

play03:56

there're these kind of like very very

play03:58

smart pieces of software that you can

play03:59

ask questions and they provide answers

play04:02

too and they've already entered a number

play04:05

of problem domains that we just haven't

play04:07

cracked in computers and certainly in AI

play04:09

right the AI has not been able to do

play04:10

this before so for example creativity

play04:13

you know these models are better than

play04:15

humans at creating images or creating

play04:17

music or creating um you know voice

play04:20

imitations it actually turns out they're

play04:22

great at natural language reasoning as

play04:24

well right they're great

play04:25

conversationalists they're great friends

play04:27

they're great romantic Partners they're

play04:29

great therapists um and they also have

play04:31

now serving this a thing which we call

play04:33

co-pilot which is this catchall phrase

play04:35

that they're pretty good at like mean

play04:37

online tasks and by mean I mean average

play04:39

right so if it's something that you do a

play04:40

lot of it can kind of get the hang of it

play04:42

and do it as

play04:43

well now remember when I said like

play04:45

traditional AI the economics didn't work

play04:47

and there was a set of reasons so those

play04:50

reasons just don't apply to this set of

play04:53

tasks right like these markets are

play04:54

enormous like whatever video games and

play04:56

movies alone are like a half trillion

play04:58

dollar market

play05:00

in many of these use cases correctness

play05:02

just isn't an issue right I mean what

play05:04

like there's no formal notion of

play05:05

correctness of creating like a fantasy

play05:07

image or like creating like a sonnet or

play05:09

something like that the use cases are

play05:11

primarily software and and the last

play05:14

point is the one that like I couldn't

play05:16

have predicted and it's the most

play05:18

surprising that it turns out that for

play05:20

these tasks the one that we think of as

play05:22

very human like you know communication

play05:24

and social interaction and creativity

play05:26

the computers are far cheaper and far

play05:28

better than than than humans

play05:31

are I want to give you a very specific

play05:33

example it may be silly but it actually

play05:35

generalizes so let's just say that I

play05:37

Martine wanted to create a a picture of

play05:40

me as a a a Pixar character so if I had

play05:44

one of these AI models do it the actual

play05:47

inference cost the cost of doing that is

play05:49

about one/ 100th of a penny and it takes

play05:51

about a second and it and I mean this is

play05:53

what we did here and this is the quality

play05:54

that you get if you were to compare that

play05:58

to hiring a graphic artist a graphic

play05:59

artist is what let's say 100 bucks in an

play06:01

hour it's it actually is much

play06:03

more I've gone down this road before so

play06:06

the AI you know it's just not a little

play06:08

bit better it's not like 20% better it's

play06:10

for orders of magnitude cheaper and

play06:15

faster this isn't limited to images this

play06:17

is also the true for like any sort of

play06:19

language understanding so like take a

play06:21

complex legal document I can take a

play06:23

complex legal document I can feed it

play06:25

into an llm and I can ask questions if

play06:28

you compare the analog would be me like

play06:30

whatever like working with my my lawyer

play06:32

so like the lawyer would have to read it

play06:33

would have to understand it you know I

play06:35

don't know how much you know you know

play06:37

the average lawyer cost is but like it's

play06:39

you know 500 tends to be pretty standard

play06:41

so again to use an llm is four to five

play06:44

orders of actitude cheaper and

play06:48

faster and it's exactly because of this

play06:52

that we as Venture investors and we on

play06:54

the private Market side are so exciting

play06:56

because we're seeing the fastest growing

play06:58

companies we've seen in the history of

play06:59

the internet including by the way the

play07:01

internet itself and this is by measured

play07:03

for revenue or the number of users Etc

play07:05

right it's exactly economic dislocations

play07:08

that create new startups not just new

play07:10

technology so if you take a step back

play07:13

historically when marginal costs have

play07:15

dropped this

play07:16

much this is what creates platform

play07:19

shifts and has changed the industry

play07:21

entirely it's happened twice you know

play07:23

that pretty concretely I want to walk

play07:25

through both of those so the first one

play07:27

was compute so in the creation of the

play07:29

microchip it brought the marginal cost

play07:31

of compute to zero like so before you

play07:33

had the microchip calculations were done

play07:36

by hand right so it was like people

play07:38

doing logarithm tables you know in in

play07:41

large rooms and then ANC was introduced

play07:44

which was forwarders of magnitude faster

play07:46

and then you had the computer Revolution

play07:47

and here came you know IBM and HP and

play07:49

everything

play07:51

else the internet brought down the

play07:53

marginal cost of distribution to zero

play07:55

right so before you like whatever You'

play07:56

send you know a box or you'd send a

play07:59

letter and then the price per bit

play08:01

dropped and you could send it over the

play08:02

Internet by the way OS forward is a

play08:04

magnitude Improvement and this ushered

play08:06

in kind of the internet Revolution right

play08:08

this is kind of Amazon and Google and

play08:11

Salesforce so it's pretty clear if you

play08:14

just take the fundamental economic

play08:16

analysis that these large models bring

play08:17

the marginal cost of creation to zero

play08:19

like creating that image and language

play08:21

understanding like reasoning over those

play08:22

documents and these are very very broad

play08:25

areas that they can be applied

play08:26

to now whenever we talk about economics

play08:29

we always kind of talk about Job

play08:30

dislocation as well it's very very

play08:31

important especially with an economic

play08:33

dislocation of this size we can learn

play08:36

from the last two Epoch both the

play08:38

microchip and the internet in that if

play08:40

demand is elastic so for example the

play08:42

demand for compute seems kind of

play08:43

unlimited and the demand for

play08:45

distribution seems kind of un limited

play08:47

that even though the costs drop the

play08:49

total throughput the total use increases

play08:52

by a lot because it becomes more

play08:53

accessible and so rather than removing

play08:57

drops or removing value these tends to

play08:58

EXP expand growth like the internet

play09:00

almost certainly expanded growth uh in

play09:02

the United States and so we think the

play09:04

same thing is going to happen here as

play09:07

well so get ready for a new wave of

play09:09

iconic companies it's almost certainly

play09:10

going to happen it's not just the

play09:12

technology which is solving problems

play09:13

that have never been solved before but

play09:14

the economic case is absolutely there um

play09:18

you know when this happened with the

play09:19

internet like we didn't really know what

play09:21

was going to be on the other side of it

play09:22

like we couldn't have predicted Google

play09:24

and we couldn't have predicted Yahoo but

play09:26

we knew it was going to be something and

play09:27

it's kind of one of those moments but we

play09:29

have some glimpses right we know like

play09:31

the social order is changing we know

play09:32

like this is a very real use case that's

play09:34

monetizing today and people are

play09:37

using we absolutely think that the

play09:38

creativity itself is going to

play09:40

change you know productivity these kind

play09:43

of mean workers like this is happening

play09:44

as well and if you really want some

play09:46

prognostication for this is all going I

play09:48

mean for the first time I say there is

play09:50

actually real line of sight to embodied

play09:52

AGI and by embodied AGI means something

play09:55

that's economically viable so you don't

play09:56

have a bunch of robots that can't work

play09:58

because they're too EXP expensive like

play09:59

actually like solving problems that we

play10:01

to have solved um and so like with that

play10:04

listen there's a lot to do this is going

play10:06

to be a major value driver I think it

play10:07

requires a ton of partnership from the

play10:08

VC Community from The Tech Community and

play10:11

certainly from DC so we appreciate all

play10:12

of you being here today and and your

play10:14

patience with my

play10:19

talk

Rate This

5.0 / 5 (0 votes)

Related Tags
AI RevolutionLarge ModelsEconomic DisruptionTech InvestmentFuturistic VisionSilicon ValleyEntrepreneurshipTechnological ShiftVenture CapitalArtificial Intelligence