Jon Siegal, Dell Technologies & Rich Gagnon, City of Amarillo | Dell Technologies World 2024

SiliconANGLE theCUBE
21 May 202420:22

Summary

TLDRIn this engaging interview at Dell Technologies World in Las Vegas, Savannah Peterson and Dave Elante discuss the innovative use of AI in city governance with Rich Kangon, Assistant City Manager and CIO of Amarillo, Texas. Rich shares how Amarillo is leveraging generative AI to bridge communication gaps, improve access to municipal services, and enhance resident engagement through a digital human named Emma. The conversation highlights the transformative potential of AI in making city services more inclusive and efficient, with implications for other industries and cities looking to democratize access to information and resources.

Takeaways

  • 🎙️ The interview is part of a three-day coverage event at Dell Technologies World held in Las Vegas, Nevada.
  • 🤝 Savannah Peterson and Dave Elante are the hosts of the show, interviewing guests about their experiences and roles in technology integration.
  • 🏙️ Rich Kangon, Assistant City Manager and CIO of Amarillo, Texas, discusses his role in implementing technology to improve city services.
  • 🔄 Rich Kangon shares a transformative vision for using technology to enhance the lives of Amarillo's citizens, including a focus on inclusivity for non-English speakers.
  • 🌐 A partnership between Dell and the City of Amarillo has led to the development of a digital human interface, named Emma, to assist residents in accessing municipal services.
  • 🤖 Emma is an AI-powered digital assistant designed to make municipal services more accessible through conversational AI, regardless of language barriers.
  • 👴 The digital human, Emma, is being further developed to cater to specific demographics, such as seniors, by creating a companion that addresses their unique needs.
  • 📈 The City of Amarillo has seen positive responses from residents and employees, with Emma becoming a favorite 'co-worker' and improving service accessibility.
  • 💡 The initiative is part of a broader strategy called 'Conversational City', which explores the use of generative AI for societal good and community impact.
  • 🛠️ The technology behind Emma involves collaboration with Dell, Nvidia, and third-party partners, utilizing AI infrastructure and services to create the AI interface.
  • 💼 The project was funded through existing budgets for website redevelopment and is expected to save costs compared to expanding the call center with human translators.

Q & A

  • What is the setting of the video script?

    -The video script is set in Fabulous Las Vegas, Nevada, during the second day of a three-day coverage event on the cube.

  • Who are the hosts of the video?

    -Savannah Peterson and Dave Elante are the co-hosts of the video.

  • What is the role of Rich Kangon in the City of Amarillo?

    -Rich Kangon is the Assistant City Manager and CIO, responsible for all technology within the city.

  • What is the partnership between Dell and the City of Amarillo about?

    -The partnership is focused on using technology, specifically generative AI, to improve the lives of the citizens of Amarillo and make municipal services more accessible.

  • What was the initial challenge that the City of Amarillo faced with its broadband project?

    -The initial challenge was that about half of the city was missing broadband access, which they later addressed.

  • How did the City of Amarillo discover the need for better language support in municipal services?

    -They discovered that they have more refugees per capita than any city in Texas, with 24% of residents not speaking English at home and one middle school having 62 languages and dialects.

  • What is the name of the AI digital human on the City of Amarillo's website?

    -The AI digital human is named Emma.

  • What was the inspiration behind the name 'Emma' for the AI digital human?

    -The name Emma was chosen as a result of a dad joke, referencing AI chatbots like Eliza from the 60s, with the last name Rillo added for humor.

  • How does the AI digital human Emma assist residents on the City of Amarillo's website?

    -Emma assists residents by having a conversation with them to help them access information and municipal services, making it easier for non-English speakers.

  • What is the long-term vision for Emma as described by Rich Kangon?

    -The long-term vision is for Emma to be a brand for the city, with the ability to recognize different languages and dialects, and introduce culturally appropriate avatars to residents during interactions.

  • What is the underlying technology supporting Emma and the City of Amarillo's AI initiatives?

    -The technology includes collaboration between Dell and Nvidia, with Dell infrastructure, Nvidia's AI enterprise software, and third-party partners, as well as a vector database provided by Prion.

  • How does the City of Amarillo ensure the quality of interactions with Emma?

    -They track thumbs up and thumbs down feedback, anonymize conversations, and have SLAs for directors to ensure questions are answered within 48 hours, improving the conversation quality over time.

  • What is the future plan for Emma's use cases in the City of Amarillo?

    -The plan includes extending Emma's use beyond the website, such as greeting visitors at the new city hall, and potentially using her for follow-up questions with residents.

  • Why is the City of Amarillo considering moving the AI from the cloud to an on-site data center?

    -It is more cost-effective to move the AI to their data center rather than moving data to the cloud, especially as the number of use cases and data sets grow.

  • How is the City of Amarillo funding the AI initiatives?

    -They have allocated funds from other projects and saved costs by implementing AI instead of expanding the call center, which would have been more expensive.

  • What is the potential impact of Emma on other industries according to John?

    -John mentions that the digital human capability of Emma could be useful in various industries, including retail, healthcare, and financial services, for improving customer and patient experiences.

Outlines

00:00

🎥 Tech Event Kickoff and Introductions

The script opens with a lively introduction to a tech event in Las Vegas, with Savannah Peterson and Dave Elante as co-hosts. They discuss their previous night's activities and a nostalgic encounter at a bar frequented by former EMC sales staff. The hosts introduce their guests, John and Rich Kango, with John being a returning guest and Rich being a first-timer on the show. Rich's role as Assistant City Manager and CIO for the City of Amarillo is highlighted, emphasizing his responsibility for all city technology.

05:01

🤖 Implementing Generative AI for Municipal Services

This paragraph delves into the partnership between Dell and the City of Amarillo, with Rich Kango sharing his vision of using technology to improve citizens' lives. A year ago, they began working together to close the digital divide in Amarillo, which led to the creation of a digital human named Emma. Emma is designed to provide a conversational interface for accessing municipal services, leveraging AI to translate and interpret various languages, thus democratizing access to information and services for non-English speakers. The development of Emma's website is discussed, along with the community's positive reception and the potential for AI to serve as a community companion, especially for the senior population.

10:04

🛠️ Behind the Scenes: Building the AI Infrastructure

The discussion shifts to the technical aspects of creating Emma, highlighting a collaboration between Dell, Nvidia, and third-party partners. The foundation of the project lies in Dell's infrastructure, including servers and storage, combined with Nvidia's AI enterprise software. The AI Factory concept is introduced, which simplifies the process of creating AI solutions. The script also touches on the use of a vector database provided by Prion, the importance of data sources, and the iterative process of refining the website and AI interactions to improve conversations and resident satisfaction.

15:04

🌐 Future Visions and Financial Implications

Rich Kango outlines the future vision for Emma, which includes expanding her role beyond the website to greet visitors in person at the new city hall. The decision to develop in the cloud and later migrate to an on-site data center is explained, focusing on cost-effectiveness and the growing number of use cases. The script also reveals that the project was funded through existing budgets for website redevelopment and savings from not expanding the call center, showcasing the financial benefits of implementing AI.

20:05

🌟 Expanding AI Applications and Closing Thoughts

The final paragraph discusses the broader implications of the AI project, with other cities expressing interest in the model implemented by Amarillo. Dell announces a generalized solution for digital assistance, based on the collaboration with Amarillo, making it easier for other cities to adopt similar technologies. John, a representative from Dell, shares his hopes for the expansion of AI applications across various industries. The conversation concludes with aspirations for the future impact of AI and the potential for broader community involvement.

📺 Sign Off from The Cube

The script concludes with Savannah Peterson signing off from The Cube, summarizing the event's focus on making AI a reality in enterprise tech and inviting viewers to continue following the event for more insights.

Mindmap

Keywords

💡AI

AI, or Artificial Intelligence, refers to the simulation of human intelligence in machines that are programmed to think like humans and mimic their actions. In the video, AI is central to the theme as it is being used to create a digital human named Emma, which serves as an interface for municipal services, enhancing accessibility and communication for the citizens of Amarillo.

💡Digital Human

A digital human is a virtual representation of a human being, capable of interacting with users in a natural and human-like manner. In the context of the video, Emma is a digital human developed for the City of Amarillo's website, providing a conversational interface for residents to access city services and information.

💡Generative AI

Generative AI refers to artificial intelligence systems that can generate new content, such as text, images, or audio, that is similar to the data they were trained on. The video discusses the use of generative AI in creating Emma, allowing her to have natural conversations with users and provide personalized responses.

💡City of Amarillo

The City of Amarillo is the local government entity for Amarillo, Texas. It is highlighted in the video as a pioneer in using AI to improve citizen services. The city's innovative approach includes the development of Emma, a digital human designed to assist residents in accessing municipal services.

💡Dell

Dell is a multinational technology company that provides a range of products and services, including AI solutions. In the video, Dell collaborates with the City of Amarillo to develop and implement the AI-driven digital human, Emma, showcasing Dell's role in advancing smart city technologies.

💡Nvidia

Nvidia is a technology company known for its graphics processing units (GPUs) and AI enterprise software. The video mentions a collaboration between Dell and Nvidia, indicating that Nvidia's technology is part of the infrastructure supporting the AI solutions being developed for the City of Amarillo.

💡Cube

In the video, 'Cube' refers to a platform or event where tech news and innovations are discussed and showcased. The script mentions 'the cube' as the setting for the interview, indicating that the conversation is taking place within a tech-focused environment.

💡Smart Cities

Smart cities are urban areas that use different types of electronic data collection sensors to supply information which is used to manage assets, resources, and services efficiently. The video discusses the City of Amarillo's efforts to become a smart city through the implementation of AI technologies like Emma.

💡AI Factory

The AI Factory, as mentioned in the video, is a concept or platform that simplifies the process of creating and deploying AI solutions. It is used in the context of the video to describe the collaborative effort between Dell and Nvidia to produce AI-driven interfaces like Emma.

💡Conversational AI

Conversational AI refers to systems that can interact with humans through natural language processing (NLP). The video emphasizes the use of conversational AI in Emma, which can understand and respond to user queries, facilitating a more human-like interaction with city services.

💡Digital Transformation

Digital transformation involves the integration of digital technology into all areas of a business or government, fundamentally changing how one operates and delivers value to customers. The video discusses the City of Amarillo's digital transformation journey, particularly through the creation of Emma, which represents a significant shift in how the city provides services to its residents.

Highlights

Savannah Peterson and Dave Elante host a discussion on the transformative use of technology in the City of Amarillo, Texas.

Rich Kangon, Assistant City Manager and CIO of Amarillo, shares his role in implementing technology across the city.

A partnership between Dell and the City of Amarillo aims to improve citizen life through technology.

The city's Broadband project helped identify a need for improved digital access, particularly for non-English speakers.

Introduction of 'Emma', a digital human interface on the city's website, to assist residents in accessing municipal services.

The use of generative AI to create a conversational interface for the city's website, making services more accessible.

The name 'Emma' for the AI was chosen through a light-hearted dad joke, reflecting a friendly approach to technology.

Senior citizens find companionship in Emma, leading to the idea of a community companion for addressing senior issues.

The city of Amarillo's approach to digital innovation includes a 'digital dignity rights and privacy' agenda to protect residents.

The collaboration between Dell, Nvidia, and third-party partners underpins the AI infrastructure for Emma.

The AI Factory concept by Dell, in partnership with Nvidia, simplifies the process of creating AI solutions for cities.

The city's website is revamped to facilitate better conversations with Emma, improving resident interactions.

Emma's development involved extensive research and feedback from city staff and residents to create a relatable avatar.

Long-term plans for Emma include recognizing different languages and dialects, and presenting culturally appropriate avatars.

The cost-effectiveness of implementing Emma compared to expanding the city's call center with human operators.

Other cities are showing interest in the City of Amarillo's approach to digital assistance with AI.

Dell's new gen solution for digital assistance aims to make AI implementation repeatable and streamlined for cities.

Rich Kangon's vision for the future includes expanding Emma's use beyond city services to support community learning.

John from Dell anticipates the digital human interface's applicability across various industries beyond city governance.

Transcripts

play00:07

good morning Dell fans and welcome back

play00:09

to Fabulous Las Vegas Nevada we're

play00:12

Midway through day two of our three days

play00:14

of coverage here on the cube my name is

play00:15

Savannah Peterson joined by my co-host

play00:17

and laptop fumbler Dave elante hey how's

play00:20

it how's it going steady hands

play00:23

aftert late night yeah hey we were we

play00:26

were pretty behaved last night for Vegas

play00:29

in particular although I went by the

play00:32

what used to be we used to call it the

play00:33

circle bar oh yeah and of course back in

play00:36

back in the day EMC world it was the

play00:38

circle bar and of course all the former

play00:40

EMC sales guys were there so I was

play00:42

trying to sneak to my room but I I

play00:44

couldn't get by them was fun good little

play00:47

reunion it's it's it's it's always worth

play00:49

having a big reion being reunions we've

play00:50

got cube veterans on the show John se

play00:52

thankk you so much for being here

play00:54

pleasure as always it's it's a joy

play00:56

you've got your big smiles you always

play00:57

bring us a fantastic customer story and

play00:59

I'm very excited for a cube first timer

play01:02

I believe second second time oh second

play01:05

repeat visitor sorry first time with me

play01:06

then we we'll cut that in rich kangon

play01:09

thank you so much for being here happy

play01:11

too uh you have a very unique role we

play01:14

don't always get to have government Pros

play01:16

on the show with us tell us a little bit

play01:19

about your role at the City of Amarillo

play01:20

just to get us started sure so I'm the

play01:22

assistant city manager and CIO

play01:24

responsible for all technology in our

play01:26

city casual just all the technology

play01:28

within within a municipality some pretty

play01:31

exciting stuff so John talk to me I know

play01:33

you were really excited to bring Rich on

play01:36

what's going on here what's the

play01:37

partnership look I mean about a year ago

play01:39

actually we started working together uh

play01:41

dell uh in the City of Amarillo and uh

play01:43

and Rich will share but it is he is got

play01:46

a transformative Vision um for how to

play01:49

take technology and apply it to good

play01:51

right and and so what you're going to

play01:52

see here is uh and I'll let him talk

play01:54

more about it but it it it's really

play01:56

about um making life better for the

play01:59

citizens of his of his uh of his city um

play02:02

and not only that but he's also

play02:03

advocating to do the same and we're now

play02:06

working with him to do the same and make

play02:07

it more repeatable for other cities

play02:08

around the country right so how did you

play02:12

end up meeting each other did you reach

play02:14

out to De yeah what is what does this

play02:16

look like if I'm a city and I want to

play02:17

partner with a power player like Del

play02:19

sure so it started actually after our

play02:21

Broadband project we had about half of

play02:23

our city that was missing sense right so

play02:25

we closed that Gap and in doing that

play02:28

what what I discovered honestly about my

play02:30

own city is we have more refugees per

play02:31

capita than any city in Texas 24% of our

play02:34

residents don't speak English at home we

play02:36

have one Middle School speaking 62

play02:38

languages and dialects in the same

play02:40

school so oh my gosh I I'm a nerd I

play02:43

started with hugging face here you're

play02:45

amongst nerd started playing with models

play02:47

and I was really impressed with the

play02:48

abilities uh to translate and thought

play02:51

hey this there's something here um

play02:53

reached out to Dell and said hey I have

play02:55

this crazy idea what if we use

play02:57

generative AI on our website and made

play02:59

that an interface into services so

play03:01

instead of having to know English or

play03:03

typing you could just have a

play03:04

conversation and get access to

play03:06

information and Municipal

play03:09

services that is so important we talk a

play03:11

lot you know and we joke about it a

play03:13

little bit there's a lot of Buzz around

play03:14

democratizing Ai and what that really

play03:16

means and I think there's a lot

play03:18

of a lot of lip service in that space a

play03:21

little bit sometimes but the real

play03:22

practical application is how is it going

play03:23

to how does it democratize access to

play03:26

even resources and tools and information

play03:27

which is exactly what you're doing you

play03:29

have a for us don't you I did I could

play03:31

show you would you mind pulling that up

play03:33

we'd love to see it so this is actually

play03:35

our our website in in development right

play03:38

now it's it'll go live in October and it

play03:41

is a digital human that resides on our

play03:44

website that allows residents to connect

play03:48

to the website she'll come up and ask

play03:49

you know what services you need access

play03:51

to we do it in text for those that are

play03:54

that are hearing challenged and then you

play03:56

just ask a question so how do I pay my

play03:58

water bill and then she will tell you

play04:00

how to do that and then navigate you to

play04:02

the site uh to the place to pay your

play04:04

water bill and this is Emma this is Emma

play04:06

now how'd you come up with the name I

play04:08

you know crowd strike has Charlotte IBM

play04:11

in the 60s had a thing called Eliza

play04:13

which was like the original AI chat bot

play04:15

how didd you come up with Emma Watson to

play04:17

be to be transparent it was the result

play04:19

of a dad joke we were looking at the

play04:20

names and Emma was one of them and I

play04:22

said well if she's Emma her last name

play04:24

has to be rillo and everybody laughed we

play04:27

were like okay that's a thing so

play04:30

wow that is just very good two daughters

play04:34

yeah that was that was great how old are

play04:36

your daughters 30 I have three

play04:38

grandchildren now so they're grown

play04:40

awesome what what do your grandchildren

play04:41

or your children think of Emma they

play04:43

adore her like yes what a lovely thing

play04:46

to say about an AI they they actually do

play04:48

and it was really funny when when we

play04:50

first started testing her um my head of

play04:52

innovation Kristen showed her kids and

play04:55

her daughter said you know that's the

play04:56

sixth grade teacher everybody wants to

play04:58

have and I knew we were in the gold

play05:00

right that's the response that we wanted

play05:02

this is interesting you your reaction

play05:05

because I mentioned Eliza yeah Eliza in

play05:09

the literally in the 60s I think it was

play05:11

late 60s they would put Eliza in front

play05:14

of folks that they felt had

play05:16

depression because yeah and so it

play05:19

companionship yes and so you think about

play05:22

AI it's much better than sitting on a

play05:24

phone and you know a call center right

play05:26

so actually you know that's something

play05:28

that we're having to deal with so when

play05:29

we did our initial testing um what we

play05:32

discovered with our senior population is

play05:34

exactly that our initial testers they

play05:37

won't stop talking to her so I came back

play05:40

and you know two and a half later hours

play05:42

later they're talking about their

play05:43

grandchildren it's so instead of

play05:45

fighting that we're trying to embrace

play05:47

that and work with some of the

play05:48

nonprofits and actually work with our

play05:50

our senior community so that we could we

play05:53

could have a community companion if you

play05:55

will that addresses senior issues it's a

play05:58

weird dynamic do you when you use chat

play05:59

GPT do you don't you do you say please

play06:01

and thank you I I do I do sometimes just

play06:06

in case the machines come after us so

play06:08

but Emma L is one of the versions right

play06:10

so did you tell Emma L is a is a another

play06:13

version if you will iteration of Emma

play06:15

for the senior community yeah so we're

play06:17

working with nonprofit profits to figure

play06:19

out okay how do we fund a companion for

play06:21

our seniors and let the seniors Define

play06:23

you know what issues do they want to

play06:25

talk about what personality will she

play06:26

have and I think in the long run prous

play06:29

we're going to start to see that we're

play06:30

going to see it with our homeless

play06:31

Community we'll see it in education so

play06:34

we're really making a study we call it

play06:36

conversational City we're doing a study

play06:38

around what does what does generative AI

play06:41

for good look like in a city in a

play06:43

community and kind of in society at

play06:45

large how do we use that to make impact

play06:47

how I'm I'm so I'm real glad we're

play06:49

having this conversation this is a great

play06:50

one what when you're communicating with

play06:53

your you know we we all live in a tech

play06:55

bubble we're talking to fellow nerds all

play06:57

the time we all have our great opinions

play06:58

and and and dreams for this new

play07:00

technological Revolution how are the

play07:02

citizens of the City of Amarillo

play07:04

embracing this what's the response been

play07:06

like as you do some of this user

play07:07

feedback you know it's been really

play07:08

interesting in the beginning you know

play07:10

anytime you innovate whether that's in a

play07:11

corporate setting you you have to create

play07:13

a a safe space right to innovate in when

play07:16

you're in government that safe space has

play07:18

to extend out to your residents so we

play07:20

really didn't hide from that we hit that

play07:22

on the front end we passed what we call

play07:24

our digital dignity rights and privacy

play07:26

agenda so it's a framework by which

play07:29

which we can ingest new technology and

play07:32

protect the rights and privacy of our

play07:34

residents we're very transparent so we

play07:37

wanted to address the fear on the front

play07:38

end that's been incredibly helpful and

play07:40

now that they there's a a level of

play07:42

comfort that okay the city's doing the

play07:44

right things and I can see that uh now

play07:47

theyve they' they've embraced the

play07:48

technology and it's really fun actually

play07:51

to introduce her to different groups

play07:53

because until you see her you know it's

play07:55

just a concept but you know I have I

play07:58

have employees that tell me that she's

play07:59

her you know their favorite coworker

play08:02

amaz so the vision here is to bridge

play08:04

that Communications Gap that's it

play08:05

amongst the citizens but what's that

play08:07

this obviously wasn't eight years in

play08:09

development I mean just very rapid time

play08:12

to development time to Market what's the

play08:14

tech underneath this whole thing so a

play08:16

lot of the so first of all this is a

play08:18

collaboration between Dell and Nvidia

play08:20

and some of our third third party

play08:22

Partners as well and part of our open

play08:23

ecosystem in fact this is a a great

play08:26

example of the Dell AI Factory with

play08:28

Nvidia in action really more than

play08:30

anything else right we've been talking a

play08:31

l about the factory um you know and and

play08:33

underneath it if you will is is Dell

play08:35

infrastructure right so you can imagine

play08:38

uh whether it's our servers and our

play08:40

storage um but also working with Nvidia

play08:43

around their AI enterprise software um

play08:45

and their infrastructure as well uh and

play08:48

frankly a lot of this is also our

play08:49

services I mean this is was really

play08:52

critical here and and the early going

play08:54

and frankly still ongoing basis is

play08:57

helping the community figure out what

play08:59

are the right data sources how to

play09:01

integrate those data sources into the

play09:02

model picking the model picking the use

play09:04

cases um implementing the platform

play09:07

integrating it with some other third

play09:09

party software that we're using and in

play09:12

addition to Nvidia uh and Dell uh to

play09:15

create that AI Avatar interface uh

play09:18

that's so unique and so conversational

play09:20

and really I think what's changing the

play09:21

game here so you know underneath the

play09:24

covers to your point is is Dell and

play09:26

Nvidia infrastructure as well as some

play09:27

software but what we're really doing

play09:30

from a Dell perspective is providing

play09:31

that what the AI Factory is is that easy

play09:33

button right so uh that's what everybody

play09:35

wants these days that's what they want

play09:37

so but yeah under the covers look

play09:38

there's a lot of complexity where you

play09:40

know for sure uh but we're hoping that

play09:43

we're providing that great simplifier

play09:44

that allows them to turn all their great

play09:46

data train it optimize it and create

play09:49

these outcomes that about it's a rag are

play09:51

you like vectorizing the ex exactly and

play09:55

and the the vector database is is a

play09:58

well-known Vector database an open

play09:59

source or is it an integrated um it is

play10:03

it's actually it's it's actually prion

play10:05

that's providing the vector database

play10:06

services for us um we made the decision

play10:09

early you know you've got to think about

play10:10

where your data sources are um we

play10:13

actually all of her her data comes from

play10:15

our website which has been really

play10:17

interesting to me because it's forced us

play10:19

to relook at the way we we inter

play10:21

interface with our residents period so

play10:23

it didn't take very long for departments

play10:25

to realize hey we don't do this very

play10:27

well like it doesn't facilitate a

play10:30

conversation and if it doesn't

play10:32

facilitate a conversation for Emma it's

play10:34

clearly not answering the questions that

play10:35

our residents really have so we've gone

play10:38

Department by department and revamped

play10:40

our entire website you could just bolt a

play10:42

digital human on your existing website

play10:44

it won't work you won't have you'll have

play10:46

garbage conversations so Department by

play10:48

Department we've engaged with our

play10:50

residents and asked what do you want to

play10:51

know about water what do you want to

play10:53

know about finance and we've defined

play10:55

those conversations that builds the

play10:57

website and now as we learn more we just

play11:00

update the website that gets ingested U

play11:02

into into the vector database and we use

play11:04

Rag and it keeps us updated if you

play11:07

notice on the demo there's a thumbs up

play11:08

thumbs down we actually track those we

play11:11

track every conversation now we're

play11:12

anonymized I don't know who's having it

play11:14

but I can see if it was good or bad I

play11:16

can tell if Emma could or couldn't

play11:18

answer it and now we have slas for our

play11:20

directors so they see okay here's

play11:23

questions we need to get answered in the

play11:24

next 48 hours so the conversation

play11:27

improves every day as we go forward yeah

play11:29

I'm sure we've saw this with our QB eye

play11:32

we had way more thumbs

play11:34

Downs you know and you have to respond

play11:37

to them and you have to you know

play11:38

continue to iterate are you using um

play11:41

multiple llms are you playing around

play11:43

with them what are you finding there

play11:45

well the website's just our first use

play11:47

case I have like a two-year road map

play11:48

right um and for that is that is one llm

play11:52

but we're building a new city hall when

play11:53

you walk in Emma will greet you in the

play11:55

front door and tell you where to go that

play11:56

can be a much smaller language model so

play11:58

the the Persona will be the same but the

play12:00

use cases will will will Define what llm

play12:03

that we use what H so she's obviously a

play12:07

a humanoid looking robot or a digital

play12:09

human right how did you decide on her

play12:11

form factor that was like nine weeks

play12:14

worth of worth of research uh you know

play12:16

we worked with unique who actually built

play12:18

her we had our internal call call center

play12:21

staff actually involved and then we had

play12:23

residents involved and we went through

play12:25

iteration after iteration she'll end up

play12:27

being Emma is the brand for the city but

play12:30

our long-term vision is you know now

play12:32

with the with uh Speech DET you know

play12:34

speech DET text you can actually

play12:35

recognize languages and dialects we want

play12:38

to get to the point where when you

play12:41

interface with us Emma can recognize

play12:43

okay that may be a Somalian man and then

play12:46

introduce a different Avatar that is

play12:49

culturally appropriate to that person so

play12:51

ideally when we're all said and done no

play12:53

matter who you are when you interface

play12:54

with our city you'll speak to someone

play12:56

that looks and feels like you seems like

play12:58

a little thing it's not but it's a

play13:00

really big thing it makes people feel

play13:01

like okay they they they really care

play13:03

about us this is running in your data

play13:06

center it's not right now right now so

play13:08

we took kind of an old school approach

play13:10

we're developing in the cloud I did not

play13:12

want to wait right I this gave me a year

play13:14

of development while Dell got their

play13:16

their infrastructure pieces ready and

play13:18

now we'll migrate it on site okay so why

play13:20

don't you just keep it in the cloud why

play13:22

are you going to migrate it back on site

play13:23

because of the number of use cases that

play13:25

I've already formed and it's cheaper to

play13:26

move the AI to my data than my data to

play13:28

the and why is it cheaper it's just that

play13:31

the the what it cost to just run tokens

play13:33

in the cloud yeah well and the data sets

play13:35

right so we have some use cases where

play13:38

we're working on something now you know

play13:40

you think about a conversation that's

play13:41

two-way right now a resident asks a

play13:45

question and Emma gives an answer but

play13:47

we're making some progress on follow-up

play13:49

questions from Emma so now we can ask a

play13:51

question Emma could ask ask a question

play13:54

and residents could give an answer so a

play13:56

simple example is we're giving updates

play13:58

for count for the first time this week

play14:00

from Emma so she'll tell residents

play14:02

here's what happened in Council yeah I

play14:05

can ask what did you think about that

play14:06

and now my residents give answers we're

play14:09

using Insight software that typically

play14:11

you see in commercial operations to

play14:14

gather that now I have a sentiment

play14:15

engine for my entire city that's

play14:17

updating on every topic so you could see

play14:21

where that would get expensive as data

play14:23

sets start to grow and did did you how'd

play14:26

you pay for this was it was it

play14:28

incremental budget

play14:29

did you have to steal from other budgets

play14:31

no actually I've been plotting this for

play14:33

a few years so we had some funds for

play14:36

redeveloping our website and we sat on

play14:39

those and added to them and I kept

play14:40

telling our our Communications

play14:42

Department we're not spending it yet

play14:43

because this generative AI thing is

play14:45

going to be something and then when we

play14:47

ran the numbers for expanding our call

play14:49

center uh in order to meet the need we

play14:51

would have to spend about 1.8 million a

play14:54

year in additional salary to have all

play14:56

the languages and translators and we're

play14:58

doing it for a frac action of that so

play14:59

not only did we we had the money through

play15:01

other through other projects but but it

play15:04

actually saves us and uh show the value

play15:06

ad which is ex John I'm curious are

play15:09

other cities like this reaching out to

play15:10

you absolutely absolutely so uh as I

play15:13

mentioned at the outset Rich has been uh

play15:15

advocating as well and we've been he's

play15:16

actually been speaking to other

play15:18

customers uh with us in our on our

play15:20

behalf uh there's there's a tremendous

play15:21

amount of Interest so really what we

play15:23

announced yesterday was the Dell gen

play15:25

solution for digital assistance which

play15:27

actually be in demo right behind us

play15:28

right now

play15:29

uh and um it really is we've taken all

play15:32

the learnings that rich that rich just

play15:34

shared with you uh and we've simplified

play15:36

it made it a repeatable solution so that

play15:37

other cities can actually streamline the

play15:40

process what what we did with Rich As I

play15:41

said started a year ago strong

play15:43

partnership he's is uh a much a partner

play15:46

as a customer really at the end of the

play15:47

day uh but but we've taken those

play15:49

learnings and now I think we've really

play15:50

streamlined it and uh you know it's now

play15:53

the ability to we still need the

play15:54

services component to help customers

play15:55

figure out the data sources and

play15:57

everything else but we've packaged a

play15:59

solution in such a way where now it's

play16:00

going to be easier to deploy including

play16:02

on Prem or at the edge because based on

play16:04

what You Know Rich described uh there's

play16:05

a lot of advantage to that whether

play16:07

that's privacy or security or or cost uh

play16:10

so we're making that now simpler than

play16:12

ever to deploy on Prem you've obviously

play16:14

built up an application portfolio over

play16:16

the the years as you get experience with

play16:20

Technologies like this how are you

play16:23

thinking about the your portfolio in

play16:25

other words what areas of the portfolio

play16:27

do you feel like hm

play16:30

what I was doing there I can now do

play16:32

differently for one tenth the cost all

play16:34

of them everything everything with so we

play16:37

actually restructured even we re we've

play16:39

reorganized around the the change that's

play16:42

coming like we all see it this wave of

play16:44

change coming in and I had two concerns

play16:46

I was really concerned with our change

play16:47

management process and how we how we

play16:50

innovate so we restructured I moved

play16:52

communication Innovation and our pmo

play16:55

into the same office so now we're

play16:57

actually going through our entire

play16:59

application set I'll give you a simple

play17:01

example um illegal dumping was an issue

play17:03

that we really struggled with we put

play17:05

that in the Innovation department they

play17:07

did a they did an engagement with our

play17:09

residents and we found out that we

play17:10

didn't never solve the problem because

play17:12

it's actually six different problems you

play17:14

know we getting we engaging with

play17:16

residents they told us exactly what the

play17:18

problems were we're doing the same thing

play17:20

with applications well the outcome of

play17:23

that is uh we now use we have we we use

play17:26

machine learning we've got dump sites

play17:29

we've dropped our our fuel cost by

play17:31

$480,000 this year and that's trash that

play17:34

is applying just a little bit of AI in

play17:36

our and you know to to solid waste and

play17:39

we're seeing that across every

play17:40

department so I think fundamentally

play17:42

we're changing the way that we look at

play17:44

how we do business oh your budget

play17:45

director must be happy very well and

play17:48

you're getting teams out of silos I mean

play17:49

I think that's a big thing theme that we

play17:51

hear a lot and even within the partner

play17:53

ecosystem that Dell has and everyone

play17:55

else it used to be this kind of Silicon

play17:57

Valley secret whisper whisper whisper

play17:58

we're doing doing these things or

play17:59

whatever is happening or this team is

play18:00

fighting for this budget and I really do

play18:02

feel we've talked about a lot on the

play18:03

show that this water level is rising

play18:05

together as we all collaborate to design

play18:07

the future of our lives and our family's

play18:10

lives and and everything else all right

play18:12

gentlemen last question for you since

play18:13

you're both Cube veterans and I'm sure

play18:15

we'll have you back what do you hope to

play18:16

be able to say on this stage with Dave

play18:19

and I next time you're here that you

play18:21

can't say

play18:23

today that we're having two a

play18:25

conversations and that Emma has been has

play18:28

been extended beyond the walls of the

play18:29

city and is helping our little

play18:31

Guatemalan children in Pampa learn

play18:33

English so I I think we're going to see

play18:36

her applied more broadly across our

play18:38

community love that we can't wait to

play18:40

celebrate that with you what about you

play18:41

John I hope we have another hundred

play18:43

examples of what rich just went through

play18:44

yes yes um and look not just not just in

play18:49

uh in city government and in smart

play18:51

cities as is really building here but

play18:53

one of the things we didn't talk about

play18:54

is the same exact capability this this

play18:56

uh digital human capability and

play18:58

interface

play18:59

is useful in several Industries uh we're

play19:01

seeing interest not just in the cities

play19:03

which I mentioned earlier because Rich

play19:04

has been helping but in retail such as

play19:07

online as well as physical stores

play19:09

actually even more so uh we're getting

play19:11

interest in healthcare to really help

play19:13

bridge the the the care teams with the

play19:15

patients whether it's you know when they

play19:17

when they first visit or when they when

play19:18

they leave or actually during their

play19:20

their stay um and so and financial

play19:23

services another one so I'm I also hope

play19:25

that in addition to the hund of those we

play19:27

have a hundred of other other uh

play19:29

Industries um examples as well so this

play19:32

is this is taken off and again the we we

play19:34

are so grateful to Rich and his

play19:35

collaboration here and we hope to uh

play19:37

help to continue to grow his uh his

play19:40

community as well well we look forward

play19:41

to hearing this the story evolves and

play19:43

we'll have all hundred of those City

play19:44

municipalities up on this stage one big

play19:46

cozy little happy family on our next

play19:48

podcast yeah sounds great Deltech World

play19:50

2025 can't wait to see it Dave thanks so

play19:52

much for another fabulous interview

play19:54

thank both of you for coming to hang out

play19:55

this is a real fun one that I think

play19:56

applies to a lot of people we're making

play19:58

AI real here on the cube folks and thank

play20:00

you for tuning in from home we're Midway

play20:02

through day two of Deltech World here in

play20:05

beautiful Las Vegas Nevada my name is

play20:06

Savannah Peterson you're watching the

play20:07

cube the leading source for Enterprise

play20:09

Tech news

Rate This

5.0 / 5 (0 votes)

関連タグ
AI AssistantCity GovernanceDigital HumanTech InnovationCitizen ServicesAmarillo CityLanguage BarrierCommunity EngagementData PrivacySmart CityAI Factory
英語で要約が必要ですか?