Jascha Goltermann: The Impact of AI on UX Design - Hatch Conference 2023

Hatch Conference
20 Feb 202427:34

Summary

TLDRYasha Golderman's talk at a conference delves into the transformative impact of AI on UX design, using Booking.com's AI Trip Planner as a case study. He discusses the evolution from traditional UX design to incorporating generative AI, emphasizing the necessity for designers to understand AI's capabilities and limitations. Golderman highlights the importance of prompt engineering, setting AI guardrails, and maintaining user trust and control, while advocating for designers to stay empathetic and adapt to the changing landscape of AI-enhanced design.

Takeaways

  • 🚀 The speaker emphasizes the growing interest in managing people and the nonlinear ways of managing a career in the tech industry.
  • 🌟 Yasha Goldman's talk focuses on the impact of AI on UX design, specifically how AI is integrated into products rather than design tools.
  • 🔍 AI's presence is exemplified by everyday applications like image recognition and search functionalities in smartphones, showcasing its accessibility and integration into user experiences.
  • 🏢 Yasha's background in UX for over a decade and his role at Booking.com, where he manages designers and leads projects like the AI Trip Planner, sets the stage for his expertise on the subject.
  • 🌐 Booking.com's scale, with 700 million monthly visitors and a strong data-informed approach, underscores the company's user-centric mindset and the potential for AI applications.
  • 🤖 The distinction between AI, machine learning, deep learning, and generative AI (Geni) is clarified, highlighting the latter's role in creating diverse data types.
  • 💬 The integration of Geni into everyday tools and platforms like Notion and Grammarly indicates a shift in user expectations and the need for designers to adapt.
  • 🛍️ The AI Trip Planner at Booking.com is presented as a case study, illustrating how AI can enhance services like virtual travel agents with more natural and context-aware interactions.
  • 🛑 The importance of setting guardrails for AI to ensure appropriate output and maintain brand values is stressed, especially in avoiding sensitive topics and malicious intent.
  • 🔄 The need for designers to shift focus from UI to AI, considering the quality of AI output as a defining factor in user experience, is highlighted.
  • 🔄 The talk concludes with a call for designers to understand AI, engage in prompt engineering, and embrace the concept of hyper-personalization to stay relevant in a rapidly evolving field.

Q & A

  • What was the main topic of Yasha Golderman's talk at the conference?

    -Yasha Golderman's talk focused on the impact of AI on UX design, specifically discussing how AI can be integrated into products to improve user experiences, using the AI trip planner at Booking.com as a case study.

  • What is the difference between AI, machine learning, and deep learning as mentioned in the script?

    -AI refers to the broader field of study of artificial intelligence. Machine learning is a subset of AI where computers are trained on large datasets to find patterns and make decisions. Deep learning takes this further by creating artificial neural networks with multiple layers to mimic the human brain, allowing the computer to learn more complex patterns.

  • What is the role of generative AI (gen AI) in the context of the talk?

    -Generative AI, or gen AI, is a type of AI that can create new data such as text, images, or video. In the talk, gen AI is highlighted for its potential to enhance user experiences in products, with examples of how it's already integrated into everyday tools and the Booking.com AI trip planner.

  • How has Booking.com utilized AI in its services prior to the development of the AI trip planner?

    -Booking.com had previously developed the Booking Assistant, which used machine learning models to help customers with trip-related questions. However, it was limited to specific topics and did not understand broader conversation contexts or apply real-world knowledge until the integration of gen AI.

  • What is the AI trip planner, and how does it differ from the previous Booking Assistant?

    -The AI trip planner is an enhancement of the Booking Assistant, integrated with open AI's GPT model, allowing it to discuss any travel-related topic in a more natural way, understand broader conversation contexts, and apply real-world knowledge to provide more personalized and accurate recommendations.

  • What is the significance of the number of visitors, listings, and reviews that Booking.com has in relation to AI?

    -The large volume of data from Booking.com's 700 million monthly visitors, nearly 30 million global listings, and over 250 million guest reviews provides a rich dataset for AI to learn from and offer personalized recommendations, enhancing the AI's ability to understand and cater to user needs.

  • Why is prompt engineering important for designers working with AI?

    -Prompt engineering is crucial as it involves instructing the AI on how to respond appropriately to user inputs. It helps in setting the AI's personality, defining guard rails, and ensuring the AI's responses align with the brand's values and user expectations.

  • How should designers approach the design process when working with gen AI?

    -Designers should shift their focus from UI to AI, mapping situations rather than steps, as gen AI interactions are nonlinear. They need to consider user flows that can adapt to various AI responses and ensure the AI's output is of high quality and meets user expectations.

  • What are some of the ethical considerations when integrating AI into a product?

    -Designers must consider setting guard rails to prevent inappropriate outputs, respecting sensitive subjects, and accounting for potential malicious intent from users trying to push the AI beyond its intended limits.

  • How can designers ensure users feel in control when interacting with AI-enhanced products?

    -Designers can ensure users feel in control by not using their data to train the AI models, allowing users to delete their conversations, and providing clear examples of how to interact with the AI, as well as managing expectations through disclaimers and welcome messages.

  • What are some resources recommended in the script for designers to learn more about AI and prompt engineering?

    -The script recommends Ben B's newsletter and the Invisible Machines podcast for staying updated on AI, the Prompt Engineering Guide for learning about instructing AI, and the Delo report 'Connecting with Meaning' for understanding hyper-personalization.

Outlines

00:00

🎤 Speaker Introduction and Career Paths

The speaker begins by discussing their preparation to introduce the next presenter, Yasha Goldman, and reflects on a podcast about career paths. They engage the audience by asking who are individual contributors and who aspires to manage people, highlighting the interest in career growth. The introduction segues into Yasha's role as a design manager at booking.com, focusing on strategic design projects that leverage AI. Yasha's background in UX for a decade and his current projects, including the AI trip planner, are briefly outlined, setting the stage for his talk on AI's impact on UX design.

05:01

🤖 Basics of AI and Its Impact on UX Design

This paragraph delves into the fundamentals of AI, machine learning, and deep learning, explaining how they work and their applications in generative AI. The speaker illustrates the prevalence of AI in everyday tools and its influence on user expectations. The talk then shifts to the speaker's work at booking.com, discussing the company's scale, user-centric approach, and commitment to data-informed design. The AI trip planner is introduced as a case study to explore AI's impact on UX, emphasizing the integration of AI into existing products and services rather than creating entirely new ones.

10:01

🗺️ The Evolution of the Booking Assistant to AI Trip Planner

The speaker recounts the history of booking.com's virtual travel agents, from the initial AI-enhanced Booking Assistant in 2017 to the current AI Trip Planner, which integrates with open AI's GPT model. The evolution is marked by a transition from keyword-based responses to a more natural, context-aware conversational ability, thanks to generative AI. The AI Trip Planner is described as a feature within the booking.com app, offering personalized travel recommendations by leveraging the company's extensive data on accommodations, guest reviews, and more.

15:02

🛣️ Designing for AI: Nonlinear User Experiences

The speaker discusses the challenges and considerations in designing for AI, emphasizing the nonlinear nature of AI interactions compared to traditional user flows. They introduce the concept of 'prompt engineering' as a new skill for designers, which involves instructing AI with examples and setting guidelines for its responses. The importance of setting guardrails for AI to prevent inappropriate outputs and maintaining brand consistency is highlighted. The speaker also stresses the need for designers to shift focus from UI to AI, considering the quality of AI output as a defining factor in user experience.

20:03

🔒 Managing User Trust and Control in AI Interactions

This paragraph focuses on the importance of maintaining user trust and control in AI-driven products. The speaker discusses the need for transparency about AI's limitations, managing user expectations, and providing examples of possible interactions. They also address the importance of user control, such as the ability to delete conversations and the assurance that user data is not used for model training. The speaker advocates for tight feedback loops to improve AI output quality and match user expectations.

25:04

🛠️ The Future of Design in the Age of AI

In the concluding paragraph, the speaker reflects on the implications of AI for the design profession. They assert that core design skills, particularly empathy, remain crucial but suggest that designers will need to become proficient in AI to understand its opportunities and risks. The speaker introduces resources for learning about AI and prompt engineering, highlighting the growing importance of these areas. They emphasize that AI will not replace the role of designers but will change it, necessitating adaptation and the acquisition of new skills to stay relevant in a rapidly evolving field.

🌐 Final Thoughts and Opportunities for Connection

The speaker wraps up with final thoughts on AI's role in enhancing rather than replacing the tasks of designers. They stress that the role of designers has always evolved and will continue to do so. The speaker invites the audience to connect with them on LinkedIn or ADP list and expresses openness to meeting for coffee in Amsterdam, signaling a willingness to engage in further discussions. They also look forward to any questions from the audience, indicating an interactive and open-ended conclusion to their talk.

Mindmap

Keywords

💡Individual Contributors

Individual contributors are professionals who focus on their specific tasks and do not manage a team. In the context of the video, the speaker uses this term to identify the audience members who are not in supervisory roles but are interested in potentially managing people in the future. The concept is tied to career progression and the desire to explore different paths within one's professional journey.

💡Career Path

A career path refers to the trajectory of professional development and job opportunities an individual may follow over their working life. The video discusses the idea that career paths are not always linear and can include various roles such as managing teams or being an individual contributor. The speaker encourages the audience to think about their long-term career goals and how they might incorporate different experiences.

💡AI (Artificial Intelligence)

Artificial Intelligence, or AI, is the simulation of human intelligence in machines that are programmed to think like humans and mimic their actions. In the video, AI is central to the discussion, particularly in its application to UX design and the development of the AI trip planner. The speaker explores how AI can enhance user experiences and is becoming more accessible and integrated into everyday tools.

💡UX Design

UX Design, or User Experience Design, is the process of designing products with a focus on the user's experience and interaction. The video emphasizes the impact of AI on UX design, showcasing how AI can be leveraged to create more personalized and responsive user experiences, as illustrated by the AI trip planner case study.

💡Booking.com

Booking.com is a prominent online platform for booking accommodations and is highlighted in the video as the company where the speaker works. The company's size, user-centric approach, and technological capabilities are mentioned to establish the context for the development and implementation of AI-driven projects like the AI trip planner.

💡Machine Learning

Machine learning is a subset of AI that involves training computers to improve at tasks based on data input without being explicitly programmed for those tasks. The video explains that machine learning is foundational to AI capabilities, with the speaker discussing how it has been used in the evolution of the Booking assistant into the AI trip planner.

💡Deep Learning

Deep learning is a more advanced form of machine learning that involves the creation of artificial neural networks with multiple layers, mimicking the human brain's structure to learn and make decisions. The video script touches on deep learning as part of the broader AI field, indicating its role in the sophistication of AI applications.

💡Generative AI

Generative AI, also known as 'gen,' refers to AI systems trained on data to generate new data, such as text, images, or sounds. The video discusses generative AI as a key component of current AI discussions, with examples of its integration into tools and services that designers and users interact with.

💡AI Trip Planner

The AI trip planner is a case study presented in the video, illustrating the practical application of AI in enhancing the travel planning experience. It is an AI-enhanced virtual travel agent developed by Booking.com that leverages machine learning and natural language processing to provide personalized travel recommendations and advice.

💡Prompt Engineering

Prompt engineering is the process of designing instructions or prompts for AI systems to guide their behavior and responses. In the video, prompt engineering is discussed as a critical skill for designers to master when working with AI, as it influences how AI interacts with users and provides personalized experiences.

💡Hyper Personalization

Hyper personalization refers to the tailoring of experiences or content to individual user preferences and behaviors at a very detailed level. The video mentions hyper personalization as a capability enabled by AI, allowing for a more nuanced understanding of user needs and the creation of highly customized user experiences.

💡User Expectations

User expectations refer to the standards or requirements that users have for a product or service, which are influenced by their experiences and the capabilities of technology. The video script notes that AI is changing user expectations rapidly, implying that designers must consider these evolving expectations when integrating AI into their designs.

💡AI Proficiency and Trust

AI proficiency and trust refer to users' ability to understand and rely on AI technologies. The video discusses the varying levels of proficiency and trust in AI among users, emphasizing the importance for designers to consider these factors when integrating AI into products to ensure a positive user experience.

Highlights

The speaker discussed the impact of AI on UX design, focusing on how AI can be integrated into products rather than as standalone tools.

AI's role in everyday life was exemplified through the use of image recognition and search in mobile applications, like iOS's swipe up or Google Lens.

The speaker's background in UX spans 20 years, with experience managing designers and leading projects at Booking.com.

Booking.com's scale was highlighted, with 700 million monthly visitors and a significant tech and design workforce.

The importance of a user-centric mindset and data-informed approach in product development was emphasized.

Basic terminology in AI, including machine learning, deep learning, and generative AI, was explained to provide foundational knowledge.

Generative AI's capability to enhance tools like Notion and Grammarly was mentioned, indicating AI's integration into everyday design tasks.

The case study of the AI Trip Planner at Booking.com showcased how AI can understand context and provide personalized travel recommendations.

The evolution from the Booking Assistant to the AI Trip Planner demonstrated the shift from keyword-based responses to context-aware conversations.

The AI Trip Planner's ability to provide real-time, accurate recommendations based on Booking.com's extensive data was highlighted.

Designers were encouraged to consider AI in the context of existing use cases to enhance user problems rather than creating entirely new products.

The importance of prompt engineering in instructing AI and setting guard rails for appropriate output was discussed.

The need for designers to understand AI proficiency levels and trust among users to create inclusive and user-friendly AI experiences was emphasized.

The concept of hyper-personalization in design was introduced, suggesting that AI can tailor experiences to individual user needs.

The speaker proposed that AI will replace tasks rather than roles, and the role of designers will continue to evolve and remain relevant.

Resources for designers to learn about AI, prompt engineering, and hyper-personalization were recommended for professional development.

The final takeaway was a reminder that designers should always serve the user's needs and be adaptable to technological changes.

Transcripts

play00:02

yes okay so as I was getting ready to

play00:05

present the next speaker I was listening

play00:07

to the podcast that he registered with

play00:09

Daman which I thought was fascinating

play00:12

even if it was short and so because they

play00:15

were talking about career path and I

play00:18

wanted to ask how many of you are

play00:21

individual contributors which means that

play00:23

you do not manage

play00:25

people yeah yeah good amount keep your

play00:28

hand up keep your hand up now how many

play00:30

of you are hoping ideally to manage

play00:33

people in the next let's say five years

play00:36

get your hand down put your hand down if

play00:40

you do okay I think it was pretty much

play00:42

everyone so this shows that uh we're

play00:44

thinking of our career in the long term

play00:47

of probably managing up but um jasha was

play00:50

telling about the fact that there are

play00:53

nonlinear ways of managing your career

play00:55

as well and he's been exploring that a

play00:57

lot from leading people managing people

play01:00

being an individual contributor in all

play01:02

sorts of directions and I think that's

play01:03

very inspiring for for all of us but

play01:06

this has nothing to do with the talk

play01:08

that he came uh for and so as he's a

play01:13

design manager at booking.com he's

play01:15

working on strategic Pro um design

play01:19

projects leveraging AI capabilities and

play01:22

he's going to tell us all about that

play01:24

please help me welcome on stage Yasha

play01:28

golderman

play01:31

thank

play01:33

you thank you for the nice introduction

play01:36

and thank you everybody for being here

play01:38

it's a great conference and I'm really

play01:40

happy and humbled to be here so like I

play01:43

was just mentioned I'm going to talk a

play01:45

little bit about Ai and the impact of AI

play01:48

on ux design but just a quick disclaimer

play01:51

I'm not talking about AI tools that you

play01:53

can use to supercharge your workflow as

play01:55

designers sorry to disappoint I'm going

play01:58

to talk about how we can use AI in our

play02:02

products and you might think I don't

play02:05

think we will use AI in my product but

play02:07

this might change soon because AI is

play02:09

getting more available and more

play02:12

accessible but before we get into it let

play02:15

me start with a simple question when was

play02:18

the last time you looked at a laundry

play02:19

label and you're not quite sure what one

play02:21

of those symbols actually mean or even

play02:24

worse you get into your car and you're

play02:27

not quite sure what one of those symbols

play02:28

on the dashboards is about

play02:31

well chances are you can just take a

play02:33

photo if you have IOS you just swipe up

play02:35

or if you have Android you use Google

play02:37

lens and it's going to tell you what you

play02:39

see and there are a few AI things at

play02:43

play here it's doing image recognition

play02:44

it's performing a search it's matching

play02:46

information and I think it's a neat

play02:48

little example of how AI is already

play02:50

around us and improving our experiences

play02:54

as

play02:55

users so who am I and why am I talking

play02:57

to you today I I've been in ux for about

play03:01

a decade and my interest in design spans

play03:03

roughly 20 years so I started designing

play03:06

with micromedia fireworks and I built my

play03:08

own little websites on front page and I

play03:11

actually spent most of their time here

play03:12

in

play03:13

Berlin now I live in Amsterdam where I

play03:15

manage designers at booking.com and I

play03:18

also sometimes lead projects and one of

play03:20

those projects is the AI trip planner

play03:22

and I'm going to use that as a case

play03:24

study today to talk about the impact of

play03:26

AI on ux

play03:28

design but let me tell you one or two

play03:30

things about

play03:31

booking.com as a product we have roughly

play03:34

700 million visitors a month that's

play03:36

about a million visitors at any given

play03:38

time nearly 30 million Global listings

play03:42

and over 250 million guest reviews and

play03:45

I'm not just naming these numbers to

play03:46

brag is relevant for the talk today

play03:49

you'll see now as a company we're over

play03:51

20,000 employees roughly 5,000 of those

play03:54

in Tech more than 200 designers and we

play03:57

have 140 offices in more than 70

play04:00

countries and the one you're seeing up

play04:02

here that's a new campass that was

play04:04

opened in Amsterdam earlier this

play04:07

year more importantly as a place to work

play04:10

we have a user Centric mindset the user

play04:13

is at the center of everything we do we

play04:15

have a very data informed approach that

play04:17

we're famous for just last year alone we

play04:20

ran over 10,000 AB tests and we have a

play04:22

machine learning organization that's

play04:24

quite sizable and knowledgeable we have

play04:27

more than 300 people working machine

play04:28

learning roles we have a vice president

play04:30

of machine learning we have a machine

play04:31

Learning Hub in Tel Aviv and we have a

play04:34

hackathon tradition we have hackathons

play04:37

every year we have conferences and

play04:38

events throughout the year and I'm

play04:40

mentioning it here because some of the

play04:42

Great Inventions originated in those

play04:44

hackathons and the AI trip planner is no

play04:47

exception so when we talk about

play04:50

AI there's more to it than I could even

play04:53

get into today and it's more complicated

play04:55

than what you see here on the screen but

play04:57

I want to just get into the very basic

play04:58

terminology

play05:00

so there is the field of study that is

play05:02

artificial intelligence and within this

play05:04

field of study there is machine learning

play05:07

which is when you train computers on

play05:09

vast amounts of data so that they can

play05:11

find patterns and make decisions without

play05:13

being specifically programmed for those

play05:15

particular

play05:16

tasks now deep learning is when you take

play05:19

this to the next level not just more

play05:21

amounts of data but those computers will

play05:23

also generate multiple layers and create

play05:25

artificial neural networks which are

play05:27

supposed to mimic basically how the

play05:29

human brain works so they can learn with

play05:31

that data on their

play05:33

own and within that there's the

play05:35

application of generative AI or more

play05:38

known as geni which is when you train

play05:41

machines on data so that they can

play05:43

generate data and this data could be

play05:45

text images video sound anything that

play05:48

you train the machines

play05:50

on and today when people talk about AI

play05:53

most of the time they actually talk

play05:55

about

play05:56

gen so when we hear about gen typically

play05:59

one of these tools comes to mind we

play06:01

think about cat GPT mid Journey Google

play06:04

Bart we've probably played around with

play06:06

these tools and I bet that within this

play06:09

audience we also know that gen is

play06:12

already built into some of our favorite

play06:14

tools mro notion grammarly they're

play06:17

already enhanced with Gen

play06:20

capabilities but I want us to zoom out

play06:22

from that and I want us to understand

play06:25

that gen is already built into some

play06:27

tools that we use on an everyday basis

play06:30

it can transcribe a video call or create

play06:33

live captions as we talk or help us

play06:35

finish our sentence when we create a

play06:37

memo or a

play06:39

note and this means for us as designers

play06:42

that user expectations are changing user

play06:45

expectations are changing and they're

play06:47

changing fast so think about that in the

play06:50

context of your product or service that

play06:52

you're working on as a designer because

play06:54

like I said AI capabilities are becoming

play06:57

more

play06:58

available

play07:00

so when we talk about gen specifically

play07:02

like I said it can generate different

play07:03

types of data at booking we're

play07:06

experimenting with Gen to create audio

play07:09

image numerical data or

play07:11

text and just within the text based gen

play07:15

we need to realize that there are vast

play07:17

amounts of very diverse kinds of use

play07:19

cases that we can apply it

play07:21

to for example at booking we're using it

play07:23

to create image descriptions which helps

play07:25

with accessibility for users with screen

play07:28

readers you can also use it for

play07:30

translations for property descriptions

play07:34

or summarizing reviews and we've also

play07:37

used it to build a virtual travel agent

play07:40

and that's the case study I will use

play07:41

today to go deeper into this

play07:44

topic now booking actually has quite a

play07:46

history of virtual travel agents let me

play07:49

take you back six years in

play07:52

2017 long before the Advent of gen

play07:56

booking released the booking assistant

play07:58

and the booking assistant was already AI

play08:00

enhanced it was trained with machine

play08:02

learning models to help Travelers or

play08:05

customers uh with questions about their

play08:07

trip or they could find hotels all kinds

play08:09

of things and it was not bad so in this

play08:13

case you see you can ask about parking

play08:15

information you could actually even

play08:16

reserve a parking spot the way how it

play08:19

was doing this it was trained on a

play08:21

machine learning model for the topic of

play08:25

parking it was Advanced over the next

play08:27

coming years it was even available right

play08:30

through the Facebook Messenger app so

play08:32

this person here is asking if this is a

play08:34

pet friendly hotel and it gave a

play08:36

relevant answer and it was doing that

play08:39

because it was trained on a machine

play08:40

learning model for pet related questions

play08:43

now think about that you needed a

play08:44

machine learning model for a topic so

play08:47

that it can identify keywords and give

play08:49

you a relevant answer and why because it

play08:52

wasn't really understanding the broader

play08:55

context of the conversation it was

play08:56

looking for keywords and matching that

play08:58

with the probability of an answer that

play09:01

might be relevant to your

play09:03

question but what it wasn't able to do

play09:06

was understand language it wasn't able

play09:09

to understand how a previous question

play09:11

was relevant to a question that you

play09:13

asked now and it wasn't able to apply

play09:16

let's say Real World Knowledge to the

play09:20

topic but then came gen and at the

play09:23

beginning of this year in a hackathon at

play09:25

booking.com a group of people thought

play09:27

what if we had gen capabilities to the

play09:29

booking assistant what if we use open AI

play09:32

API to basically plug in chat GPT into

play09:35

the booking assistant and immediately it

play09:38

became clear that now the booking

play09:40

assistant would be able to talk about

play09:41

any topic not just the ones that it was

play09:43

specifically trained on and it was able

play09:46

to do so in a much more natural way it

play09:49

had a very much lower error rate and it

play09:52

was able to understand that a question

play09:54

you were asking may be related to a

play09:55

question you asked earlier and it was

play09:57

even able to apply real world context to

play10:00

the question that you

play10:02

asked and that's basically in a nutshell

play10:05

how the AI trip planner was

play10:06

born so the a planner is built right

play10:09

into the booking.com app it's accessible

play10:12

right now for audiences in the US and

play10:14

it's expanding gradually to other

play10:16

regions and what it can do is basically

play10:18

anything that you would expect from a

play10:20

real human travel agent so you can ask

play10:23

about places to go or hotels to book or

play10:27

some travel advice like to pack or what

play10:30

to prepare or what to think about before

play10:32

you uh travel before you start your

play10:35

travels now that sounds like classic jet

play10:38

GPT and it makes sense because we're

play10:41

plugging open ai's GPT model into this

play10:43

AI trip planner but we build a whole

play10:46

wrapper around

play10:47

it so basically the a planner is only

play10:51

going to recommend places that actually

play10:53

available that actually exists it's not

play10:55

going to hallucinate places it's not

play10:57

going to hallucinate activities or

play10:58

things to do and it has information

play11:01

about places beyond what you would

play11:03

expect from any other available chatbots

play11:06

because like I mentioned with those 266

play11:09

million guest reviews booking.com has

play11:11

knowledge about neighborhoods about

play11:14

dining options about activities about

play11:17

things to do it has vast amounts of

play11:19

knowledge so when the a planner

play11:21

recommends you a place to stay it knows

play11:24

whether there are nearby restaurants

play11:26

that are recommended by users for let's

play11:29

say a romantic trip it knows if a

play11:31

property is wheelchair accessible or pet

play11:34

friendly basically it's the booking

play11:37

assistant but capable of really

play11:40

understanding the world similar in a way

play11:42

how a human would and capable of uh

play11:45

reacting and understanding the language

play11:46

in a way how a real human would and all

play11:49

of this information is live and accurate

play11:51

you can see the prices the reviews the

play11:54

availability you can book right through

play11:56

the app then go back into the chat

play11:58

continue your your conversation maybe

play12:00

add something to your wish

play12:02

list now for me this means that we as

play12:06

designers should think about AI in the

play12:08

context of existing use cases I know

play12:12

it's very tempting to think that with

play12:13

this novel technology there are all

play12:15

these new kinds of products that we

play12:17

could build that have never existed

play12:18

before and to some extent that is true

play12:21

but I would urge you to think about what

play12:24

is your product or service trying to

play12:25

solve for the users and how could AI be

play12:28

used use possibly to solve that problem

play12:31

in a better

play12:32

way let me give you one more example in

play12:35

the context of booking a trip let's take

play12:38

this Persona Lisa and she's looking for

play12:40

a mountain honeymoon in the USA so she

play12:43

will go to Google and Google will take

play12:45

her to a Blog and then she will research

play12:47

some information on Wikipedia and she

play12:49

will use social media and she will talk

play12:50

to friends and family to sort of form

play12:53

her trip intend and she goes through

play12:55

various phases of inspiration and

play12:58

research and narrowing down and finding

play13:01

the best deals and all of that happens

play13:04

in different places and not at the same

play13:06

time and it's not a linear path she goes

play13:09

back and

play13:10

forth if she asked the a trip planner

play13:13

for Mountain honeymoon in the USA is

play13:16

going to give her relevant

play13:18

recommendations and if you think about

play13:20

the information that she has to provide

play13:22

it's actually very little she just

play13:24

mentioned a mountain honeymoon

play13:27

USA But if you go to a real human travel

play13:30

agent they would realize that likely

play13:34

your duration is probably one to two

play13:36

weeks you're looking for romantic

play13:38

activities your budget is likely

play13:40

elevated and all of this leads to better

play13:42

recommendations because it understands

play13:45

real world context and it can you know

play13:47

understand the likelihood that those

play13:49

pieces of information that you didn't

play13:50

explicitly give are also

play13:53

true this means that gen enables hyper

play13:58

personalization ation this is something

play14:00

we need to think about more as designers

play14:02

in the future you can understand users

play14:05

at the individual users level and don't

play14:07

just think about it in the context of

play14:09

this case study of the chatbot that

play14:11

basically gives an individual

play14:13

response think about it Beyond and think

play14:16

about it more abstract and more

play14:18

futuristic in theory the blocks of your

play14:20

interface could assemble itself based on

play14:23

what you know about that particular

play14:25

single user at that moment in

play14:27

time so when we built the a

play14:30

planner we started by mapping the

play14:33

experience and the skills you can apply

play14:35

here is basically creating user flows

play14:38

but it's not the same it's not the same

play14:41

with Gen because gen interactions are

play14:45

nonlinear so the interaction with Gen

play14:48

can go in multiple different ways think

play14:50

about the trip planner you ask it the

play14:51

same question twice it's not going to

play14:53

give you the exact same answer twice so

play14:56

you map situations not steps you don't

play14:59

say if this happens then that happens

play15:01

you give examples of if this situation

play15:03

occurs then I want this experience to to

play15:06

get out of it and you need to let the AI

play15:08

handle situations in multiple ways and

play15:11

that's a bit difficult for designers to

play15:13

wrap their heads around because we're

play15:14

used to mapping out the exact experience

play15:18

that we want the user to have so we're

play15:20

losing a little bit of control when we

play15:22

work with

play15:24

Gen now what you need to do here or no

play15:27

actually let me give you an example

play15:29

first imagine you use the trip planner

play15:32

to plan a road trip so it's going to ask

play15:34

you if you already have a destination in

play15:36

mind or if you're open to suggestions

play15:38

now what happens if you just answer

play15:40

hamburgers there are multiple ways how

play15:42

it could handle this

play15:43

situation in our case it's going to

play15:46

understand it in the context of you

play15:49

looking for travel advice so it's going

play15:51

to ask you are you interested in

play15:52

locations that are known for great

play15:54

hamburgers or are you planning a road

play15:56

trip that has Hamburg Germany as one of

play15:59

the um places on your route so we

play16:03

trained it to understand the question in

play16:05

a travel context and the way how you

play16:07

train the AI is with prompt

play16:10

engineering so you need to design the

play16:13

prompts prompts are how you instruct the

play16:15

AI on what to do and you don't do that

play16:18

by saying if this happens you need to do

play16:20

this no you provide examples for the AI

play16:23

to learn from and you need to create

play16:25

guidelines and principles and you need

play16:27

to Define things like like what's the

play16:29

audience of this AI what's the goal of

play16:31

the AI what's the goal of the audience

play16:33

what's the role tone you need to infuse

play16:35

it with a

play16:36

personality think about it like a person

play16:39

it's not a person but think about it

play16:40

like a person if you had a if you had to

play16:42

hire a travel agent and they have no

play16:44

experience you need to train them and

play16:46

the same thing with our virtual travel

play16:49

agent we had to train it and give it a

play16:52

personality let me give you another

play16:54

example if you ask the AI trip planner

play16:57

that you want to go elephant ride

play16:58

writing is going to say that it cannot

play17:01

recommend such activities because that

play17:02

may result in animal exploitation and

play17:05

their booking a com is committed to

play17:07

sustainable and responsible

play17:08

travel so it has a personality here it

play17:11

applies that

play17:13

personality now if you say I want to see

play17:15

elephants that's great elephants seeing

play17:18

elephants in the natural habitat that

play17:20

can be a great experience so it's happy

play17:22

to oblige and give you recommendations

play17:25

there so this means that we need to set

play17:28

guard rails we need to Define what our

play17:30

AI should do and what it should not do

play17:33

there's a huge potential for

play17:35

inappropriate output we need to consider

play17:38

sensitive subjects especially in the

play17:41

context of our product and our brand and

play17:43

we need to account for malicious intent

play17:46

because chances are when users realize

play17:49

they're interfacing with a product that

play17:51

is outputting content with AI they're

play17:54

going to try to find out what are the

play17:55

limits of this Ai and they might try to

play17:57

push it beyond the those

play17:59

limits let me give you another tangible

play18:02

example if you asked the a planner for

play18:04

attractions in the US in the 1950s is

play18:07

going to ask if you're interested in

play18:09

attractions that date back to the 1950s

play18:11

or if you would like to plan an

play18:13

imaginary trip to the US of the 1950s

play18:16

which are completely Val travel

play18:18

requests but if you ask almost the same

play18:21

question about attractions in Germany in

play18:24

the 1940s it's just going to say that

play18:26

I'm sorry I can't assist you with that

play18:29

because likely in this case it's

play18:31

somebody trying to trick the AI into

play18:33

generating inappropriate output or

play18:35

getting into a sensitive topic or

play18:37

getting into a discussion so you don't

play18:38

want to have to deal with that and what

play18:40

you can see here is that it's not

play18:42

explaining anymore why it's not getting

play18:44

into the topic because that would only

play18:46

fuel somebody who's trying to get it and

play18:49

push it Beyond those uh limits that you

play18:51

want to set and something that I think

play18:54

is relevant for us to take away from

play18:56

that is that we need to shift Focus from

play18:59

UI to

play19:01

AI don't get me wrong the UI is still

play19:03

very important how things look how easy

play19:06

they are to use all of that is still

play19:08

relevant but it's equally important or

play19:11

more more so what the quality of the

play19:14

output of the AI in your product is

play19:16

because that really defines the quality

play19:18

of the experience that the users will

play19:20

have with your product and it's not

play19:22

abstract it's not the

play19:23

future more companies and even smaller

play19:26

companies will be able to apply AI into

play19:29

their product relatively

play19:32

soon something we had to account for and

play19:35

I think this is a general learning for

play19:36

anyone who's building AI into their

play19:38

product is AI proficiency and Trust in

play19:41

AI which varies greatly so some people

play19:45

don't trust AI in general some people

play19:47

don't have experience with it and they

play19:48

might not know how to interact with it

play19:51

just on this screen alone here I want to

play19:53

give you three examples at the top there

play19:56

is a disclaimer saying that the chat

play19:57

includes machine generated content that

play19:59

may contain errors so we are being clear

play20:02

about limitations and risks then there

play20:05

is a welcome message that says hey I'm

play20:07

still learning but I'm happy to help you

play20:09

so we're setting a friendly tone but

play20:12

we're also managing

play20:14

expectations and then we have those uh

play20:17

interactions here that provide examples

play20:19

of things you might ask because not

play20:21

everybody who uses this has already

play20:23

tried chat GPT in the past so they might

play20:25

not know what they can expect from this

play20:27

chat are they talking suddenly to

play20:29

customer support all of this needs to be

play20:31

clear so you need to account for

play20:33

different levels of AI proficiency and

play20:35

Trust in Ai and this also means keeping

play20:39

users in control typically users have a

play20:41

bit less control when I is generating

play20:44

content for them and they know that and

play20:46

you need to give them control back and

play20:49

you need to make sure that they know

play20:50

that they're in control and for us this

play20:52

meant primarily two things first of all

play20:56

the data that users provide in the chat

play20:58

is never being used to train the model

play21:00

it's never fed back into the model

play21:03

second of all they can always delete

play21:06

their conversations some users might

play21:08

feel uneasy talking now about a

play21:10

different kind of trip knowing that it

play21:12

still has the context from the previous

play21:14

conversation we're also resetting

play21:16

conversations automatically after

play21:19

certain session durations not while

play21:21

they're chatting but if they haven't

play21:22

used the app for a

play21:24

while finally testing and feedback so

play21:28

always important to improve the quality

play21:29

of your product but even more so when

play21:31

you have a little less control over what

play21:34

the the product actually is which

play21:36

happens when you add gen capabilities to

play21:39

your product so you need to establish

play21:41

tight feedback loops of course you still

play21:44

need to do usability testing and

play21:46

research and all those things but

play21:48

whenever there is an output from AI in

play21:50

your product you need to make sure that

play21:52

users can give direct feedback about the

play21:54

quality of this output and whether it

play21:56

matches their expectations

play21:58

so in our case those little helpful not

play22:00

helpful interactions Whenever there is a

play22:03

recommendation or whenever there is a

play22:05

longer response from the AI

play22:08

planner and I want to remind us that we

play22:11

serve the user not the tech all of this

play22:14

I think reminds us that sure we always

play22:17

need to be uh mindful of our users goals

play22:20

of their motivations of their time of

play22:23

their privacy of their data even more so

play22:26

when we work with new emerging maybe

play22:29

experimental Tech in our

play22:32

product but finally what does this mean

play22:35

for us as

play22:37

designers what does it mean for our

play22:39

craft what does it mean for our skills

play22:42

because like I said it's just a matter

play22:44

of time until pretty much any product

play22:48

has the ability to enhance their

play22:51

experience with AI capabilities first

play22:54

and foremost I think it means that all

play22:57

the skills that are are relevant for

play22:58

designers today are still relevant for

play23:01

designers tomorrow and in a year from

play23:03

now and a couple of years don't want to

play23:05

look too far into the

play23:07

future at the center of it obviously

play23:10

empathy being able to understand our

play23:12

users needs their motivations their

play23:14

goals their

play23:17

frustrations all of this is hugely

play23:19

relevant even more so now when there is

play23:22

new things that we can do new use cases

play23:24

that we can unlock with a new

play23:26

technology so what this means is our

play23:29

role is uniquely positioned now in this

play23:31

era where AI becomes more prevalent more

play23:34

available more

play23:37

accessible but we might want to add a

play23:39

couple of new skills to the list first

play23:42

and foremost I think we need to get

play23:44

proficient at the field of study that is

play23:47

artificial

play23:49

intelligence artificial intelligence is

play23:51

not a field of study for engineers or

play23:55

data scientists alone designers need to

play23:57

be involved in the discussion they need

play24:00

to be able to have a say in the

play24:02

direction in which it goes they need to

play24:04

be able to understand it we need to know

play24:07

which machine learning models are out

play24:09

there what opportunities they have what

play24:11

limitations they have what risks they

play24:14

have and I want to leave you with two

play24:16

resources here that are great to get

play24:19

into the field of AI Ben B's newsletter

play24:22

and the invisible machines podcast are

play24:24

both resources that will give you on a

play24:26

weekly basis bsz information so that you

play24:28

know what's going on in the field of

play24:32

AI something that I'm sure will be added

play24:35

to the job descriptions of designers in

play24:38

the future at least in some cases is

play24:41

prompt engineering or now sometimes

play24:43

called prompt

play24:45

design because the way how you instruct

play24:47

the AI in a proper way the way how you

play24:51

give the AI of personality the way how

play24:53

you set those guard rails like I

play24:55

mentioned earlier today this is really

play24:57

how you're going going to impact the

play24:58

experience that your users will have

play25:00

when your product is being enriched with

play25:03

AI

play25:05

capabilities so it's not an engineer

play25:07

task it might happen in the code maybe

play25:09

in the future not anymore maybe in the

play25:11

future it's going to be part of your

play25:13

figma workflow but it's the task that ai

play25:16

ai designers need to be or ux designers

play25:18

sorry need to be more proficient in so a

play25:21

great resource for this is the prompt

play25:23

engineering guide just Google that

play25:25

you'll find this webbsite and it's an

play25:27

extensive resource that has everything

play25:29

you need to know about prompt

play25:31

engineering long before your product is

play25:34

ready to build AI into their uh into

play25:37

their

play25:38

service and finally the concept of hyper

play25:41

personalization that I mentioned earlier

play25:43

this is something we need to wrap our

play25:44

heads around because it really unlocks

play25:47

new ways new use cases new ways to

play25:49

improve the experience for our uses in

play25:52

our

play25:53

product a great resource for this is the

play25:55

Delo report connecting with meaning I

play25:57

know it's very long and extensive but

play25:59

it's free and openly available so if you

play26:02

just get into the basics of this report

play26:05

just scan through some of those chapters

play26:07

and it will open your mind to a new kind

play26:09

of thinking because you'll realize the

play26:11

applications in your product in your

play26:14

service with personalization at the

play26:17

individual users level personalizing the

play26:21

experience for each user

play26:24

individually and this is going to be

play26:26

more and more normal like I said earlier

play26:28

user expectations are

play26:31

changing my final takea away from all of

play26:34

it is that I AI replaces tasks not roles

play26:38

for us as designers yes AI might help us

play26:41

build interfaces create wireframes and

play26:43

whatnot but our

play26:46

skills our responsibilities as designers

play26:49

remain hugely relevant and the role of

play26:52

designers has always

play26:54

shifted what ux designers do today is

play26:57

not what ux designers were doing 5 years

play26:59

ago and it's certainly not what ux

play27:01

designers were doing 5 years before that

play27:04

if that title was even used back then

play27:07

remember the time when we were basically

play27:08

called web designers or visual

play27:12

designers so the role of designers

play27:14

change and we need to adapt but it's not

play27:16

going

play27:17

away thank you for your time if you want

play27:20

to connect with me best way to reach me

play27:21

is on LinkedIn you can also find me on

play27:23

ADP list if you're ever in Amsterdam I

play27:25

would be happy to catch up and a coffee

play27:28

and I'm looking forward to your

play27:32

questions

Rate This

5.0 / 5 (0 votes)

Related Tags
AI ImpactUX DesignMachine LearningUser ExperienceAI PersonalizationVirtual AssistantPrompt EngineeringBooking.comTravel TechAI EthicsDesign Innovation