Model Autotuning, Generative AI | SAS Viya March 2023 Release

SAS Users
18 Apr 202321:23

Summary

TLDRIn the April 2023 SAS Viya release highlight show, host Thiago Doza discusses new features with experts. Sasha Karpinsky introduces Microsoft Word integration for SAS, allowing users to embed and update SAS reports in Word documents. Joe Madden presents updates in machine learning, including the new ASTORE model format for neural networks and autotuning capabilities in Light GBM. Alex Vilan covers enhancements in SAS Studio, such as data engineering steps and custom column steps. The show also features part two of an interview with Mary Osborne on generative AI models, exploring their potential and ethical considerations in various applications.

Takeaways

  • 😀 The SAS Viya release as of April 2023 includes significant updates and integrations.
  • 📈 Integration with Microsoft Word allows for seamless sharing of SAS analytical insights within Word documents.
  • 💡 Machine learning updates feature a new ASTORE model format for neural networks, enhancing deployability and scoring speed.
  • 🔧 Autotuning capabilities in Light GBM have been introduced to improve efficiency and scalability for large datasets.
  • 🎹 SAS Studio has been enhanced with new data engineering steps, custom column steps, and an analyst step for ranking data.
  • 🔄 The ability to redeploy Studio flows using SAS and Python programs has been added for greater flexibility.
  • đŸ€– Generative AI models, like the BERT-based classifier, are being integrated into SAS Viya to improve natural language processing.
  • đŸ‘©â€đŸ« Generative AI has the potential to revolutionize personalized education and product recommendation systems.
  • đŸ„ Synthetic data generation can aid researchers in modeling rare diseases by expanding data sets for better analysis.
  • đŸ›Ąïž SAS is taking a cautious approach to generative AI, prioritizing ethical considerations and risk mitigation.
  • 📚 Users are advised to verify the information generated by AI tools like chat GPT to ensure accuracy and reliability.

Q & A

  • What is the main topic of the SAS Viya Release Highlight Show for April 2023?

    -The main topic is the new features and updates in SAS Viya as of April 2023, including integrations and enhancements in areas like Microsoft Word, machine learning, and SAS Studio.

  • How does the new Microsoft Word integration in SAS Viya work?

    -The integration allows users to view and interact with SAS visual analytics reports, insert visual insights directly into Word documents, and update embedded SAS content with the latest data, all without leaving the Word application.

  • What is the significance of the aStore model format for neural networks in SAS Viya?

    -The aStore model format is significant because it is easily deployable, more portable, and faster than traditional data step methods, leading to a significant improvement in scoring time for neural networks.

  • What is the new autotuning capability in Light GBM as discussed in the show?

    -The new autotuning capability in Light GBM allows for efficiency and scalability for large datasets with many features, and it includes unique parameters like bagging fraction, bagging frequency, lasso, and ridge.

  • What are the new features introduced in SAS Studio for data engineering?

    -SAS Studio introduces advanced data engineering capabilities such as the ability to create outputs as views, a new 'rank data' step for assigning rank values, and extended scheduling functionality for Studio flows.

  • How can users deploy or redeploy Studio flows using SAS and Python programs?

    -Users can deploy Studio flows as jobs without specifying a scheduling trigger and redeploy jobs that have been previously deployed from a specific Studio flow, with this option also supported for SAS and Python programs.

  • What is the focus of the interview with Mary Osborne in the show?

    -The interview focuses on generative AI models, discussing the recent release of a BERT-based classifier in SAS Viya, the concept of generative AI, and its potential impact on everyday life and business.

  • What are some examples of how generative AI can impact everyday life?

    -Generative AI can impact everyday life by providing personalized instruction through 'teacher in the box' concepts, curating product information, and generating synthetic data for research purposes, among other applications.

  • What are the key technologies behind generative AI as discussed in the interview?

    -The key technologies behind generative AI include large language models based on transformer architecture, such as BERT and GPT, and generative adversarial models for generating synthetic tabular data.

  • What is SAS's approach to the development and deployment of generative AI models?

    -SAS is taking a conservative approach to the development and deployment of generative AI models, focusing on trustworthiness, ethical considerations, mitigating risks, and ensuring a strong return on investment for customers.

  • What advice does Mary Osborne give to casual users of generative AI like chat GPT?

    -Mary Osborne advises casual users to use generative AI with caution, always verify the information it provides, and be aware that the models can generate very plausible but incorrect or non-existent content.

Outlines

00:00

📈 Introduction to SAS VIA Release Highlights

The video script introduces the SAS VIA release highlight show hosted by Thiago Doza, focusing on updates as of April 2023. It sets the stage for various segments, including Microsoft Word integration in SAS for Microsoft 365 by Sasha Karpinsky, machine learning updates by Joe Madden featuring a new model format for neural networks and autotuning capabilities in Light GBM, and new features in SAS Studio by Alex Vilan, such as data engineering steps, custom column steps, and the ability to deploy or redeploy Studio flows using SAS and Python programs. The script also mentions the continuation of an interview with Mary Osborne about generative AI models.

05:02

🔗 Microsoft Word Integration and Machine Learning Updates

Sasha Karpinsky discusses the new integration of SAS with Microsoft Word, enhancing the ability to share analytical insights within an organization directly from Word documents. Joe Madden introduces advancements in machine learning, specifically the support for the analytical store (ASTORE) in SAS for neural networks, which improves deployability, portability, and speed. Additionally, autotuning for Light GBM is presented, which includes unique parameters to enhance efficiency and scalability for large datasets. The segment also previews new output results in Model Studio, including plots for evaluation and iteration history.

10:04

đŸ› ïž Advanced Data Engineering and Custom Step Extensions

Alex Vilan presents new features in SAS Studio, focusing on advanced data engineering capabilities. These include the ability to create views as outputs, a new 'rank data' step for assigning rank values, and extended scheduling functionality for SAS Studio flows. The segment also covers enhancements to custom steps, such as making input table and column selector controls read-only and hiding their values at runtime, as well as excluding specific columns from previous selections. These updates aim to empower custom step authors to build more powerful and flexible custom steps.

15:06

💡 Generative AI Models and Their Impact

Mary Osborne discusses generative AI models, starting with the release of a BERT-based classifier in SAS VIA. She explains generative AI as a technology for creating content, including images, text, and structured data. Osborne provides examples of generative AI's impact on everyday life, such as personalized education and curated product information. She also touches on business applications like synthetic data generation for rare disease research and the potential for content creation acceleration. The conversation emphasizes the importance of ethical considerations, computational costs, and the potential risks and benefits of generative AI.

20:09

🌐 Ethical Considerations and Future of Generative AI

The discussion continues with ethical concerns and the future of generative AI at SAS. Osborne emphasizes SAS's commitment to developing trustworthy models and methods, taking a conservative approach to novel text generation to mitigate risks. The conversation highlights the importance of an ethical path, considering data sources, privacy, and the potential for model hallucinations. The segment also addresses the high computational costs and the rapid evolution of generative AI, with a focus on ensuring a strong return on investment and reducing risks for customers. Practical advice for users is provided, urging caution and verification of generative AI outputs.

📱 Closing Remarks and Invitation for Future Engagement

Thiago Doza concludes the show by summarizing the updates and inviting viewers to try out the new SAS VIA features. He encourages engagement through likes and subscriptions on the SAS Users YouTube channel and asks for comments on topics for future shows. The script ends with a tease for the next show in May, maintaining viewer interest and engagement.

Mindmap

Keywords

💡SAS Viya

SAS Viya is an advanced analytics platform from SAS that supports a wide range of analytics techniques from descriptive to predictive to prescriptive analytics. In the video, it is highlighted as the main subject with updates and new features being discussed, such as integration with Microsoft Word and enhancements in machine learning capabilities.

💡Microsoft Word Integration

This refers to the new feature in SAS Viya that allows users to integrate SAS visual analytics reports directly into Microsoft Word documents. This integration facilitates sharing analytical insights within an organization without leaving the Word application, as mentioned by Sasha Karpinsky in the script.

💡Machine Learning

Machine learning is a type of artificial intelligence that enables systems to learn and improve from experience without being explicitly programmed. In the video, Joe Madden discusses updates related to machine learning in SAS Viya, including a new model format for neural networks and autotuning capabilities in Light GBM.

💡Neural Networks

Neural networks are a set of algorithms modeled loosely after the human brain that are designed to recognize patterns. The script mentions a new model format for neural networks in SAS Viya, which is the analytical store (ASTORE), allowing for faster scoring times compared to traditional data step methods.

💡Light GBM

Light GBM is a gradient boosting framework that uses tree-based learning algorithms. It is known for its efficiency with large datasets. The script discusses the addition of autotuning capabilities in Light GBM, which will help in optimizing model parameters for better performance.

💡Model Autotuning

Model autotuning is the process of automatically tuning the parameters of a model to improve its performance. In the context of the video, autotuning is being implemented in Light GBM to help users achieve better model fits with less manual effort.

💡SAS Studio

SAS Studio is an integrated development environment (IDE) for SAS that provides code editing, debugging, and submission facilities. Alex Vilan in the script discusses new features in SAS Studio, such as data engineering steps, custom column steps, and the ability to deploy or redeploy Studio flows using SAS and Python programs.

💡Generative AI

Generative AI refers to AI models that can generate new content, such as images, text, or structured data. In the video, Mary Osborne discusses generative AI models, including their potential applications and ethical considerations, highlighting the release of a BERT-based classifier in SAS Viya.

💡BERT (Bidirectional Encoder Representations from Transformers)

BERT is a large language model that is used for natural language processing tasks. It is mentioned in the script as a recent addition to SAS Viya, which allows for more advanced text analytics capabilities compared to traditional rule-based approaches.

💡Synthetic Data

Synthetic data is artificially generated data that mimics the properties of real data. In the context of the video, synthetic data generation is discussed as a way to expand datasets, especially useful for modeling rare events or diseases where real data is scarce.

Highlights

SAS Viya release highlights for April 2023 include integration with Microsoft Word, machine learning updates, and new features in SAS Studio.

Sasha Karpinsky discusses the new Microsoft Word integration for SAS, allowing users to share analytical insights directly within Word documents.

Joe Madden introduces a new model format for neural networks, the analytical store (ASTORE), for faster and more portable model deployment.

Autotuning capabilities in Light GBM are now available for improved efficiency and scalability with large datasets.

Alex Vilan covers new features in SAS Studio, including data engineering steps, custom column steps, and the ability to redeploy Studio flows using SAS and Python programs.

Part two of the interview with Mary Osborne explores generative AI models and their potential impact on everyday life.

Generative AI can provide personalized instruction through 'teacher in a box' technology, enhancing education.

Generative AI can curate product information, offering a more general and trustworthy approach to consumer decisions.

Synthetic data generation is highlighted as a way to expand datasets for rare diseases, improving the foundation for modeling and research.

Large language models and generative adversarial models are key technologies behind generative AI, with applications in natural language processing and structured data.

SAS is taking a conservative approach to generative AI, focusing on ethical considerations and ensuring a strong ROI for customers.

The future of generative AI at SAS involves continued research and development, with an emphasis on trustworthiness and risk mitigation.

The rapid growth of generative AI models like GPT is discussed, with newer versions offering improved capabilities.

Users are advised to approach generative AI with caution, verifying the information it provides to avoid inaccuracies.

The show concludes with a reminder to subscribe to the SAS Users YouTube channel for updates on future episodes.

Transcripts

play00:00

[Music]

play00:05

hello everyone and welcome to the SAS

play00:07

via release highlight show I'm Thiago

play00:10

Doza and today we'll be talking about

play00:12

what's new in SAS via as of April

play00:16

2023 for our rundown segment we have

play00:19

Sasha karpinsky highlighting Microsoft

play00:22

Word integration in SAS for Microsoft

play00:25

365 then we have Joe Madden with a few

play00:28

updates on machine learning

play00:30

first he'll tell us about a new aore

play00:33

model format for neural networks and

play00:36

then he'll cover some new model

play00:38

autotuning capabilities in light GBM and

play00:41

in model Studio Alex Vilan is also back

play00:44

focusing on different ways to look at

play00:47

your data Alexi will cover multiple new

play00:49

features in SAS Studio like data

play00:51

engineering steps there are two new

play00:54

custom column steps a new analyst step

play00:57

for ranking data and the ability to de

play00:59

deploy or redeploy Studio flows using

play01:02

SAS and python programs finally in our

play01:05

release talk segment we have part two of

play01:08

our interview with Mary Osborne about

play01:10

generative AI models but that's just an

play01:13

overview of everything you'll hear about

play01:14

today why don't we get right into it I

play01:17

give to you the

play01:20

[Music]

play01:24

rundown welcome to the

play01:26

20233 release highlights for SAS from

play01:29

Microsoft

play01:30

365 March

play01:32

2023 today I'm so excited to introduce

play01:35

sas's integration with Microsoft Word

play01:38

available on both web and desktop

play01:40

versions of word these new features make

play01:43

it easier than ever to share critical

play01:45

analytical insights from SAS with the

play01:48

rest of your

play01:49

organization you can now View and

play01:51

interact with SAS visual analytics

play01:53

reports insert visual insights from SAS

play01:57

directly into your Word documents and up

play01:59

update embedded SAS content with the

play02:01

latest SAS data all without ever leaving

play02:04

your word

play02:07

application hi this is Joe Madden and I

play02:10

have a few exciting machine learning

play02:12

updates to share with you for the latest

play02:13

release of SAS viia we'll kick things

play02:15

off with a big Improvement for neural

play02:17

networks we are pleased to share that

play02:19

the analytical store commonly known as a

play02:21

store is Now supported directly in SAS

play02:24

Studio the SAS code node or the SWAT

play02:26

python library today and it'll soon be

play02:29

available model studio aore is our

play02:32

preferred format within via for saving

play02:34

and scoring a model because it's easily

play02:36

Deployable it's more portable and it's

play02:39

faster than relying upon the traditional

play02:40

data step method in this example we have

play02:43

a neural net running against some

play02:45

simulated data scoring time is a scale

play02:49

of magnitude faster with a store

play02:52

compared to that data step and even when

play02:54

looking at smaller data sets significant

play02:57

Improvement is expected so if you've

play02:59

used a store for other model types this

play03:01

will be just like what you're familiar

play03:02

with and remember scoring can be called

play03:05

from the proc net and proc a store

play03:09

procedure next we have another evolution

play03:12

of the light GBM implementation we're

play03:14

pleased to announce that autot tuning is

play03:16

now ready for the light grab boost

play03:18

action fans of light GBM know it's

play03:20

particularly powerful when you need

play03:22

efficiency and scalability for large

play03:24

data sets that it often includes a large

play03:26

number of features uh so this usage is

play03:29

very similar to other autotune features

play03:31

with a couple unique parameters such as

play03:33

bagging fraction bagging frequency lasso

play03:36

and

play03:37

ridge so let's take a look at some of

play03:39

those results just as you would see with

play03:42

other autot tuning output you're going

play03:44

to get nice view into what happened at

play03:46

each iteration and don't worry if you're

play03:48

not a programmer this will soon be

play03:50

brought into model studio and speaking

play03:53

of model studio and autot tuning we have

play03:55

new output results that you're going to

play03:57

want to check out in this example we're

play03:59

showing gradient boosting enabled for

play04:01

autotuning set up with the genetic

play04:03

algorithm for its search

play04:05

method the two new plots are evaluation

play04:08

history and iteration history evaluation

play04:11

history shows a scatter plot across

play04:13

iterations each point on the plot

play04:15

represents the various evaluations

play04:17

performed within an iteration iterations

play04:20

are denoted by color and represent

play04:22

unique groupings of hyperparameter

play04:23

values along with its results and the

play04:26

solid line represents the best

play04:28

combination for the objective function

play04:30

that the autotune process found the

play04:32

second plot iteration history shows how

play04:35

time and the objective function spans

play04:37

with iterations in this case the higher

play04:40

KS value shows a better model fit as

play04:43

time increases we'll see that the

play04:45

objective also

play04:47

increases while we just have time to

play04:49

show this in action for graad Boost it

play04:51

works across all model types so make

play04:53

sure to give it a try

play04:54

today hello everyone welcome to sus

play04:58

Studio release 202 free or free in this

play05:01

release we introduce a few Advanced Data

play05:04

engineering capabilities in s

play05:07

studio let's take a look first of all

play05:10

for a table step in s studio we add

play05:13

support of the ability to create an

play05:15

output as a view so now you can choose

play05:18

whether your output should be located in

play05:20

a physical table or it should be created

play05:23

in a form of view next for s studio

play05:26

analyst we we introduce a new step T

play05:29

that is called rank data this tab will

play05:33

allow you to calculate and assign rank

play05:35

values to your data

play05:38

set next we significantly extend the

play05:41

functionality of scheduling for s studio

play05:44

flows we introduce a couple of options

play05:46

on S Studio flows menu first we allow to

play05:50

deploy s studio flow is a job without

play05:53

the need to specify a scheduling trigger

play05:56

and secondly we now also allow to rate

play05:59

deploy jobs that have been deployed

play06:01

previously from a specific s studio flow

play06:04

this option is now also supported for

play06:07

SAS and python programs in SAS

play06:11

Studio next let's take a quick look at

play06:15

the extensions for custom steps

play06:17

framework for a couple of dynamic

play06:20

controls that we have in custom steps

play06:22

input table and column selector we now

play06:25

allow to make these controls read only

play06:29

and also allow to hide the values of

play06:32

these controls at R

play06:35

time also for column selector control we

play06:40

add an additional attribute that allows

play06:42

to exclude specific columns from the

play06:45

previous

play06:47

selection these capabilities will allow

play06:49

custom step authors build more powerful

play06:52

custom

play06:54

steps that was Sasha karpinsky Joe

play06:57

Madden and Alex vaan with this month's

play06:59

rundown I know that the Microsoft Word

play07:02

integration is something a lot of users

play07:04

are excited about because it's such a

play07:06

great way to share insights from svia

play07:09

thanks to the three experts for coming

play07:10

back and being regulars on our show now

play07:13

it's time for our interview with Mary

play07:15

Osborne about generative AI models I had

play07:18

a chance to talk with Mary last week so

play07:21

let's take a

play07:26

look hey Mary thanks for uh returning to

play07:29

the show for part two of this interview

play07:31

happy to be

play07:32

here yeah we're glad to have you um I

play07:35

was actually out for last show so I

play07:38

missed the interview entirely could you

play07:40

give us a a recap on what you talked

play07:42

about sure uh we recently released a

play07:45

Bert based classifier for in SAS via

play07:49

Bert is bidirectional encoder

play07:51

representations for Transformers and it

play07:53

is a large language model so it's a nice

play07:55

addition to the rules based approaches

play07:57

that we currently have in SAS visual

play07:59

texting

play08:00

analytics that's awesome so we're

play08:02

hearing so much about generative AI in

play08:05

terms of chat GPT could you tell me a

play08:08

little bit more about what generative AI

play08:10

is sure um in many cases we look at

play08:14

generative AI as technology that as a

play08:16

name would imply generat some sort of

play08:19

content so that could be images like we

play08:21

see in computer vision it could be text

play08:24

like we do in my domain which is natural

play08:26

language processing it could also be

play08:28

tabular data or data that is more

play08:30

structured that we see um much more on

play08:32

the traditional structured machine

play08:34

learning

play08:36

standpoint very interesting so what are

play08:39

some examples of how generative AI can

play08:42

impact everyday

play08:44

life there are actually quite a few um

play08:48

one of the one of my favorites is

play08:50

actually sort of the idea of teacher in

play08:52

the Box um I have children and education

play08:56

is something that is always top of mind

play08:58

and there are some conversations

play09:00

happening in the market around being

play09:02

able to provide more personalized

play09:04

instruction um through the use of

play09:06

generative AI so having that teacher in

play09:09

a box essentially for tutoring some

play09:11

additional help for uh homework those

play09:13

types of things and there's also the

play09:15

idea of more personalized um not really

play09:18

marketing um because people don't really

play09:20

love to be marketed to um but there's

play09:23

the idea of um instead of going out to a

play09:26

website like Amazon for example and

play09:28

looking at reviews which we know

play09:31

sometimes people are paid to do reviews

play09:32

so it can be kind of difficult to

play09:34

determine whether or not that five-star

play09:35

rating and that glowing review really is

play09:37

accurate being able to curate

play09:39

information about products so I could go

play09:41

out and say you know I want to know what

play09:44

the top

play09:46

10 ski ski coats are uh for this season

play09:50

and can you give me a list of those and

play09:52

tell me what the pros and cons are so

play09:54

instead of going to one specific vendor

play09:56

being able to see more of a blanket

play09:59

approach um more of a general approach

play10:01

to marketing um and through through the

play10:04

use of things like curated

play10:07

lists lot of cool examples there I like

play10:10

the the ski coat example you gave there

play10:12

are some some business uses that you're

play10:15

excited

play10:16

about there um one of my favorite

play10:20

examples I actually learned um this

play10:22

weekend at a conference is being able to

play10:25

use things like synthetic data

play10:26

generation so at SAS we don't only do

play10:29

generative AI through large language

play10:31

models in the text side but we also do

play10:34

play in the generative AI space on the

play10:36

structured tabular side so if you are uh

play10:40

a researcher and you're researching rare

play10:43

diseases and maybe you only have a

play10:45

population of a thousand people with

play10:47

that rare disease it can be really hard

play10:48

to model that kind of data so in in many

play10:51

cases we need to expand the data

play10:54

traditional approaches of expanding data

play10:56

random random approaches um traditional

play10:58

statistical I methods don't typically

play11:00

work as well as we would like um by

play11:03

introducing the idea of neural networks

play11:06

and uh generative adversarial models we

play11:09

have the ability to generate tabular

play11:10

data that is similar to the original

play11:14

data so it gives us much a much better

play11:16

foundation for additional modeling and I

play11:18

think that's a really interesting use

play11:19

case um there's also of course all of

play11:22

the content related uh use cases on the

play11:25

large language model side so anything we

play11:27

can do to speed up uh curation of

play11:30

information um take advantage of the

play11:33

technology to knock out some of the more

play11:35

mundane aspects of content creation I

play11:37

think are

play11:39

benefits yeah that's super interesting

play11:41

uh generative AI in general sounds super

play11:45

complex though could you talk about some

play11:46

of the key technology that is being uh

play11:50

played here sure I mentioned large

play11:53

language models and that we're

play11:55

supporting one right now in Bert um

play11:57

large language models that do generative

play12:00

AI are are predicated on the idea of a

play12:03

transformer based architecture um that

play12:06

was a

play12:08

groundbreaking

play12:11

uh development that's the right word

play12:14

groundbreaking development uh in in

play12:16

terms of modeling and natural language

play12:18

processing and it gave us a really good

play12:20

way to not only um do basic things like

play12:24

classification summarization those types

play12:26

of things that we often think about in

play12:28

terms of natural language processing but

play12:30

it also moved the needle further and

play12:32

being able to truly generate novel

play12:33

content uh so you'll hear things about

play12:36

Transformer models not the Optimus Prime

play12:38

more than meets the eye variety but in

play12:40

terms of large language models you'll

play12:42

also uh hear things like ber GPT um all

play12:47

of those are fall into the realm of the

play12:50

large language model but on the

play12:52

structured side we also support

play12:53

generative adversarial models for

play12:55

generating tabular synthetic data as

play12:57

well as smot

play13:00

very cool so what does the future of all

play13:03

of this look like in terms of natural

play13:06

language processing at SAS and and

play13:07

Beyond what does that look

play13:09

like this is something that we've put a

play13:11

lot of thought into and we're going to

play13:12

continue to put a lot of thought into

play13:14

there are a lot of concerns around

play13:16

generative AI um there are a lot of pros

play13:18

and cons and at SAS we've always focused

play13:21

on developing models that people can

play13:24

trust and methods that people can trust

play13:26

so rather than jumping Allin

play13:29

uh to novel generation of text which

play13:31

we've seen in many use cases uh in the

play13:33

media about model hallucinations where

play13:36

the models go off and say things that

play13:37

aren't necessarily true but they say it

play13:39

in a way that's believable we want to

play13:41

make sure that we mitigate those types

play13:43

of risks before we make technology

play13:45

available from SAS in that domain so

play13:47

we're taking a conservative approach um

play13:49

doing a lot of research we have uh folks

play13:52

in our R&D area prototyping a variety of

play13:54

different things um that we hope to

play13:56

bring to Market but we always want to

play13:58

keep keep an eye on the feasibility

play14:02

these models are really expensive to run

play14:04

um they take a lot of compute power so

play14:05

we want to make sure that whatever we

play14:06

generate whatever we make available to

play14:08

our customers really does um give an RO

play14:11

a strong Roi because if you're going to

play14:13

pay for them you want to make sure

play14:14

you're getting something tangible in

play14:16

return um we also want to make sure that

play14:19

we're following an ethical path and

play14:21

there are a lot of discussions around

play14:22

ethics when it comes to generative Ai

play14:24

and AI in general uh where does the data

play14:27

come from in order to train these large

play14:29

language models you have to have a

play14:30

tremendous amount of data and there are

play14:32

a lot of concerns about the way some of

play14:34

the um off the-shelf right now uh large

play14:38

language models are are built and

play14:41

pre-trained using Wikipedia and other

play14:44

internet-based sources who owns that

play14:46

data and are there privacy concerns we

play14:48

want to make sure that we're following

play14:50

the most ethical path forward so as far

play14:52

as generative AI at SAS uh we're always

play14:54

going to be um keeping an eye on the

play14:58

ethical side and we want to make sure

play15:00

that whatever we produce is done um with

play15:03

an eye on mitigating harm we don't we

play15:06

definitely don't want to introduce harm

play15:08

uh and doing things in a way that's

play15:09

really going to bring True Value to our

play15:11

customers and reduce risk because

play15:14

they're all there are a lot of risks uh

play15:15

with generative

play15:17

AI for sure lots of points of concern

play15:20

there about the ethics and cost to

play15:23

compute but a lot to look forward to as

play15:26

well um I've been seeing more and more

play15:28

more jat uh chat GPT versions come out

play15:33

like one month to the next the growth on

play15:36

that is pretty exponential could you

play15:38

talk a little bit about the rate of that

play15:40

growth and what the newest version

play15:42

offers and the the the timeline for that

play15:46

sure um chat GPT is really fun I mean I

play15:49

think everybody has everybody who's

play15:51

involved in technology has played with

play15:53

it in one form or another um I have

play15:55

friends who have their grandparents Now

play15:58

using chat GPT to generate recipes for

play16:00

Sunday dinners uh so we have our

play16:02

grandmothers and our great-grandmothers

play16:04

involved uh in technology which is

play16:05

really really cool not all the recipes

play16:08

are really good so you have to take that

play16:10

for whatever whatever it's worth um but

play16:13

these models are here to stay so they're

play16:15

not going to go away they're going to

play16:16

continue to improve and as open AI has

play16:20

has released um additional versions so

play16:23

chy GPT the original was at running at

play16:25

GPT 3.5 and they have released GP 4 and

play16:29

that model is showing even more promise

play16:31

so the the research in this area is

play16:34

amazing there's there's a lot of work

play16:36

being put into it by uh by so many uh

play16:40

people organizations because there's a

play16:42

lot of interest in it um so it's

play16:44

technology that's here to stay it's not

play16:46

going away uh it's going to continue to

play16:48

improve and as long as we keep an eye on

play16:50

it from an ethical

play16:53

standpoint I say the sky's the

play16:56

limit yeah it's a lot of exciting stuff

play16:58

you'd have to be a really Brave one to

play17:00

try a chat GPT recipe for now some of

play17:05

the recipes are a little questionable

play17:07

yeah a little sketchy but I'm sure it'll

play17:10

get to the point where it'll be just

play17:11

chef's kiss type of stuff hopefully um

play17:14

question for you uh for the Casual chat

play17:17

GPT generative AI user what are some

play17:21

some things that they should watch out

play17:23

for just general you know Pro tips best

play17:26

practices that we should keep in mind

play17:29

I think my favorite because like said

play17:31

we're all engaging with chat GPT there

play17:33

are people that are using it to generate

play17:35

a tremendous amount of content be

play17:37

careful um there is risk uh the the

play17:42

models do generate really excellent

play17:44

sounding results and sometimes they're

play17:47

not really that trustworthy uh my

play17:49

favorite example recently I asked chat

play17:52

GPT about text to speech synthesis which

play17:55

is an area that I find interesting which

play17:57

is essentially um having a machine speak

play18:00

like a human so you have to think about

play18:02

things like inflection and tone and the

play18:05

rise and fall of the voice depending on

play18:07

what you're talking about so I thought

play18:08

it'd be interesting to see what it came

play18:10

back with and it gave me a really nice

play18:12

explanation I asked it deci it sources

play18:15

and it came back with four papers and

play18:17

they all sounded believable and it gave

play18:19

me links to the papers which I thought

play18:21

though that's really cool so I click on

play18:22

the links I get 404 not found errors so

play18:25

the links are bad so I thought okay well

play18:27

I'm just going to search for the papers

play18:29

the papers don't actually exist so they

play18:31

sound plausible but they're not real

play18:33

papers they were not published works so

play18:35

I asked chat GPT where can I find this

play18:38

type of information on the ACL Anthology

play18:40

which is a really big repository of

play18:43

papers around computational Linguistics

play18:45

and natural language processing so it

play18:47

gave me the same paper names with ACL

play18:49

Anthology links when I clicked on those

play18:51

links the P it returned papers but they

play18:54

weren't the papers that were cited

play18:55

because those papers didn't exist uh

play18:58

such took it one step further last step

play19:00

um I asked it for the authors of these

play19:02

invented papers and it gave me authors

play19:05

that publish in the space um but the

play19:07

combinations of researchers didn't match

play19:10

up uh and they certainly didn't write

play19:12

those papers because those papers don't

play19:13

exist so if I had taken that information

play19:15

at face value it probably wouldn't have

play19:17

panned out very well because none of it

play19:19

was real um it sounded plausible though

play19:22

and the titles seemed very believable

play19:24

the authors that were generated are real

play19:26

but not in the right combinations so my

play19:28

advice is use it with caution so always

play19:32

check you know always verify the work um

play19:35

I uh I work with students and I tell

play19:38

them that in general if you're going to

play19:39

use generative AI to do your homework

play19:42

your grade is probably going to reflect

play19:43

the level of effort you put into it so

play19:45

use it with

play19:47

caution yes good point they're very good

play19:49

at sounding convincing sounding real

play19:52

sounding human when it's actually not at

play19:55

all uh break the fourth wall a little

play19:57

bit this Mary Osborne that we have on

play19:59

right now is actually generated by chat

play20:02

GPT we just threw in prompt and here she

play20:05

is convincing

play20:08

right Mary thank you so much for for

play20:11

coming on the show again and uh we hope

play20:13

to have you back for another interview

play20:14

great it's been my pleasure thank

play20:17

you just to clarify that was the real

play20:21

Mary Osborne AI isn't at that level yet

play20:23

abilities across the entire analytics

play20:26

life cycle including preparing data

play20:29

creating and viewing reports building

play20:31

models automating model deployment and

play20:34

visualizing event streams so try it out

play20:37

today go to sas.com slva for complete

play20:41

information and to sign up for the trial

play20:44

well we reached the end of this month's

play20:46

show but we'll be back at it again next

play20:48

month with more SAS via features and

play20:50

updates if you're watching this on

play20:52

YouTube why not give us a like And

play20:54

subscribe to the SAS users YouTube

play20:55

channel click on that Bell so you'll get

play20:58

notified for new videos and when we go

play21:00

live for our next show in May until then

play21:04

comment on what topics you'd like to see

play21:05

in future shows I've been your host

play21:08

Thiago Doza that was the word for

play21:10

today's updates and I'll see you next

play21:12

time thanks

play21:15

[Music]

play21:22

everyone

Rate This
★
★
★
★
★

5.0 / 5 (0 votes)

Étiquettes Connexes
SAS ViyaMicrosoft WordMachine LearningData EngineeringModel AutotuningNeural NetworksGenerative AIEducational InsightsEthical AITech Innovation
Besoin d'un résumé en anglais ?