AI Career Opportunities for Data Professionals - Time to Pivot?

Dave Ebbelaar
26 Jul 202423:58

Summary

TLDRIn this insightful video, Dave Abelar, founder of Data Lumina, explores the booming AI industry's impact on data professionals. He discusses opportunities across various roles, including data scientists, engineers, and AI specialists, highlighting the need to upskill in software engineering and adapt to new technologies like large language models. Abelar also addresses the current hype cycle of generative AI, suggesting ways to pivot or upskill within the field, and offers guidance for leveraging AI in business strategies and considering freelance opportunities to future-proof careers.

Takeaways

  • πŸš€ The AI hype is still booming, offering numerous opportunities for data professionals to pivot or upskill their careers.
  • πŸ’‘ Data professionals are considering whether to pivot or upskill in response to the current market trends and opportunities in AI.
  • 🌐 Dave Abelar, founder of Data Lumina, discusses various data roles and their opportunities in the current market, emphasizing the potential for growth and change.
  • πŸ“ˆ The hype cycle of generative AI is currently at the peak of inflated expectations, suggesting a potential upcoming disillusionment phase where the technology's challenges become more apparent.
  • πŸ” Despite the public hype dying down, business owners and managers still show strong interest in large language models and their transformative potential.
  • πŸ’» Data scientists can leverage their skills in understanding business cases and data to work with pre-trained models, but may need to upskill in software engineering to implement these models in applications.
  • πŸ“Š Data analysts can explore opportunities in monitoring and evaluating large language models, using tools like LangSmith or LangFuse to ensure model performance over time.
  • πŸ”§ Data engineers have a crucial role in providing the foundational data and infrastructure needed for AI models, including building data platforms and optimizing data feeds for AI applications.
  • πŸ€– AI Engineers focus on prompt engineering, handling chaotic mediums like large language models, and building event-driven architectures, often without needing deep machine learning expertise.
  • πŸ’Ό Consulting in AI strategy can be a valuable role for data professionals, helping businesses navigate the implementation of AI effectively and safely.

Q & A

  • What is the current state of the AI hype cycle according to the video?

    -The video mentions that generative AI was at the peak of inflated expectations last year, and it is likely to be followed by a trough of disillusionment where people realize the technology is not as easily transformative as initially thought.

  • What is the role of Dave Abelar in the data community?

    -Dave Abelar is the founder of Data Lumina, where he has been building custom data solutions for clients for the past 5 years. He also runs a community called Data Freelancer, teaching data professionals how to get started with freelancing and scale it to six figures and beyond.

  • Why might a data professional consider upskilling in software engineering when looking into generative AI?

    -Upskilling in software engineering is important because when working with pre-trained large language models, the focus shifts from model training to application development. This requires understanding web applications, event-driven architectures, and deployment strategies like Docker containers and cloud services.

  • What opportunities are available for data scientists in the context of AI and large language models?

    -Data scientists can explore opportunities in prompt engineering, optimizing AI model outputs, and building applications around pre-trained models. They can also leverage their skills in data analysis and model evaluation to work on generative AI projects.

  • How can data analysts contribute to the monitoring and evaluation of AI applications?

    -Data analysts can use tools like LangSmith or LangFuse to create dashboards for monitoring AI applications, ensuring the performance of these applications does not decrease over time. They can also create evaluation datasets to assess model performance with different prompts.

  • What is the significance of data infrastructure for data engineers in leveraging AI opportunities?

    -Data engineers play a crucial role in establishing a solid data platform that feeds the AI models with the right data. They can focus on building robust data pipelines, working with vector databases, and ensuring data is well-prepared for AI models to use effectively.

  • What are the key skills an AI engineer should focus on according to the video?

    -AI engineers should focus on prompt engineering, tolerance for working with chaotic mediums like large language models, chaining agents, reactive UIs, and event-driven architectures. They should also understand software engineering fundamentals more than deep learning expertise.

  • What opportunities are there for machine learning engineers in the field of generative AI?

    -Machine learning engineers can explore optimization techniques for large language models using libraries like DSPI and TextGret. They can also focus on monitoring and operational aspects of AI models, leveraging their existing knowledge in machine learning to work with generative AI.

  • What consulting opportunities are available for data professionals in the realm of AI?

    -Data professionals can offer AI strategy consulting, helping businesses understand how to effectively, safely, and reliably use AI. This includes creating AI strategy roadmaps, addressing data management, technology infrastructure, and capability development within a company.

  • How can data professionals capitalize on the current AI hype to pivot their careers?

    -Data professionals can explore internal opportunities within their current roles, seek new job opportunities focusing on AI, or start freelancing to gain experience with generative AI. They can also consider consulting to help businesses navigate AI implementation.

Outlines

00:00

πŸš€ Opportunities in Data Careers Amidst AI Hype

Dave Abelar, founder of Data Lumina, discusses the booming AI industry and its impact on data professionals. He outlines the various roles such as data analysts, scientists, engineers, machine learning engineers, and AI engineers, and the opportunities available in the current market. Dave aims to provide insights to help viewers decide whether to upskill or pivot in their careers, possibly towards generative AI or freelancing. He shares his expertise based on hands-on experience and a professional network, emphasizing the ongoing interest from business owners despite a dip in public hype.

05:01

πŸ”§ Upskilling for Data Scientists in the AI Era

The script highlights the need for data scientists to upskill in software engineering to leverage large language models (LLMs) effectively. Traditional data science focuses on modeling, but with pre-trained LLMs, the emphasis shifts to application development. Data scientists are encouraged to learn web application building, working with web hooks, event-driven architectures, and containerization for deployment. Practical skills like prompt optimization and using libraries for robust LLM applications are also discussed, positioning data scientists for new opportunities in AI engineering or freelancing.

10:03

πŸ“Š Data Analysts: Monitoring and Evaluating AI Applications

Data analysts are presented with opportunities in monitoring and evaluating AI applications, particularly large language models. The script suggests learning tools like LangSmith or LangFuse for dashboard creation and model performance evaluation. It also mentions the importance of creating evaluation datasets to prevent model drift over time, aligning with the existing skill set of data analysts and opening avenues for involvement in the AI space.

15:04

🌐 Data Engineers: Building Foundations for AI

Data engineers are poised to capitalize on the AI hype by focusing on data infrastructure, which is crucial for feeding and managing LLMs. The script discusses the need for solid data platforms, the use of vector databases, and technologies like Pinecone, Weaviate, and Milvus. It also touches on data enrichment using LLMs and the potential of open-source models to reduce costs, positioning data engineers as essential in enabling AI adoption.

20:06

πŸ›  AI Engineers: The New Role in AI Implementation

AI engineers are described as a new role that overlaps with machine learning experts and full-stack engineers, focusing on prompt engineering, tolerance for chaotic mediums like LLMs, and building reactive UIs and event-driven architectures. The script emphasizes that deep ML expertise is not required, and software engineering fundamentals are more valuable. It also discusses the importance of understanding full-scale end-to-end solutions, robust application monitoring, and the strategic placement of AI within a company's architecture.

πŸ€– Machine Learning Engineers and the Optimization of AI

Machine learning engineers are encouraged to explore libraries like DSPI and TextGret for optimizing large language models using backpropagation, similar to neural network optimization. The script highlights the importance of post-production model monitoring and the unique advantage machine learning engineers have in understanding these processes. It also suggests considering a move towards AI strategy consulting to help businesses navigate AI implementation effectively.

πŸ’Ό Navigating Career Pivots in the AI Landscape

The final paragraph discusses personal strategies for capitalizing on the AI hype, whether through internal pivots within one's current job, seeking new job opportunities, or starting a freelancing side gig. It emphasizes the importance of understanding one's personal situation and leveraging the current skills to explore generative AI projects. The script also promotes a training program for data professionals interested in freelancing and ends with a call to action for viewers to learn more about Data Lumina Solutions' approach to AI project delivery.

Mindmap

Keywords

πŸ’‘AI Hype

The term 'AI Hype' refers to the widespread excitement and attention surrounding artificial intelligence technologies, particularly in the media and public discourse. In the video, it is mentioned that despite the hype potentially dying down for the general public, business owners and managers still show strong interest in AI, especially in large language models, due to their transformative potential.

πŸ’‘Data Professionals

Data professionals encompass a range of roles, including data analysts, scientists, engineers, and those involved in machine learning and AI. The video discusses various opportunities available to these professionals in the current AI market, suggesting they might consider upskilling or pivoting their careers to align with the latest trends.

πŸ’‘Upskilling

Upskilling is the process of acquiring new skills or improving existing ones to stay relevant in a changing job market. The script encourages data professionals to consider upskilling in areas such as software engineering or understanding large language models to capitalize on opportunities in the AI field.

πŸ’‘Generative AI

Generative AI refers to artificial intelligence systems that can create new content, such as text, images, or music. The video discusses how generative AI, and AI in general, presents new career paths and opportunities for data professionals, such as working on projects that involve these innovative technologies.

πŸ’‘Data Analysts

Data analysts are professionals who collect, process, and interpret data to help businesses make decisions. The script mentions that data analysts can explore opportunities in monitoring and evaluation of large language models, which is crucial for ensuring the reliability and correctness of AI applications.

πŸ’‘Data Engineers

Data engineers are responsible for building and maintaining the infrastructure that supports data analytics. The video highlights the importance of data engineers in preparing data for AI models and the potential for them to work with new technologies like vector databases and AI-specific platforms.

πŸ’‘Machine Learning Engineers

Machine learning engineers develop algorithms and systems that enable computers to learn from data. The script suggests that these engineers can leverage their skills in optimizing and working with large language models, as well as monitoring these models once they are in production.

πŸ’‘AI Engineers

AI engineers are a new category of professionals who specialize in working with AI technologies, particularly focusing on prompt engineering and the application of AI models in various contexts. The video describes the role of AI engineers as not requiring deep machine learning expertise but rather a focus on software engineering and practical application of AI.

πŸ’‘Freelancing

Freelancing refers to the practice of working independently, often on a contract basis, for different clients. The script encourages data professionals to consider freelancing as a way to explore AI opportunities, gain experience, and potentially earn extra income while testing the waters of the AI job market.

πŸ’‘Monitoring Tools

Monitoring tools are software applications used to track the performance and health of systems, including AI models. The video mentions specific tools like Lang Smith and Lang fuse, which are important for data professionals to learn in order to effectively monitor and maintain AI applications.

πŸ’‘Event-Driven Architectures

Event-driven architectures are a type of software design pattern where the flow of the program is determined by events such as user actions or messages from other systems. The script points out the significance of understanding and implementing event-driven architectures for AI engineers working on generative AI applications.

Highlights

The AI hype is booming, presenting numerous opportunities for data professionals.

Data professionals are considering career pivots and upskilling in response to the AI market.

Dave Abelar, founder of Data Lumina, discusses various data roles and their opportunities in the current market.

Generative AI is at the peak of inflated expectations, likely to be followed by a trough of disillusionment.

Public interest in generative AI is waning, but business interest remains high.

Data scientists can pivot towards AI engineering by upskilling in software engineering.

Data scientists should focus on understanding how to build web applications and work with web hooks.

Data analysts can explore opportunities in monitoring and evaluating large language models.

Data engineers have opportunities in building data platforms and pipelines for AI models.

AI engineers should focus on prompt engineering and building event-driven architectures.

Machine learning engineers can leverage their skills in optimizing large language models using libraries like DSPI and TextGret.

Consulting in AI strategy can be a viable option for data professionals interested in advising businesses on AI implementation.

Data professionals can consider freelancing to explore AI opportunities while maintaining their current positions.

Data Lumina Solutions offers a training program to help data professionals start freelancing in AI.

Data professionals should consider pivoting within their current roles or exploring new job opportunities in AI.

Event-driven architectures are crucial for AI applications, requiring skills in software engineering.

Transcripts

play00:00

the AI hype is still booming and there

play00:02

are so many opportunities for data

play00:04

professionals right now and if you are

play00:07

one probably over the last couple of

play00:08

months you have thought to yourself at

play00:10

least a couple of times should I pivot

play00:12

should I upskill what should I do with

play00:14

my career where do I want to go so what

play00:16

I want to do in this video I want to go

play00:18

over each of the various data roles so

play00:21

analysts scientists engineers machine

play00:23

learning engineers and AI engineers and

play00:25

I want to talk about the opportunities

play00:28

that I see for each of those roles with

play00:30

in the current market right now and my

play00:32

goal with this video is to hopefully

play00:34

give you some ideas to figure out

play00:36

whether right now would be a good moment

play00:37

to upscale in a certain direction maybe

play00:39

pivot within your current role maybe

play00:41

look for a completely new role or maybe

play00:44

even start some Freel like freelance

play00:46

gigs on the side to see if generative AI

play00:49

or AI in general is the route that you

play00:51

want to go with your career and now for

play00:53

those of you that are new here my name

play00:55

is Dave abelar I'm the founder of data

play00:56

Lumina and I've been building custom

play00:58

data Andi solution for my clients for

play01:01

the past 5 years already and next to

play01:04

that we also run a community called Data

play01:06

freelancer where I teach data

play01:08

professionals how to get started with

play01:10

freelancing and then scale it to six

play01:12

figures and Beyond and because of my

play01:15

position in the market right now having

play01:17

uh both hands-on experience working with

play01:19

clients and talking to a lot of business

play01:20

owners and also having that Professional

play01:23

Network around me of lots of Freelancers

play01:25

I would say have a pretty good pulse on

play01:27

what's currently going on in the market

play01:29

what what's hot what's trending what

play01:31

companies are looking for and also does

play01:34

what kind of skill sets as a data

play01:36

professional do you need and before we

play01:38

dive in let's quickly talk about the

play01:40

current hype cycle of generative Ai and

play01:43

where things are at right now to also

play01:45

assess for you where you should Mo move

play01:47

towards and to talk about this I I'm

play01:50

going to pull up a picture I have it

play01:52

here on my laptop but I will put it here

play01:53

on the screen this is the hype cycle

play01:55

from Gardner that all new technologies

play01:58

follow and last year you can see Gardner

play02:00

Place generative AI at the peak here of

play02:03

inflated expectations meaning that it is

play02:07

likely going to follow with uh or is be

play02:09

followed by a Thro of disillusion

play02:12

disillusionment where people are

play02:14

figuring out okay the technology it's

play02:16

not as transformational as we thought it

play02:18

was going to be it's actually pretty

play02:19

hard to to implement and where we are

play02:22

currently at on this hype cycle I can

play02:25

tell you for sure the only the only data

play02:28

that I can provide personally uh for you

play02:31

is for example if you look at uh if I

play02:34

last year would create a video on a new

play02:37

like General AI framework or giup

play02:39

repository it would easily get like

play02:41

100,000 views if I create the same video

play02:43

right now it will probably get only like

play02:45

5,000 or so views so that's kind of like

play02:47

a 20x in the amount of attention the

play02:50

amount of people that are interested in

play02:52

this but then on the other hand if we

play02:54

look at data luminous Solutions or

play02:56

development company we still have an

play02:58

ever increasing amount of inquiries that

play03:01

from from potential clients from leads

play03:03

that want to work with us and are are

play03:04

looking for a custombuilt data Ori

play03:06

solution so the O I would say the

play03:09

overall hype is dying down a little bit

play03:11

for the like general public but if you

play03:14

look at business owners

play03:16

managers there the the sentiment is

play03:18

still pretty pretty high pretty strong

play03:20

with regards to large language models

play03:22

and the opportunities that are there and

play03:24

also for a good reason this technology

play03:26

is still transformational but it's also

play03:28

challenging to Implement at scale but

play03:32

that's where we as data Professionals of

play03:34

course come in so with that out of the

play03:36

way let's now talk about these

play03:38

opportunities and like I've said I'm

play03:39

going to split these up into the various

play03:42

data roles now um I will also link time

play03:45

stamp so you can maybe if you're a data

play03:47

scientist for example you can jump to

play03:48

the data science part Etc but I think it

play03:51

could also be interesting to um or I

play03:53

would definitely recommend watching all

play03:54

of these and not just to get fuse on

play03:56

this video but it might trigger some

play03:58

ideas on how a certain skill set can be

play04:01

leveraged in this AI hype that's going

play04:04

on so let's start with data scientists

play04:07

and let me Begin by stating that the

play04:10

traditional role of a data science

play04:11

working on traditional classical machine

play04:14

learning problems is still there's still

play04:17

so much demand for that probably even

play04:19

more than generative AI so please also

play04:22

don't forget that but given this new

play04:25

technology and given large language

play04:27

models there are various new

play04:28

opportunities that are interested uh

play04:31

interesting for data scientists and you

play04:33

also see this trend there's also this

play04:35

nice meme I will put it on the screen

play04:37

here of data scientists rebranding

play04:40

themselves towards AI engineers and I'm

play04:42

personally guilty of that like for sure

play04:45

I've been trained as a data scientist

play04:47

but right now what I spot right uh right

play04:49

now especially for my business I enjoy

play04:53

uh I enjoy working on generative AI

play04:56

projects more than working on classical

play04:58

machine learning projects we still do

play05:00

those as well but there is just a whole

play05:03

lot there are just much more

play05:04

opportunities right now and also if you

play05:06

look at the skill set of a data

play05:08

scientist and how you are trained it

play05:10

aligns very well with what you can do

play05:13

with these these new technologies but

play05:16

there are some caveats here and that is

play05:18

you probably need to upscale on software

play05:20

engineering because while data

play05:23

scientists uh previously data science is

play05:26

is much more focused on the modeling

play05:28

part right asking the right questions

play05:29

getting the right data getting to that

play05:32

final model that works for your specific

play05:34

use case now when we take large language

play05:37

models the model is already pre-trained

play05:39

so this powerful engine is already here

play05:43

and the the like the same mindset and

play05:46

skill set early on in the projects of

play05:48

figuring out uh the business case

play05:50

figuring out the true problem getting

play05:51

the right data that is all still the

play05:53

same but the whole modeling part is now

play05:55

very much different because the model is

play05:57

already there so you almost immediately

play06:00

jump to putting it into putting it into

play06:03

an application create creating an

play06:04

application around that already existing

play06:07

model and like I've said what that means

play06:10

in in practice is that you need to

play06:12

understand how to build web applications

play06:14

you need to understand how to for

play06:16

example work with with web Hops and

play06:17

triggers to build event driven

play06:19

architectures you probably need to

play06:22

understand if you put all of this

play06:23

together how to put this into for

play06:25

example a Docker container and then put

play06:27

it on a server or run it in a container

play06:30

app on Azure or AWS those are now all

play06:34

skills that you need in order to really

play06:36

put these applications into production

play06:39

whereas before it was maybe just your

play06:41

machine learning model that you would

play06:43

make available and then another team

play06:44

would create an application around that

play06:48

so I would say that is the most

play06:50

important skill and therefore also

play06:52

opportunity that you could look into if

play06:55

you want to explore generative AI so the

play06:56

software engineering part is definitely

play06:58

the I would say the most important one

play07:01

to look into but next to that you also

play07:03

have more practical things like

play07:05

understanding how rack works how to

play07:06

build rack pipelines how to optimize

play07:09

prompts how to work with libraries uh

play07:11

like instructor and penic in order to

play07:14

improve the robustness of your llm

play07:17

applications those are all things that I

play07:19

would say really naturally fit into the

play07:22

core skill set of a data scientist and

play07:24

then if you if you really master that

play07:26

and then also look into infrastructure

play07:28

and building web application

play07:30

you set yourself up for a lot of new

play07:33

opportunities whether that's inside your

play07:35

current role an entirely new role where

play07:38

you could look for AI engineering

play07:39

positions for example or like I've said

play07:41

even Explore some freelancing gigs on

play07:43

the side to really figure out if this is

play07:45

the direction you uh you like to learn

play07:48

more about these Technologies and of

play07:49

course maybe make a little bit of extra

play07:51

money on the side all right and then

play07:53

next let's talk about data analysts and

play07:56

one big opportunity that I see right

play07:59

here for for data analyst is it has to

play08:01

do with large language models monitoring

play08:05

and evaluation and why does this maybe

play08:07

something you shouldn't immediately

play08:09

think about what you see in the real

play08:11

world right now is that putting these

play08:13

large language models into applications

play08:15

at scale it it becomes really tricky

play08:17

it's really tricky to monitor them and

play08:19

to make sure that the answers stay

play08:22

correct that the applications keep

play08:23

running and I think this could be an

play08:26

interesting opportunity for data

play08:28

analysts to look into tools like for

play08:30

example Lang Smith or an open source

play08:32

version Lang fuse and figure out and

play08:34

learn these tools and understand how you

play08:36

can use these tools to create simple

play08:38

dashboards to monitor llm applications

play08:41

then next to that you can also look into

play08:43

creating evaluation data sets so how you

play08:46

can evaluate various versions of models

play08:50

uh in combination with various promps to

play08:52

ensure that the performance of these

play08:54

applications is not decreasing so you

play08:56

have a constant evaluation to this it's

play08:59

also something you have with machine

play09:00

learning it's called Model drift over

play09:02

time you always have to keep monitoring

play09:03

your model same is true with large

play09:06

language models with the model fions

play09:07

with the prompts all right and then next

play09:09

let's talk about data engineers and

play09:11

there are so many great opportunities

play09:13

for data Engineers right now because

play09:16

while large language models are

play09:18

pre-trained there is no training

play09:20

required typically if you go fine

play09:21

shooting at Route but typically you can

play09:23

use the models out of the box but still

play09:25

you need data to feed those models you

play09:28

need prom to feed those models and

play09:31

especially the combination and with that

play09:34

what you see right now is there AI is

play09:37

fancy AI is what companies want right

play09:40

they want the fancy model they want the

play09:41

automation but what they don't

play09:43

understand is that in order to fully

play09:45

leverage this technology they need those

play09:48

foundations in place they need good data

play09:51

and whatever and this of course depends

play09:54

on the size of the company but this

play09:55

could even mean for larger organizations

play09:57

that you need a solid like data platform

play10:00

you need everything in place in order to

play10:02

then unify that and make it uh available

play10:05

to these AI models and there is so much

play10:07

work to be done in that area where data

play10:11

Engineers can really leverage that and

play10:13

position themselves as data Engineers

play10:16

that help companies to basically enable

play10:19

them to use Ai and a little more

play10:22

practical also of course here you can

play10:24

focus on rack pipelines and then more

play10:26

specifically getting to some more

play10:28

advanced algorithms and techniques like

play10:31

query expansion uh self query hybrid

play10:34

search reranking those are all things

play10:37

you could look into then of course you

play10:38

have the vector databases for example

play10:40

you have pine cone we8 quadrant you

play10:42

could look into PG factor or PG Factor

play10:45

scale those are all entirely new

play10:47

technologies and platforms that you can

play10:49

look into as a data engineer to expand

play10:52

that skill set that you already have

play10:54

again minimizing the effort required in

play10:57

order to learn something new and learn

play11:00

new skill and take on uh a whole set of

play11:03

new projects and next to that if you're

play11:05

working for larger organizations you

play11:07

have platforms like data bricks or

play11:09

snowflake or uh just the data uh

play11:12

database tools that are available in the

play11:14

major Cloud providers like Azure AWS or

play11:16

Google those are all technologies that

play11:19

really fit well into that whole

play11:21

Narrative of getting your data first in

play11:23

the right place maybe having like bronze

play11:25

silver gold layers um getting that data

play11:29

ready for these AI models to use next to

play11:32

that one other thing also data data

play11:35

enrichment using large language model so

play11:38

generating metadata using llms on Big

play11:41

Data is also really interesting it can

play11:43

get really expensive depending on the

play11:45

size and this is also I think where open

play11:48

source models are going to play a big

play11:50

role in order to make that cheaper uh

play11:52

and maybe don't need as much power just

play11:55

to for example create simple tags uh to

play11:57

add some additional element to that data

play12:00

all things that you can look into as a

play12:02

data engineer to capitalize on this AI

play12:06

hype and then let's talk about the AI

play12:08

Engineers which is a relatively like new

play12:11

term that has been coined even though AI

play12:14

has already been around for years but

play12:16

what you see right now online is that

play12:18

the AI Engineers are kind of like

play12:20

positioned like this and let me actually

play12:22

pull up an an article here um I will I

play12:24

will put it on the screen this is about

play12:26

how to hire AI Engineers but I recently

play12:28

came AC Ross this and they have this

play12:30

very cool diagram over here how an AI

play12:33

engineer what what kind of like the

play12:34

focus is and they highlighted here as as

play12:37

an AI engineer you focus on prompt

play12:38

engineering fa to tolerance for a

play12:41

chaotic medium AKA large language models

play12:43

chaining agents reactive uis and event

play12:47

driven architectures and this also uh

play12:51

illustrates that there's a lot of

play12:52

overlap with uh machine learning experts

play12:55

and full stack Engineers lot of overlap

play12:58

there and I think also one interesting

play13:00

point is that deep ml expertise is not

play13:04

required and I definitely agree with

play13:07

that if you want to focus on AI

play13:09

Engineering in the typical role that I

play13:11

just described working with large

play13:13

language models you don't need uh deep

play13:15

learning or machine learning expertise

play13:17

you don't really also don't need any

play13:19

like statistics or math knowledge it

play13:22

could help but really truly you don't

play13:24

need it because these models are already

play13:26

pre-trained and you're much better off

play13:28

learning more about software engineering

play13:31

fundamentals than it uh than learning

play13:34

math or statistics and with this new

play13:36

role what you see is of course it builds

play13:38

on top of everything that we've already

play13:40

discussed so everything that I've

play13:42

discussed is also relevant for an AI

play13:44

engineer to understand but something uh

play13:47

important here to consider is if you

play13:49

really position yourself as an AI

play13:51

engineer and also being able to for

play13:53

example deliver full scale end to-end

play13:55

Solutions what you should figure out is

play13:58

we are

play13:59

we're right now we're past the phase

play14:01

where companies are just okay with

play14:03

spending lots of money on proof of

play14:05

Concepts because that was last year it

play14:07

was really the case like every like

play14:09

major company would just have an R&D

play14:11

budget was like go do something with

play14:13

this and right now what we see people

play14:15

have of companies have spent that money

play14:17

and right now what they want is they

play14:19

want real business value so they

play14:21

actually want something that works in

play14:23

production and in order to do that you

play14:27

first of all you need experience because

play14:29

it's it's challenging to to do this

play14:32

properly and you need to understand a

play14:34

whole lot of Concepts that can help you

play14:37

to make these uh applications using

play14:40

large language models more robust so it

play14:42

becomes really important to understand

play14:45

proper Arrow handling proper monitoring

play14:48

large language models Ops using the the

play14:50

tools that I've uh just described so

play14:52

Lang fuse L Smith those kind of

play14:54

monitoring tools putting libraries like

play14:57

instructor to work to leverage for

play15:00

example uh penic data models for for

play15:03

validations um but then also considering

play15:06

all of that and then looking how that

play15:08

fits in the overall architecture of the

play15:11

company and where we could eventually

play15:13

like put this into production whether

play15:15

that's on a server using Docker or using

play15:17

some resource within some kind of cloud

play15:19

provider these are all questions and

play15:21

things that you have to consider and

play15:23

skill sets that you need to understand

play15:25

if you really want to become an AI

play15:27

engineer in precision yourself as

play15:29

someone that can really deliver these

play15:31

Solutions end to end and one other thing

play15:33

that I would like to elaborate on is

play15:35

this notion of event driven

play15:37

architectures and this is why this is so

play15:40

important is that most of the generative

play15:43

AI applications are event driven meaning

play15:46

there is some kind of like application

play15:48

that is waiting for a trigger waiting

play15:50

for a response waiting for an event

play15:52

either from a user or from a process and

play15:56

that triggers the whole pipeline so

play15:58

think about for example a customer care

play16:01

automation solution the application is

play16:03

running in the background and whenever

play16:04

there is a new ticket coming in that

play16:07

ticket has information and the AI needs

play16:10

to process that information in order to

play16:13

for example then generate an automated

play16:15

reply which is then sent back to the

play16:17

ticketing system so this is event driven

play16:21

and you can set this up in your web

play16:22

application but you need to be able to

play16:25

handle this at scill so that maybe means

play16:28

putting uh workers or cues in place like

play16:30

celery and being able to handle all of

play16:33

that traffic correctly at scale monitor

play16:36

that oversee that so event driven

play16:39

architectures uh like I've said it's

play16:40

much more in the software engineering

play16:42

side really important to to look into

play16:45

understand uh how to build those

play16:47

understand the design patterns that you

play16:48

can leverage here really interesting

play16:50

stuff I really enjoy learning and Diving

play16:52

more into that all right and then let's

play16:54

get into the machine learning engineer

play16:56

now here again there's a lot of over lab

play16:59

with the data engineer and the data

play17:00

scientist but I think given the the

play17:03

skill set of uh classical machine

play17:05

learning engineer there are some other

play17:07

opportunities that that could work well

play17:09

for this role and that has a lot more to

play17:12

do with the optimization part of the

play17:15

whole process of working with large

play17:17

language models and two particular

play17:19

libraries that are really interesting to

play17:21

look into are dspi and text Gret which

play17:25

are both libraries I believe from

play17:26

Stanford researchers and they both based

play17:29

around the idea of of back propagation

play17:32

uh about similar to how pytorch is set

play17:34

up to optimize neural networks but now

play17:38

you can do so with large language models

play17:41

using prompts using text and both of

play17:43

these libraries are really interesting

play17:44

to look into they have a slightly

play17:46

different angle but they are both uh

play17:49

created around the idea of optimizing

play17:51

large language models similar to how you

play17:54

would do with neural networks so I think

play17:57

that's an a unique advantage that really

play17:59

ties into the skills and the knowledge

play18:01

that you already have as a machine

play18:03

learning engineer but then also really

play18:05

of course what happens after you put the

play18:07

model into production monitoring it so

play18:10

again here the whole llm llm Ops comes

play18:12

into play monitoring so depending on

play18:15

what you like depending on how much

play18:16

experience you for example have with

play18:18

monitoring machine learning algorithms

play18:21

monitoring large language models is I

play18:23

would say relatively similar although

play18:26

much more chaotic so that is something

play18:29

you have to adjust for that is something

play18:30

you uh you have to consider other than

play18:33

that really great opportunities for

play18:35

machine learning Engineers as well they

play18:37

have a great skill set to really thrive

play18:40

in this AI hype and then one last thing

play18:42

I want to talk about is Consulting

play18:44

within the realm of AI and I think this

play18:46

is something any data role can

play18:48

potentially do if you're interested in

play18:50

that if you like that because what you

play18:52

see right now business owners companies

play18:55

they have a lot of questions they want

play18:57

to know how AI can be used effectively

play19:00

safely reliably without sharing data

play19:03

with open AI all of those questions they

play19:06

they want to get answers to that and so

play19:08

there is a lot of uh room for AI

play19:12

strategy Consulting and what you could

play19:15

think or offer for example would be to

play19:17

create AI strategy road maps and within

play19:20

such a road map you we're building one

play19:22

right now for a company you could really

play19:23

think about so the Strategic use of AI

play19:26

data management and governance the

play19:28

technology infrastructure skills and

play19:30

capability development are really about

play19:32

the talent that they uh need within a

play19:35

company in order to um Implement AI at

play19:38

scale effectively you can talk about

play19:40

change management risk management

play19:42

management budgets and fenders those are

play19:44

all things that you can talk about and

play19:47

help companies with now if you're

play19:49

currently a data professional and you

play19:51

work for example in a large organization

play19:53

and you maybe already see some of the

play19:55

things that are going on you can take

play19:57

all of that information and maybe talk

play19:59

to small business owners where of course

play20:01

the landscape the situation is very

play20:03

different but also uh since it's smaller

play20:05

usually a lot simpler so you can use all

play20:08

of that that knowledge and even start

play20:10

some Consulting gigs on the site and

play20:12

help companies like that and the cool

play20:14

thing about starting with that is that

play20:17

by starting as in with a consulting job

play20:19

or Consulting role for example you get

play20:21

to know these these companies and their

play20:23

pain points and their challenges and

play20:24

also their opportunities and then that

play20:27

could open the door to then maybe

play20:28

position yourself as also the expert to

play20:32

come and implement this so those are all

play20:34

things that you can consider and this is

play20:36

much more for really if you want to do

play20:38

things on the side probably not so much

play20:40

within your own role but hey who knows

play20:43

all right and with those opportunities

play20:45

covered let's now talk about whether

play20:47

it's time for you to piot how you can

play20:49

capitalize on this current AI hype and

play20:52

whether or if you shoot and of course

play20:54

this answer is going to really depend on

play20:56

your personal situation but really my

play20:59

goal here is to present you all of these

play21:01

opportunities and help you think outside

play21:03

of the box to see what's possible here

play21:06

and also really think about that for a

play21:08

lot of or almost all of the data roles

play21:11

there is something that is I would say

play21:13

right around the corner so meaning it it

play21:16

fits really well into your current skill

play21:18

set you maybe just have to look up a few

play21:20

tutorials and then you could probably

play21:23

take on a project within uh that

play21:26

particular like area Direction in

play21:28

generative Ai and because of that

play21:31

possibility there are a lot of things

play21:34

that you can potentially do so you have

play21:36

of course pivoting within your own

play21:39

current job so you could figure out okay

play21:41

my company my role right now do I like

play21:43

it do I want to pursue generative AI do

play21:45

I want to move towards that direction

play21:47

see if there are opportunities talk with

play21:49

your manager talk with your boss take on

play21:51

an internal project even an innovation

play21:53

project R&D project figure out if you

play21:55

can uh move that way to see if you like

play21:58

it I think it can almost uh help any

play22:01

company really literally every company

play22:03

could can benefit from generative AI if

play22:05

implemented correctly that's what I

play22:07

believe so go and search for that

play22:09

opportunity now if you feel like this is

play22:11

really so exciting and my current role

play22:14

I'm not sure I don't really like it

play22:16

anymore I feel like I'm kind of like

play22:17

stuck then what you could of course

play22:19

explore is looking for an entirely new

play22:23

uh job opportunity somewhere else where

play22:25

you could do more with this new

play22:27

technology but but that's of course is a

play22:29

big step and then another thing you can

play22:31

also of course try is start freelancing

play22:33

on the side to maybe take on some small

play22:37

projects and work with this generative

play22:39

AI technology to see if you like it

play22:41

maybe to learn more about this maybe you

play22:43

get paid to learn even if you just like

play22:45

start out small and this could be as as

play22:47

simple as helping out a friend or a

play22:49

family member with a simple simple

play22:52

application maybe even starting out for

play22:54

free and then maybe start charging later

play22:57

on once you've proved that you can do

play22:59

this maybe you got some testimonials so

play23:01

that could also be an excellent IDE to

play23:05

learn more about this technology to

play23:06

Future proof your career while still for

play23:09

example keeping the the safety and the

play23:12

security of your current position and

play23:15

now also if that's something you're

play23:16

interested in you could check out the

play23:18

first link in the description like I've

play23:19

said I help dat the professionals to do

play23:21

this we have a dedicated training

play23:23

program to literally get you up and

play23:25

running in 60 days it will teach you

play23:26

everything you need to know in in order

play23:28

to get started and land your first

play23:30

paying client as a data professional so

play23:33

if you want to check that out first link

play23:35

in the description all right and that

play23:36

wraps up this video if you found it

play23:38

helpful please leave a like and also

play23:40

consider subscribing and then if you

play23:42

want to learn more about how we a data

play23:44

Lumina Solutions find build and deliver

play23:46

these generative AI projects all the way

play23:49

from the beginning to the whole like

play23:50

architecture check out this video next

play23:53

where I will go over that entire process

play23:55

that we use inside our company right now

Rate This
β˜…
β˜…
β˜…
β˜…
β˜…

5.0 / 5 (0 votes)

Related Tags
AI HypeCareer PivotUpskillingData RolesGenerative AIData ScienceMachine LearningData EngineeringAI EngineeringFreelancingTech Trends