6 Years of Studying Machine Learning in 26 Minutes

Boris Meinardus
22 Jul 202426:05

Summary

TLDRThis video script narrates the journey of a machine learning enthusiast, detailing their six-year transformation from a computer engineering student to a research scientist at a favorite AI startup. The speaker shares their academic and professional experiences, including initial struggles, pivotal courses, research projects, and the process of landing their dream job. The script also highlights the importance of continuous learning, making informed career choices, and avoiding common beginner mistakes in the field of machine learning.

Takeaways

  • 😀 The speaker's journey in machine learning started with an interest in physics and math, leading to a Computer Engineering degree at TU Berlin.
  • 📚 The initial years of university were challenging, focusing on foundational courses like linear algebra, calculus, and differential equations, which later became crucial for understanding machine learning.
  • 🔧 The speaker's first job as a student researcher in an optical physics lab helped build a strong foundation in experimental work and programming, but also highlighted the importance of seeking new challenges to avoid stagnation.
  • 💡 The discovery of AI courses in the fifth semester marked the beginning of the speaker's deep dive into machine learning, starting with reinforcement learning.
  • 🎓 The bachelor thesis on deep reinforcement learning for autonomous robotic navigation was a significant step, despite the initial struggles and the steep learning curve.
  • 📈 The transition to a Computer Science master's program allowed the speaker to focus exclusively on machine learning, taking advanced courses and engaging in more complex projects.
  • 🤖 Working on robotics projects and publishing a paper at a top conference like IROS was a major milestone, showcasing the speaker's growth and capabilities in the field.
  • 👨‍🏫 The speaker's experience of switching teams within the research institute to work in the AI department highlights the importance of proactively seeking opportunities to learn and grow.
  • 📘 Reading papers and learning from them independently became a habit that contributed to the speaker's development as a researcher.
  • 🚀 The pursuit of internships and jobs at top companies, including rejections and learning from them, demonstrated resilience and a commitment to continuous improvement.
  • 🌟 The speaker's eventual success in joining a favorite AI startup as a research scientist after years of hard work and learning emphasizes the value of persistence and incremental progress.

Q & A

  • What was the speaker's initial academic background before getting into machine learning?

    -The speaker initially studied Computer Engineering at TU Berlin, taking courses in linear algebra, calculus, differential equations, and basic programming in C.

  • How did the speaker's interest in machine learning begin?

    -The speaker's interest in machine learning began during their fifth semester when they chose their first AI course, which was split into two parts: old school AI and reinforcement learning.

  • What was the speaker's first experience with a machine learning project?

    -The speaker's first machine learning project was their bachelor thesis, where they worked on deep reinforcement learning for autonomous robotic navigation.

  • What was the speaker's first job as a student researcher, and how did it relate to their later work in AI?

    -The speaker's first job as a student researcher was at an optical physics lab, running experiments with optical fibers. Although not directly related to AI, it provided them with basic programming skills that later became useful in machine learning.

  • How did the speaker's experience with coding evolve throughout their studies?

    -The speaker started coding in C during their computer engineering studies, then moved to Java for data structures and algorithms, and later used Python for machine learning projects, including using libraries like PyTorch.

  • What is Codium, and how did the speaker use it to improve their coding efficiency?

    -Codium is a free coding assistance tool similar to GitHub Copilot. The speaker used it to refactor and explain existing code and to write appropriate functions using context from their entire project.

  • What was the speaker's approach to learning new machine learning concepts?

    -The speaker learned new machine learning concepts through a combination of university courses, self-study using YouTube videos, reading papers, and hands-on projects.

  • How did the speaker's job change when they switched teams within the research institute?

    -The speaker transitioned from working in an optical physics lab to joining the AI department, where they started working on data engineering and gained more experience with machine learning.

  • What was the speaker's experience with internship applications, and what did they learn from it?

    -The speaker faced rejections from several top ML internships but learned the importance of persistence and self-improvement. They eventually secured an offer from their favorite AI startup.

  • What is the speaker's advice for beginner ML students to avoid common mistakes?

    -The speaker suggests that beginner ML students should watch a follow-up video where they share seven common mistakes to avoid, emphasizing continuous learning and improvement.

  • What was the speaker's final decision regarding their academic and career path after completing their master's degree?

    -The speaker decided to join their favorite AI startup as a research scientist instead of pursuing a PhD, although they had an offer for a PhD position.

Outlines

00:00

🎓 Journey to Becoming an AI Research Scientist

The speaker reflects on their six-year journey in machine learning, starting as a Computer Engineering student at TU Berlin with no knowledge of AI. They describe the initial struggle with foundational courses like linear algebra and calculus, which later became crucial for understanding machine learning models. The speaker also shares their first steps into the tech industry through a student researcher role at an optical physics lab, emphasizing the importance of continuous learning and the steep learning curve of new jobs.

05:02

📚 Transitioning from Academics to Practical Machine Learning

The speaker discusses their transition into machine learning during their third year at university, where they took their first AI course, which included reinforcement learning. They recount the challenges of their bachelor thesis on deep reinforcement learning for robotics, which involved self-teaching and overcoming hardware setup difficulties. The paragraph also highlights the speaker's first publication at a top robotics conference, IROS, marking a significant milestone in their academic career.

10:03

🔬 Balancing Theory and Practice in Machine Learning

In this paragraph, the speaker delves into their fourth year, focusing on machine learning courses and projects. They mention taking a classical machine learning course, learning about various algorithms, and gaining practical experience through coding assignments. The speaker also talks about their experience working at a research institute's AI department, where they learned data engineering and gained more experience with PyTorch. They emphasize the steep learning curve and the excitement of working on new ML domains like computer vision for medical image analysis.

15:05

🚀 Pursuing Advanced Studies and Research in Machine Learning

The speaker recounts their graduate studies, where they took advanced courses in deep learning and computer vision, and worked on various projects, including one that was published but never successfully. They express a desire for a more dynamic learning environment, leading to a job change to work on graph neural networks. Despite the initial rejection, they eventually joined the ML department, where they continued to learn and grow in the field of AI.

20:08

🛠️ Overcoming Challenges and Exploring Multimodal Learning

The speaker describes their quest for a more challenging and dynamic work environment, leading to applications for internships at top tech companies and startups. They recount their experiences with interviews and the process of finding a professor for their Master's thesis in multimodal learning. The paragraph highlights the importance of persistence and the pursuit of research interests, even when facing rejections and setbacks.

25:09

🌟 Securing a Position at a Dream AI Startup

In the final paragraph, the speaker shares their decision to apply for research scientist positions despite the risk of rejection. They detail the application process for a favorite AI startup and their surprise at receiving an invitation for an interview. The speaker reflects on their growth and the importance of daily improvement, ending with the announcement of their upcoming role at the AI startup and an invitation to watch a follow-up video on common mistakes for beginner ML students.

Mindmap

Keywords

💡Machine Learning

Machine Learning (ML) is a subset of artificial intelligence that enables systems to learn from and make decisions based on data. In the video, the speaker's journey into ML began with an initial interest in computer engineering and physics, evolving into a deep dive into ML research and application. The term is central to the video's theme, as it encapsulates the speaker's academic and professional progression, from studying basic math and computer science to working as a research scientist in AI startups.

💡Research Scientist

A Research Scientist is a professional who conducts research in a specialized field, often contributing to the advancement of knowledge and technology. In the script, the speaker's goal to become a research scientist in an AI startup is a significant milestone, representing the culmination of years of study and work in ML. The role is integral to the video's narrative, illustrating the speaker's career aspirations and achievements.

💡Computer Engineering

Computer Engineering is a discipline that integrates elements of electrical engineering and computer science to design, develop, and test computer hardware and software. The speaker's initial foray into tech was through studying Computer Engineering at TU Berlin, which provided foundational knowledge in math, coding, and electrical engineering, setting the stage for their later specialization in ML.

💡Mathematics

Mathematics is the abstract science of number, quantity, and space, often used to model and solve real-world problems. In the video, the speaker emphasizes the importance of math as a fundamental skill for understanding ML concepts. Early struggles with math courses like linear algebra and calculus are mentioned, highlighting the necessity of a strong math foundation for advanced ML studies.

💡Coding

Coding, or programming, is the process of writing computer programs to perform specific tasks. The speaker's journey involved learning to code in various languages like C and Java, which is essential for implementing ML algorithms and models. Coding is a key skill in the video, illustrating the practical application of computer science knowledge in ML projects.

💡Reinforcement Learning

Reinforcement Learning (RL) is a type of ML where an agent learns to make decisions by performing actions in an environment to maximize a reward. The speaker's interest in RL began with a university course and culminated in a bachelor thesis on the topic. RL is a significant concept in the video, showcasing the speaker's early foray into a specialized area of ML.

💡Deep Learning

Deep Learning is a subset of ML that uses neural networks with many layers to learn and represent data. The speaker's introduction to deep learning was through a project on autonomous robotic navigation, which required learning about neural networks from scratch. Deep Learning is a pivotal concept in the video, marking a transition from traditional computer science to cutting-edge AI research.

💡Convolutional Neural Networks

Convolutional Neural Networks (CNNs) are a class of deep learning algorithms widely used in computer vision tasks. The speaker's first encounter with CNNs was during a project course on medical image analysis, which involved learning about this technology to detect anomalies in 3D brain images. CNNs are a key term in the video, representing the speaker's expansion into the field of computer vision.

💡Multimodal Learning

Multimodal Learning is an area of AI that involves processing and understanding data from multiple modalities, such as text, images, and video. The speaker's interest in multimodal learning was sparked by the desire to work with AI that can understand and process various types of data. This concept is central to the video's narrative, as it led the speaker to choose a professor and a research direction for their thesis.

💡Technical Papers

Technical Papers are scholarly articles that present research findings, methodologies, and results in a technical field. Throughout the video, the speaker's learning process involved reading and understanding technical papers, which is a common practice in the scientific community for staying updated and advancing knowledge. The term is used to illustrate the speaker's academic development and research contributions.

💡Internship

An Internship is a temporary job opportunity that provides practical experience in a professional setting. The speaker's attempts to secure internships at top ML companies like Amazon and DeepMind, despite facing rejections, demonstrate the competitive nature of the field and the speaker's determination to gain industry experience. The term is used in the video to highlight career development and learning opportunities.

Highlights

Six-year journey in machine learning, starting from an ML student researcher to joining a favorite AI startup as a research scientist.

Initial introduction to technology through a combination of interest in physics, math, and the practicality of engineering.

Foundation in computer engineering at TU Berlin, with early struggles in understanding the relevance of mathematical concepts.

The importance of math skills as a fundamental for later machine learning understanding and intuition.

First job as a student researcher in an optical physics lab, highlighting the initial steep learning curve and eventual plateau.

The transition from computer engineering to focusing on machine learning during the third year of university.

First exposure to AI through a course on reinforcement learning, which sparked interest in machine learning.

Bachelor thesis on deep reinforcement learning for autonomous robotic navigation, marking a significant step into deep learning.

The experience of publishing the first ML paper at a top robotics conference, IROS.

Switching to a pure computer science master's program to delve deeper into ML, facing challenges with engineering and training ML models.

The process of learning to read and understand ML papers, a skill that became essential for research.

Internal job switch within a research institute from physics lab to an AI department, highlighting the importance of persistence.

Exploration of computer vision and medical image analysis, introducing the challenges of learning new domains.

The realization of the need for continuous learning and improvement in ML, as well as the decision to pursue a PhD.

The pursuit of internships and the challenges faced in the competitive tech industry, including rejections and learning from failures.

Finding and working with a professor specializing in multimodal learning, emphasizing the importance of finding the right mentor.

Research on video moment retrieval in the field of multimodal learning, achieving state-of-the-art performance.

The decision to join a favorite AI startup as a research scientist, illustrating the culmination of years of hard work and dedication.

Reflection on the importance of daily improvement, enjoying the work, and being proud of achievements in the ML field.

Transcripts

play00:00

I've been studying machine learning for

play00:01

the past 6 years in which I worked as an

play00:04

ml student researcher for over 2 years

play00:07

and have written my first three papers

play00:09

my journey started studying Computer

play00:11

Engineering not knowing what ml was or

play00:14

even that it existed to where I am now

play00:17

soon joining my favorite AI startup as a

play00:19

research scientist in this video I'll be

play00:22

sharing my experience over these six

play00:24

years and explain what I did each year

play00:27

to get where I am now things like what

play00:30

to expect for the first few years what I

play00:33

did to get my first ml student roles and

play00:36

most importantly what you should be

play00:38

avoiding and trust me there's a

play00:44

lot okay before we get to years 1 and

play00:47

two how did I get into Tech well young

play00:50

Boris liked physics and math in high

play00:53

school and thought hm with physics you

play00:56

can't really make money so I need to do

play00:59

engineering

play01:00

I.E applied physics building a robot

play01:03

would be really cool but then I also

play01:06

need to know how to program the robot to

play01:09

make it do the stuff I wanted to do at

play01:12

that time I didn't know Ai and ml

play01:14

existed but those were my thoughts those

play01:17

led me to studying Computer Engineering

play01:19

at the TU Berlin the first two years

play01:22

were really tough of course I had to

play01:24

take the standard courses like linear

play01:27

algebra 1 Calculus 1 and two and a

play01:30

course on differential

play01:32

equations luckily I genuinely enjoy

play01:35

learning math but that doesn't mean it

play01:37

was easy for me in the beginning it all

play01:40

doesn't make much sense and you don't

play01:42

know why you are learning all these

play01:45

mathematical formulas and Abstract

play01:47

Concepts but I promise you at some point

play01:50

most of them will make sense and you

play01:52

will learn to appreciate and make use of

play01:54

them especially when learning ml the

play01:57

basics of these math skills will be the

play01:59

fundamentals you will later need for ML

play02:02

and give you an intuition for how to

play02:04

look at ml models in a mathematical

play02:07

sense but back then again I didn't even

play02:10

know AI existed I had a lot of

play02:12

electrical engineering and even some

play02:14

Physics courses those were more tough

play02:18

but I also had my first computer science

play02:20

courses and learned how to code in C yes

play02:24

in C that's right remember I was a

play02:27

computer engineering major so my program

play02:29

was designed for low-level coding and

play02:32

electrical

play02:33

engineering but I still had the standard

play02:35

courses on data structures and

play02:37

algorithms in Java and also a course on

play02:40

theoretical computer science all that is

play02:43

pretty much the standard things you

play02:45

learn when getting into computer science

play02:47

related programs some CS Theory and a

play02:50

lot of coding luckily coding is much

play02:53

easier nowadays with a cool coding

play02:55

assistance out there a tool I cannot

play02:57

live without anymore you have probably

play03:00

heard about GitHub co-pilot but what if

play03:02

you want to use a tool that has pretty

play03:04

much the same features but you could use

play03:06

it for free as an individual well that's

play03:09

where today's sponsor comes into play

play03:12

codium you can very easily install it in

play03:14

any of your favorite IDs and then simply

play03:17

hit command plus I and type in what you

play03:19

wanted to do the cool thing is it can

play03:22

not only refactor and explain existing

play03:25

code but it also uses a lot of context

play03:27

from your entire project to figure out

play03:30

how to write the most appropriate

play03:32

functions using different apis spread

play03:34

out throughout your code base it looks

play03:36

at your open tabs and even the entire

play03:39

git Repro you can even go beyond that

play03:41

and add links to other files and Repros

play03:44

to use those as context as well so to

play03:47

improve your coding efficiency use

play03:49

codium for free forever using my link in

play03:52

the description below no strings

play03:55

attached just an amazing free product

play03:58

but now let's get back to what I did

play04:00

besides normal college courses Landing

play04:03

my first student researcher job at an

play04:05

optical physics lab about 6 months into

play04:08

my first year I wanted to somehow boost

play04:11

my resume earn some money to survive

play04:13

college and also just learn more stuff I

play04:17

then saw this listing at a research

play04:19

institute directly next to my uni and

play04:21

applied it was honestly quite surprising

play04:24

that they invited me to an interview

play04:27

because I literally had not much to

play04:29

offer except basic programming skills

play04:32

but I guess for the job I was supposed

play04:34

to do it was enough I was responsible

play04:36

for running a lot of experiments with

play04:39

Optical fibers and doing measurements

play04:42

when starting a new job or project the

play04:44

learning curve will likely be very steep

play04:47

which is amazing I learned a lot but if

play04:50

you do the same measurements for over

play04:53

one and a half years the learning curve

play04:55

plateaus and the job becomes boring in

play04:59

total I stayed at this job for 3 years

play05:02

and this learning curve was completely

play05:04

flat after perhaps 8 to 9 months if not

play05:08

less and this was a big mistake I really

play05:11

should have at least changed to a

play05:12

different team at this Research

play05:14

Institute after a year but I was quite

play05:18

exhausted for these first two years I

play05:21

slept 6 hours at night didn't do much

play05:24

Sports and just worked a lot which is

play05:28

normal I don't want to PL I had a lot of

play05:31

fun in fact I am happy and proud I did

play05:34

all that but yeah all of this happened

play05:38

in my first two years of uni most

play05:40

importantly I learned the basics of math

play05:43

and computer science and worked as a

play05:45

student researcher all of which helped

play05:47

me with studying machine learning

play05:49

without even knowing ml

play05:54

existed I finally got into the third

play05:56

year semesters five and six where I

play05:59

could choose some of my courses myself

play06:02

this fifth semester is where I saw that

play06:04

AI courses existed at my uni and is

play06:07

where I chose my very first AI course

play06:11

this is where the ml Journey really

play06:13

started that said this AI course was

play06:16

split into two parts the first one was

play06:18

about old school AI not machine learning

play06:22

yes AI does not necessarily mean ml if

play06:25

you have an algorithm with a set of

play06:28

rules to make decisions it's effectively

play06:31

AI I learned about things like the

play06:34

strips method looking back it's not that

play06:37

exciting honestly but that is where I

play06:40

started and back then I thought it was

play06:43

decently cool but the second half of

play06:45

this course was really cool the second

play06:48

half was about reinforcement learning

play06:51

which in retrospect is a weird start

play06:54

into ml learning about RL before even

play06:57

knowing what a newal network was but

play06:59

maybe this is a good way to show you

play07:01

that it does not really matter how you

play07:03

start if you keep going you will learn

play07:07

all the fundamentals anyway just in a

play07:09

different order perhaps but I would

play07:12

still not recommend it if you have the

play07:14

option to choose but you know you you

play07:16

get the point anyway I learned about

play07:20

things like Bandit Theory Monte Carlo

play07:22

research marof decision processes and

play07:25

finally RL algorithms like Q learning so

play07:28

in my fifth semester 2 and a half years

play07:31

into college there was still not that

play07:33

much ml but these RL lectures really got

play07:36

me interested in ml and especially RL

play07:40

that's why I wanted to do my bachelor

play07:42

thesis in RL which is what I did in my

play07:45

sixth semester I worked on deep

play07:48

reinforcement learning for autonomous

play07:49

robotic

play07:50

navigation this was a complete cold

play07:53

start into deep learning I didn't even

play07:55

know what a new network was I had to

play07:58

learn all of that on my own through

play08:00

YouTube videos even worse in the

play08:02

beginning I struggled a lot to even get

play08:05

the hardware set up and when I reached

play08:07

out to my supervisor for help he said he

play08:10

thought I might not be ready for this

play08:12

thesis and I had two weeks to prove him

play08:14

otherwise and if I failed he would have

play08:17

to drop the thesis with me which would

play08:20

have been so bad the semester had

play08:23

already started and then I would have to

play08:25

look for a completely new one but I

play08:28

pushed through

play08:30

and made it this thesis project was a

play08:33

lot of work a lot of engineering work

play08:36

and no real training itself since the

play08:39

thesis was more on the deployment side

play08:41

of DRL agents than the training side

play08:44

nevertheless I still learned a lot of

play08:46

core coding skills like debugging and

play08:49

did get to learn pyo for the first time

play08:52

so my final Bachelor year was still a

play08:55

slow step into the world of ml but a

play08:58

very firm one one that set the path to

play09:00

going all in on ML which is why I then

play09:03

switched to a pure computer science

play09:08

master so my fourth year began and I

play09:11

went all in on ML I selected only ml

play09:14

courses and projects but this of course

play09:17

came with a lot of challenges in my

play09:20

first graduate semester I pretty much

play09:22

had one big course and one big project

play09:26

for the project I continued to work on

play09:28

the same team for autonomous robotic

play09:30

navigation that I worked with during my

play09:32

bachelor thesis the project was still

play09:34

more of an engineering effort because we

play09:36

built a benchmarking suite for

play09:38

autonomous robots which again came with

play09:41

a lot of failing and debugging but this

play09:45

time I could focus a lot more on

play09:47

training our own agents using pytorch

play09:49

and had to start reading papers to learn

play09:52

things like Po of course the beginning

play09:54

of reading papers is always a bit tough

play09:58

because you have to get used to the

play09:59

lingo but I felt so cool I felt like a

play10:03

real scientist the really cool thing was

play10:06

that later that year we actually

play10:08

published this work to one of the two

play10:11

best robotics conferences iros that was

play10:14

so huge for me it was my first ml paper

play10:17

and it was even published at a top

play10:19

conference now alongside this project I

play10:22

had my first real ml course I learned

play10:25

all the basics of classical machine

play10:26

learning for example what is supervised

play10:29

learning unsupervised learning what is

play10:32

the bias variance trade-off what are

play10:34

methods like linear regression decision

play10:37

trees support Vector machines K means

play10:40

PCA boosting and Ensemble learning and I

play10:43

learned about all the basics of new

play10:45

networks like what loss functions grade

play10:48

and descent back propagation and

play10:50

regularization are alongside each

play10:52

lecture there were of course practical

play10:55

homework assignments to implement the

play10:57

ideas we learned during the lecture and

play11:00

those were again using py do now besides

play11:03

uni I still had this boring physics lab

play11:06

job at this point I was working there

play11:08

for two to two and a half years already

play11:11

but the cool thing was the research

play11:13

institute I worked at also had an AI

play11:15

department so I wanted to internally

play11:18

switch teams I applied got an interview

play11:22

and was rejected I mean I get it I was

play11:26

just starting my first real ml course

play11:29

and had no theoretical knowledge of any

play11:31

of the ml fundamentals so I tried again

play11:35

half a year later after completing the

play11:37

ml course and having gathered more basic

play11:40

pyto experience and then actually did

play11:43

get the job what an amazing start to my

play11:46

second graduate semester my second half

play11:49

of my fourth year I started my work as

play11:51

an applied scientist student researcher

play11:54

in the ml Department I again had a steep

play11:57

learning curve and was so excited to get

play12:00

to work these first six months I started

play12:03

working on a lot of data engineering

play12:06

mainly using pandas which I have never

play12:09

used before I learned a lot there and at

play12:13

Uni I also focused on Purely practical

play12:16

learning I took two project courses I

play12:19

again continueed to work on this

play12:21

robotics project but at this point I

play12:24

felt a bit more of a fatigue working on

play12:26

the project it wasn't that exciting

play12:29

anymore but it still was a lot of work

play12:32

and my learning curve PL toed but I

play12:35

contined to work on it because I hoped

play12:37

for another paper nevertheless I started

play12:41

to look at other cool ml domains and

play12:43

took another project course a project on

play12:46

computer vision for medical image

play12:48

analysis this was my first computer

play12:51

vision project and I had to detect

play12:53

anisms in 3D images of the brain it was

play12:57

really cool but I have never dealt with

play12:59

computer vision before and had never

play13:02

learned what a convolutional new network

play13:04

was so the learning curve was again very

play13:07

steep I had to learn all of that

play13:09

knowledge Myself by watching YouTube

play13:12

videos and reading more papers in the

play13:15

end the final project was not the worst

play13:18

but also not the best either at least

play13:21

looking back at it now and I think this

play13:23

is a good thing if you are looking back

play13:26

at Old projects and think they are bad

play13:28

and and perhaps even cringing because

play13:30

you would have done things differently

play13:32

with your current knowledge then you

play13:35

have gotten

play13:36

better so yeah this year was packed with

play13:39

all the ml I could fit in most of it was

play13:43

actually working on ML projects and only

play13:45

taking one ml lecture but a really

play13:48

important one so far it was quite

play13:51

straightforward but in my next year I

play13:54

had to make some important decisions

play13:59

now uni continued as usual but

play14:02

career-wise I had to make those

play14:04

important decisions in my third graduate

play14:06

semester I again took one lecture course

play14:09

and two more projects I took my first

play14:12

actual deep learning course which had a

play14:15

decent overlap with my first ml course I

play14:18

again learned about the same

play14:20

fundamentals of new networks but now

play14:22

also had lectures on cnns recurrent new

play14:25

networks Auto encoders and a bit of

play14:29

explainable AI so nothing too crazy

play14:33

right at this point I am really into AI

play14:36

myself and I started watching paper

play14:38

review videos on YouTube and reading

play14:41

random papers on my own perhaps because

play14:44

this course didn't have too much new

play14:46

stuff and my job didn't teach me much

play14:49

theoretical content as well but anyway

play14:52

this habit of reading papers and

play14:54

learning stuff on my own are things I

play14:57

still do to this day and that I I

play14:59

genuinely enjoy so besides this deep

play15:02

learning lecture I once again worked on

play15:05

this robotics project and I have to say

play15:08

working on it this semester just wasn't

play15:11

necessary it was really not that

play15:14

interesting anymore and I really just

play15:16

wanted to learn new stuff but I was

play15:19

still hoping for a paper which in the

play15:21

end was never successfully published now

play15:25

my second project course this semester

play15:27

on the other hand was again about

play15:29

reinforcement learning but was amazing I

play15:32

had to thoroughly read a paper and

play15:34

actually reimplement it and reproduce

play15:36

its results which was a lot of fun I

play15:39

often say it and I'll say it again

play15:42

reimplementing a paper and recreating

play15:44

its results is one of my favorite

play15:46

projects to recommend I even wrote a

play15:49

blog post about it and submitted it to a

play15:51

top ml conferences blog post track but I

play15:55

didn't really know how the process

play15:57

worked back then and

play15:59

I did get my reviews but never received

play16:02

an email telling me that they were

play16:04

released so when I randomly checked I

play16:08

saw the reviews and that I never

play16:10

responded to them thus the article was

play16:13

rejected from the icr blog post track

play16:17

nevertheless the project taught me a lot

play16:20

and at this point I was pretty confident

play16:22

I wanted to become a top ml researcher

play16:26

and this goal meant for me I needed to

play16:28

strive for the best companies my job at

play16:31

that time as a student researcher was

play16:33

not completely plateauing but also not

play16:36

the best anymore we started doing

play16:38

research on graph newal networks but for

play16:41

over a year now we were still stuck with

play16:44

a lot of the same boring data

play16:47

engineering and feature engineering I

play16:49

effectively didn't really learn anything

play16:52

new that's why I wanted to find a new

play16:55

job and not make the same mistake as

play16:57

before where I stayed for three years at

play16:59

the same job so I applied to dozens of

play17:02

top ml internships and I actually got

play17:05

invited to an interview for a applied

play17:07

science internship at Amazon that was my

play17:11

first real Tech interview it was really

play17:14

exciting except that I failed miserably

play17:18

the more frustrating part was that the

play17:20

questions were really not that hard it

play17:24

was a rapid fire basic ml questions

play17:27

interview they were literally asking

play17:29

about the content of my first ml course

play17:31

I mentioned before the one I completed

play17:35

not even a year ago but well life goes

play17:39

on and I got another interview at a cool

play17:41

startup called nuro this time it was for

play17:44

an ml engineering internship and the

play17:46

first interview round was a coding

play17:48

interview again something completely new

play17:51

to me I prepared using lead code but

play17:54

when I saw a blank code in canvas and no

play17:57

pre-existing code where just just had to

play17:59

fill in an algorithm I was so scared I

play18:03

failed miserably again well the

play18:06

applications weren't going so well I

play18:08

simply didn't get many more interviews

play18:11

so I changed my Approach I directly

play18:14

reached out to a Google Deep Mind

play18:15

researcher I found interesting and asked

play18:18

for an internship and he got back to me

play18:21

we had an interview call where I felt it

play18:24

went decently well but I got rejected I

play18:29

was done with looking for internships

play18:31

and focused on finding a new job as a

play18:33

student researcher where I could also do

play18:35

my Master's thesis I decided I had

play18:38

enough of reinforcement learning and

play18:40

found computer vision really cool but

play18:43

then I thought how cool would it be if

play18:45

you could talk to an AI about images or

play18:48

even

play18:49

videos well that's where I decided

play18:52

multimodal learning was really cool but

play18:55

at my University there was a problem

play18:58

there were no professors working on

play19:00

multimode learning and pretty much all

play19:03

of the professors were how do I say it a

play19:06

bit more old school and not that much

play19:09

into the new stuff there definitely were

play19:11

one or two don't get me wrong but they

play19:14

just weren't into something really

play19:16

similar to multimod learning so I looked

play19:19

outside of my uni tiim I wanted to look

play19:22

for a professor that was a bit more

play19:24

active and ambitious I read multimode

play19:28

learning papers and looked at the

play19:30

authors I then Googled them to see if

play19:32

they could be an option as an adviser

play19:34

for my research and thesis and then I

play19:37

found the perfect Professor he was young

play19:40

was just about to start as a professor

play19:42

and before that he was a postor at UC

play19:45

Berkeley and a researcher at meta and he

play19:48

worked on multimodal learning he was

play19:50

everything I was looking for long story

play19:53

short I am so happy to have gotten the

play19:56

job and started to work with him later

play19:59

in my final year I still had my goal of

play20:01

getting to Big Tech but there are these

play20:04

nice sayings Rome wasn't built in a day

play20:07

and all roads lead to Rome I.E

play20:11

everything takes time and there are

play20:13

multiple ways to get where you want to

play20:14

get so all in all this semester besides

play20:18

this career hassle I just did a lot of

play20:22

coding at my job for the robotics

play20:25

project and for this RL paper

play20:27

reimplementation but this was still just

play20:30

the first half of my fifth year my

play20:33

second half was not that eventful since

play20:36

I failed all my applications for summer

play20:38

internships I was still doing my best to

play20:41

learn stuff at my at the time current

play20:44

job otherwise not much interesting stuff

play20:47

happening there and at Uni I really

play20:50

focused on computer vision I took a

play20:52

course on automatic image analysis and

play20:55

another seminar course on deep learning

play20:57

for computer vision where I had to read

play21:00

several papers on self-supervised

play21:01

learning and presented them to the group

play21:05

that was so much fun I just really enjoy

play21:08

reading papers I even made my

play21:10

presentation into a mini YouTube series

play21:12

on self-supervised learning but besides

play21:15

those two courses I took my second

play21:18

General deep learning course this one

play21:20

was finally a bit more advanced I

play21:24

learned about things like representation

play21:26

learning self-supervised learning

play21:28

Transformers Gans diffusion models graph

play21:32

new networks and even neural ordinary

play21:35

differential

play21:36

equations and finally I also did another

play21:40

computer vision project course where I

play21:42

wrote a paper/ techical report on so

play21:45

there was way more theoretical content

play21:48

this semester but still a practical

play21:50

project now you might have noticed that

play21:53

this semester usually should have been

play21:55

my final semester usually the Masters

play21:58

would end after 2 years but I had

play22:00

actively decided to give myself one more

play22:03

year mainly to have one semester for an

play22:05

internship and one more for my thesis so

play22:09

this semester was my last one with

play22:12

courses and since I didn't get an

play22:14

internship I had one more entire year to

play22:18

focus on doing research with my new

play22:20

professor and then completing my

play22:22

Master's

play22:23

thesis and that is what I did in my

play22:26

final year

play22:30

I was finally done with uni at least it

play22:33

felt like that because I had no more

play22:36

exams I started working as a student

play22:38

researcher with this cool professor and

play22:41

started doing research on multimodal

play22:43

learning specifically video moment

play22:46

retrieval I read a lot of papers

play22:49

developed a model that achieved new

play22:50

state-of-the-art performance on the

play22:52

benchmarks I evaluated on and wrote a

play22:55

paper on it in a very short time I even

play22:58

submitted the paper to a top conference

play23:01

and I'm telling you those were some

play23:04

stressful weeks but it still recently

play23:08

got rejected and to be honest I probably

play23:11

understand why I rushed it because we

play23:14

chose a deadline that was simply way too

play23:17

close I should have taken more time and

play23:20

just submitted it to a later conference

play23:22

so that the paper was overall more solid

play23:25

although it was annoying I will continue

play23:28

to improve this work and soon submitted

play23:30

to another conference then I remembered

play23:33

that I'm still in my final year I still

play23:36

need to actually complete my degree LOL

play23:39

that's why I'm currently still in the

play23:41

process of finishing to write my thesis

play23:43

and handing it in but since this is my

play23:46

final year I also had to think of what

play23:49

comes next I thought to myself either I

play23:53

skip the PHD and become a researcher at

play23:55

a top lab or I do my PhD D I mean How

play24:00

likely was it to skip the PHD the cool

play24:02

thing was I already had an offer from my

play24:04

professor for the PHD position and I was

play24:07

very happy to accept it nevertheless I

play24:11

still want to try out applying to two

play24:13

companies as a research scientist one

play24:16

was deep mind and although I thought my

play24:19

chances were in fact decent because I

play24:22

had exactly the combination of different

play24:24

experiences that they were looking for I

play24:27

got rejected but besides deep mind I

play24:30

applied for another really cool AI

play24:32

startup my favorite one to be precise I

play24:35

knew I wouldn't even get invited to an

play24:37

interview but one evening I was like why

play24:41

not they won't invite me

play24:43

anyway but you probably already know

play24:45

where I'm going with this they did

play24:48

invite me and I was shocked the

play24:50

application process was quite tough and

play24:53

I wanted to really give it my all and

play24:55

see if I am good enough for them and

play24:58

well long story short I did get an offer

play25:01

and will work for them starting in a few

play25:03

months at the time of this recording

play25:06

once I start my work I will announce

play25:08

which company it is don't worry I just

play25:11

want to make it cool because for me it

play25:14

is a big thing but yeah anyway

play25:18

throughout all these years there was a

play25:20

lot of struggling but also some

play25:23

occasional successes I quickly learned

play25:25

that the important thing is to keep

play25:27

moving think some people get to where I

play25:30

am now in less time and some in more but

play25:34

that doesn't matter what matters is that

play25:37

you try to improve every day by 1%

play25:40

overall enjoy what you do and that you

play25:43

are proud of what you do nevertheless

play25:46

there are many mistakes you can avoid

play25:48

and not waste any time on if you simply

play25:51

know what they are that's why you might

play25:53

want to watch this video next I there

play25:56

share seven common mistakes beginner ml

play25:58

students make every year happy learning

play26:02

and bye-bye

Rate This

5.0 / 5 (0 votes)

Etiquetas Relacionadas
Machine LearningResearch ScientistAI StartupEducationalML StudentCoding SkillsMath FundamentalsDeep LearningReinforcement LearningCareer Advice
¿Necesitas un resumen en inglés?