How To Do Machine Learning Research Without A PhD
Summary
TLDRThe video script discusses the roles and requirements in AI research labs like Google Brain, DeepMind, and OpenAI. It clarifies that while a PhD in machine learning is often expected for research scientists aiming for top-tier publications, it's not mandatory for software engineers who build infrastructure. Research engineers fall in between, contributing to research papers and requiring less specialized ML knowledge. The speaker encourages those interested in AI research to consider applying for roles even without a PhD, emphasizing on-the-job learning and familiarity with ML jargon.
Takeaways
- đ§âđ» There are three common roles in research labs: software engineer, research scientist, and research engineer, each with different requirements for machine learning knowledge.
- đ§ Software engineers primarily build infrastructure for research teams and typically require less machine learning knowledge, often not needing a PhD in ML.
- đŒ Software engineers might specialize in low-level systems or distributed systems, focusing on performance and scalability across data centers.
- đ Research scientists are expected to publish in top-tier conferences and usually have a PhD, as their main output is research papers.
- đŹ Research engineers sit between software engineers and researchers, contributing to research papers and often implementing novel techniques from academic papers.
- đ€ Research engineers may work closely with software engineers and researchers on ambitious projects, utilizing more resources to tackle complex problems.
- đ Not all research labs have a research engineer role; for example, Google does not, while DeepMind and OpenAI do.
- đ Having a PhD is not a prerequisite for all roles, and even software engineers can publish papers in top-tier venues.
- đ The speaker advises against pursuing a PhD solely for the purpose of working in a research lab, suggesting there are many other options available.
- đ It's recommended to take introductory courses in machine learning to familiarize oneself with the field and the specific research focus of the lab of interest.
- đŒ For those interested in AI research, applying directly to labs as a software engineer or research engineer without a PhD is encouraged, as skills can be learned on the job.
- đ The transcript emphasizes that a PhD is not always necessary for cutting-edge work in machine learning and AI research labs.
Q & A
What are the common roles found in research labs like Google Brain, DeepMind, OpenAI, and Facebook AI Research?
-The three common roles are software engineer, research scientist, and research engineer. Each role has different responsibilities and requirements for machine learning knowledge.
What is the primary responsibility of a software engineer in a research lab?
-A software engineer is mainly responsible for building infrastructure for the research team, which could be specific to a single research experiment or used by multiple teams for various research papers.
Do software engineers in research labs need to have a deep understanding of machine learning?
-Typically, the required knowledge of machine learning for software engineers is at the lower end, and they are less likely to solve complex machine learning problems during interviews.
Is a PhD in machine learning necessary for the role of a software engineer in a research lab?
-No, a PhD in machine learning is not typically required for software engineers in research labs.
What are the expectations for a research scientist in terms of academic contributions?
-A research scientist is expected to publish papers in top-tier conferences such as NeurIPS, ICML, ICLR, or other specialized venues related to their subfield.
How common is it for research scientists to have a PhD?
-About 99% of research scientists have a PhD in their chosen field or a closely related field to machine learning.
What is the role of a research engineer in a research lab?
-A research engineer sits between a software engineer and a researcher, helping with research papers, running experiments, and contributing to specific papers with novel techniques or ideas.
Do all companies have a research engineer role?
-No, some companies like Google do not have a research engineer role, while others like DeepMind or OpenAI do.
Can software engineers also act as research scientists and publish papers?
-Yes, many software engineers also engage in research activities and publish papers in top-tier venues.
What advice does the speaker give regarding pursuing a PhD solely to work in a research lab?
-The speaker advises against spending five years pursuing a PhD with the sole purpose of working in a research lab, as there are many other options available.
What should someone interested in working in a research lab do to prepare?
-The speaker recommends taking introductory courses in machine learning to familiarize oneself with the jargon and research topics of the lab they are interested in.
Outlines
đŹ Roles in AI Research Labs
The speaker discusses the varying roles within AI research labs such as Google Brain, DeepMind, OpenAI, and Facebook AI Research, emphasizing that a PhD in machine learning is not always required. They outline three common positions: the software engineer, who primarily builds infrastructure and may not need a PhD; the research scientist, who is expected to publish in top-tier conferences and typically holds a PhD; and the research engineer, who bridges the gap between the two, assisting with research and possibly contributing to papers. The video aims to clarify the misconception that a PhD is mandatory for all roles in AI research and encourages those interested to apply directly for positions such as software or research engineer roles even without a PhD.
đ Preparing for AI Research Lab Roles
In this paragraph, the speaker advises viewers to take introductory machine learning courses to familiarize themselves with the field's terminology and to gain an overview of the type of research conducted by the labs they are interested in. They mention that while having a PhD is not a prerequisite for working in a research lab, understanding the basics of machine learning is beneficial. The speaker also cautions against pursuing a PhD solely for the purpose of working in a research lab, suggesting that there are other paths available. They conclude by inviting viewers to share their thoughts and questions in the comments section.
Mindmap
Keywords
đĄResearch Lab
đĄPhD in Machine Learning
đĄSoftware Engineer
đĄInfrastructure
đĄDistributed Systems
đĄResearch Scientist
đĄPublishing Papers
đĄResearch Engineer
đĄCutting-Edge Research
đĄMachine Learning Jargon
đĄReinforcement Learning
Highlights
Working in top research labs like Google Brain, DeepMind, OpenAI, and Facebook AI Research does not always require a PhD in machine learning.
Three common roles in research labs are software engineer, research scientist, and research engineer, each with varying ML knowledge requirements.
Software engineers primarily build infrastructure for research teams, which may be specific to one experiment or used across multiple teams.
Software engineers may specialize in low-level systems programming in C++ or work on distributed systems infrastructure for scalability across data centers.
Machine learning knowledge for software engineers is typically at the lower end, with less emphasis on ML problem-solving during interviews.
A PhD in machine learning is generally not required for software engineers in research labs.
Research scientists are expected to publish papers in top-tier conferences like NeurIPS, ICML, ICLR, and are typically required to have a PhD.
Research scientists collaborate with software engineers on ambitious projects and have access to more resources for tackling complex problems.
The research engineer role sits between the software engineer and researcher, assisting with experiments, infrastructure, and contributing to research papers.
Research engineers focus on novel techniques, implementing academic papers, and may propose research ideas for publication.
Not all research labs have research engineer roles; for example, Google does not, while DeepMind and OpenAI do.
Many software engineers act as research scientists, publishing papers in top-tier venues, indicating that a PhD is not a strict requirement for publishing research.
There is no need for a PhD to work in cutting-edge machine learning and AI research; consider applying as a software or research engineer without one.
Taking introductory machine learning courses is recommended to familiarize oneself with the jargon and research of the lab to which one is applying.
Pursuing a PhD solely to work in a research lab is not recommended, as there are many other options available for gaining experience and expertise.
The big takeaway is that a PhD is not always necessary for contributing to state-of-the-art research in machine learning and AI.
Transcripts
A lot of people have asked me what it takes to work in a research lab like Google Brain, Â
DeepMind, OpenAI and Facebook AI Research. And a very common question I get is, do I need a Â
PhD in machine learning to work on cutting edge machine learning? I have news for you that is Â
maybe. So stay tuned and I'll tell you which roles require a PhD and which ones Â
don't. So let's get into it. There's three very common roles that you find in research labs, Â
and they sort of exist on a spectrum of minimal requirement for machine learning knowledge Â
to requiring very deep specialized ML knowledge.
The first most common job role exists on this end of the spectrum, and that's going to be the Â
software engineer. This software engineer is primarily concerned with building out Â
infrastructure for the rest of their research team, and this infrastructure might be specific Â
to a one research experiment for a single paper or it might be some info that's used by multiple Â
teams or even ML info that's going to be used for multiple research papers. These software engineers Â
typically need to be very strong at either low level systems if they're doing kind of low level Â
programming and C++ or doing things on like TPUs or GPUs at the kernel level.
Alternatively, you have software engineers who are more specialized in distributed systems, and Â
they're going to be building out infrastructure that can scale across a cluster of machines that Â
are available in data centers. Now, both of these software engineering roles are sort of specialized Â
in those particular domains and it's by no means easy work. But they're required knowledge of Â
machine learning typically is going to be at the lower end, and they're less likely Â
during an interview to be required to solve the kind of problems that other roles would require.
Oh, and one more thing about the software engineer is they typically don't require a PhD Â
in machine learning, so that's one role in a research lab that doesn't require a PhD. Â
Now on the flip side, on the opposite of the spectrum, you have the research scientist, Â
the research scientist has an expectation typically of publishing papers into top Â
tier conferences like NeurIPS, ICML, ICLR, or if they're specialized in some subfield like computer Â
vision or speech, they're going to want to publish in those particular conferences and those venues.
Because they're expected to publish papers and do research that is cutting edge, typically they're Â
required to have a PhD. And I'd say about 99% of research scientists have a PhD in their chosen Â
field or very close field to machine learning because their primary output is going to be Â
research papers. Many times you'll have a research scientist working with software engineers and they Â
will be building out some larger projects that is more ambitious and requires a larger team, Â
but also they have the unfair advantage of having more resources at their disposal to Â
solving maybe a much harder problem than they could if they were just one person.
And then there's a third role, which is going to be the research engineer. The research engineer Â
sort of sits in between the software engineer and the researcher. Their expectation is to help Â
with research papers. They're typically running experiments, helping out on the infrastructure Â
side, maybe applying it to a very specific problem contributing for a very specific paper. Â
And they will typically be focused on very novel techniques or reading academic papers Â
that they downloaded off of archive, or that they saw at our research conference.
And they'll take that information and try to implement some papers. And they might even Â
be proposing ideas for avenues of research in their particular like in a paper that they're Â
trying to publish with their research scientist peers. Now, some research labs don't actually Â
have research engineers. For example, at Google, there's no such thing as a research engineer role. Â
And whereas at companies like DeepMind or OpenAI, Â
that role exists and has a more clearly defined skillset. Not everyone who has a PhD Â
is a research scientist. There are many software engineers who actually on their day to day job Â
act as research scientists, and they are publishing papers in top tier venues.
So you don't need to feel like because you're not a research scientist, you can't publish. Â
So yeah, there you have it. That's a high level overview of the different kinds of roles you have Â
in state-of-the-art research labs, doing machine learning and artificial intelligence Â
research. The big takeaway is that you don't actually need a PhD to do a lot of this work. Â
In fact, if you're very interested in getting into that kind of work, strongly consider Â
applying directly to one of those labs as maybe a software engineer or a research engineer if Â
you don't have a PhD already, because you'll be able to learn many of those skills on the job.
Now, I would highly recommend still taking some introductory courses in machine learning so that Â
you're familiar with the jargon or at least have an overview of the kind of research that the lab Â
you're applying to does. For example, OpenAI does a lot of reinforcement learning type research, Â
and you should probably be familiar with that kind of a subject before you're applying. But Â
don't feel like you need to have a PhD before you do that. I would not recommend spending five Â
years of your life pursuing a PhD with the sole purpose of wanting to work in a research lab.
There are many other options available to you, and that can be the topic of the next video. Â
With that, I'd like to thank you for your time and let me know below in the comments anything Â
5.0 / 5 (0 votes)