Programming for Cloud Engineering: Beginner's Guide for 2024
Summary
TLDRLe script aborde la compétitivité croissante du marché technologique, en particulier dans l'espace cloud, où les rôles débutants exigent souvent des compétences en programmation. L'auteur suggère de se concentrer sur les bases de la programmation, l'utilisation des API et des services cloud. Il propose également des projets pratiques pour acquérir ces compétences, ainsi que des conseils pour approfondir ses connaissances et devenir un développeur cloud ou logiciel expérimenté.
Takeaways
- 😲 Le marché technologique est de plus en plus compétitif, en particulier dans l'espace du cloud, où des compétences supplémentaires sont souvent requises pour les postes de niveau débutant.
- 🔍 L'exigence de compétences en programmation est devenue inévitable pour les rôles d'ingénieur cloud, comme le montre l'exemple des offres d'emploi sur LinkedIn.
- 👨🏫 L'auteur suggère de se concentrer sur les langages de programmation Python et Go, en fonction de la popularité et des opportunités sur le marché local.
- 📝 Il est recommandé de commencer par apprendre les bases de la programmation, y compris les variables, les boucles, les structures de données de base, la gestion des versions et le contrôle de version.
- 📱 L'idée de projet pour les bases de la programmation consiste à développer une application console qui lit des données de film à partir d'un fichier CSV local et permet aux utilisateurs d'interagir avec ces données.
- 🌐 L'étape suivante couvre l'utilisation des API, y compris la formulation de requêtes HTTP, l'analyse de données JSON et la gestion des erreurs.
- 🔄 L'auteur insiste sur l'importance de l'apprentissage des services cloud, notamment le stockage d'objets dans le cloud, la création de services cloud avec des SDK, et l'utilisation de fonctions sans serveur.
- 🔑 Il est également important de comprendre l'utilisation de chaînes de connexion et de principaux de service pour l'authentification avec les services cloud.
- 🚀 Pour progresser, l'auteur recommande d'explorer des sujets avancés tels que la programmation orientée objet, les tests unitaires, les algorithmes de base, et l'architecture de microservices.
- 🛠️ L'extrait de code et les pratiques DevOps, notamment la mise en place de CI/CD et l'infrastructure en tant que code, sont essentiels pour les projets de cloud.
- 📈 L'auteur encourage également à se concentrer sur l'amélioration continue des compétences, en partageant des projets, en écrivant des articles de blog, en participant à des événements technologiques et en s'engageant dans des projets open source.
Q & A
Pourquoi le marché technologique est-il devenu plus compétitif que jamais ces dix dernières années?
-Le marché technologique est devenu plus compétitif en raison de l'augmentation de la demande et de l'expansion rapide des services cloud, qui ont créé une concurrence accrue pour les rôles d'ingénierie, y compris les postes de niveau entrée et associé.
Quels sont les compétences requises pour les rôles d'ingénieur cloud d'aujourd'hui?
-Les rôles d'ingénieur cloud exigent désormais des compétences en programmation, notamment en utilisant des langages comme Python, Go, Bash, JavaScript et même parfois en .NET.
Pourquoi est-il important d'apprendre à programmer pour devenir ingénieur cloud?
-La programmation est devenue une compétence clé pour les ingénieurs cloud, car elle permet de travailler avec des API, de gérer des erreurs et de créer des services cloud efficacement.
Quel est le premier langage de programmation recommandé par l'auteur pour les débutants dans le domaine cloud?
-L'auteur recommande Python ou Go pour les débutants, en fonction de la popularité et des opportunités sur le marché.
Quel projet est suggéré pour les débutants apprenant les bases de la programmation?
-Le projet suggéré est de développer une application console qui lit des données de film à partir d'un fichier CSV stocké localement et permet aux utilisateurs d'interagir avec ces données via un menu.
Quels sont les avantages de stocker son code source sur GitHub?
-Stocker son code source sur GitHub permet de gérer le contrôle de version, de faciliter la collaboration, de créer des rapports de lecture et d'appliquer les pratiques DevOps telles que le CI/CD et l'infrastructure en tant que code.
Quels sont les objectifs du projet lié aux API dans le cadre du guide pour débutants en programmation cloud?
-L'objectif est d'améliorer le projet de base en utilisant une API en ligne pour récupérer des données de films au lieu d'un fichier CSV local, en apprenant à faire des requêtes HTTP, à analyser les données JSON et à gérer les erreurs potentielles.
Quels sont les services cloud basiques que les débutants doivent apprendre?
-Les services cloud basiques incluent le stockage d'objets, la création de services cloud avec des SDKs, l'utilisation de fonctions sans serveur, l'authentification avec des chaînes de connexion et des principaux de service, et l'utilisation d'une base de données NoSQL cloud.
Quel est le projet suggéré pour les services cloud dans le guide pour débutants en programmation cloud?
-Le projet suggéré consiste à créer votre propre API qui utilise des données stockées dans une base de données NoSQL cloud et des images stockées dans le stockage cloud, avec des fonctions pour retourner des informations de film au format JSON.
Quels sont les avantages de participer à des communautés en ligne telles que le Discord Learn Cloud?
-Les communautés en ligne offrent la possibilité d'obtenir des retours d'informations, de participer à des discussions techniques, de partager ses projets et d'apprendre des pratiques professionnelles telles que les demandes de tirage (pull requests) et les revues de code.
Quels sont les sujets d'élaboration (level up) suggérés pour les personnes souhaitant approfondir leurs compétences en programmation cloud?
-Les sujets d'élaboration incluent la programmation orientée objet, les tests unitaires, les algorithmes de base, l'architecture microservices, la création d'une API RESTful complète, l'utilisation de services IA cloud pour le traitement de données, et la mise en place de stratégies de mise à l'échelle et de répartition de charge.
Quels sont les avantages de la pratique DevOps pour les projets de programmation cloud?
-La pratique DevOps permet d'intégrer des tests dans le pipeline CI/CD, de containeriser les applications, d'orchestrer les services, et d'améliorer la qualité et la fiabilité du code en suivant des processus professionnels.
Outlines
😲 Évolution des compétences requises pour les rôles de base dans le cloud
Le marché technologique est de plus en plus compétitif, en particulier dans l'espace du cloud. Les rôles d'entrée de gamme exigent désormais des compétences en programmation qui n'étaient pas nécessairement requises auparavant. L'auteur suggère de consulter LinkedIn pour observer cette tendance, en se concentrant sur les postes de 'Cloud Engineer' à New York, et souligne l'importance de la programmation dans le domaine du cloud. Il propose également des conseils pour apprendre à programmer et pour améliorer ses compétences en développement cloud ou logiciel.
📝 Projet de développement d'une application console pour la gestion de données de films
L'auteur recommande de se concentrer sur les bases de la programmation, en choisissant entre Python et Go, et de développer une application console qui lit des données de films à partir d'un fichier CSV local. Le projet consiste à créer une interface utilisateur simple qui permet de rechercher des films par nom, année de sortie ou réalisateur. Il insiste sur l'importance de la gestion de version avec Git et de l'hébergement des projets sur GitHub, avec des README et des pratiques DevOps telles que la CI/CD et l'infrastructure en tant que code.
🌐 Intégration d'API et services cloud pour le stockage et le traitement des données
Le script passe ensuite à l'utilisation d'API pour faire des requêtes HTTP, analyser des données JSON et gérer les erreurs. L'objectif est d'apprendre à travailler avec des API existantes plutôt que de créer les propres. Le projet associé consiste à améliorer l'application console en utilisant une API en ligne pour récupérer des données de films, au lieu d'un fichier CSV local. L'auteur introduit également les services cloud tels que le stockage d'objets blob ou S3, la création de services cloud avec des SDK, les fonctions sans serveur et l'utilisation d'une base de données NoSQL.
🚀 Projet d'API personnelle avec des fonctionnalités améliorées et des crédits supérieurs
L'auteur encourage à construire son propre API en utilisant les données stockées dans une base de données NoSQL et du stockage cloud pour les images. Le projet consiste à créer des fonctions qui retournent des informations sur les films au format JSON, y compris les URL des images. Il propose également des crédits supérieurs tels que la création d'une fonction pour générer un résumé de film avec l'aide d'un service AI cloud, et d'autres pratiques DevOps pour améliorer les projets, comme l'utilisation de Key Vault pour les secrets et l'intégration de tests dans les pipelines CI/CD.
🛠 Approfondissement des compétences en programmation et en architecture cloud
Le script se termine par une section sur l'approfondissement des compétences, incluant la programmation orientée objet, les tests unitaires, les algorithmes de base, l'architecture microservices et la compréhension des bases de données NoSQL et relationnelles. L'auteur insiste sur l'importance de la mise en pratique de ces compétences par le biais de projets personnels, de la participation à des groupes de discussion techniques et de la contribution à des projets open source pour acquérir une expérience professionnelle.
Mindmap
Keywords
💡Cloud engineer
💡Programmation
💡API
💡Services cloud
💡Python
💡Projet
💡GitHub
💡DevOps
💡NoSQL
💡AI
Highlights
Tech Market is more competitive than in the past decade, especially in the cloud space.
Entry-level cloud roles increasingly require programming skills that were not previously necessary.
LinkedIn job postings for Cloud Engineer roles in New York often request specific programming languages like Python.
The importance of programming in cloud engineering roles cannot be overstated.
The presenter, GPS, offers a beginner's guide to cloud programming through diagrams and videos.
For beginners, focusing on basics, APIs, and cloud services is recommended.
Python and Go are the most popular programming languages for cloud roles.
A project idea for learning basics is to develop a console application for movie data interaction.
Every project should have a GitHub repository, README, and incorporate Version Control.
Working with APIs involves making HTTP requests, parsing JSON, and error handling.
Cloud services involve using cloud storage, creating services with SDKs, and serverless functions.
The project idea for cloud services is to build an API using data from a NoSQL database and cloud storage.
Extra credit involves creating an AI-generated movie summary function in the API.
DevOps practices like CI/CD and infrastructure as code are important for cloud projects.
Leveling up includes object-oriented programming, unit testing, and understanding algorithms.
Building a full RESTful API with CRUD functionality is part of leveling up in API skills.
In cloud services, leveling up involves data transformation with AI, understanding NoSQL databases deeper, and autoscaling.
DevOps leveling up includes containerization, orchestration, and adding tests to CI/CD pipelines.
Transcripts
it's no secret that the tech Market is
more competitive than it's been in maybe
the past
decade and specifically in the cloud
space I'm seeing more entrylevel
associate level roles requiring skills
that potentially weren't required before
let's just take a look at LinkedIn jobs
to see what I'm talking about so I've
typed in Cloud engineer New York is my
area so I'm putting in New York and the
first one that comes up is this
engineering Cloud technology IES and
what instantly caught my attention is
this one's asking for donet which I
think is pretty interesting let's scroll
down and stick to the ones that say
cloud engineer so let's like click on
this one and here we are looking at yep
right here work with python right and
again I'm going to try to stick to just
the ones that say specifically Cloud
engineer and let's go to yeah let see
this is another issue with these POS
things is it's like cloud developer data
engineer when you type in Cloud engineer
but uh let's see we'll scroll we'll find
something Cloud operations engineer
maybe this one here this one is asking
for bash go JavaScript
python uh so experience with one read
and write and willingness the
willingness to learn more interesting
all right so anyway you you get my my
what I'm trying to get at is programming
programming is becoming a skill that you
just can't avoid I tell people now that
if you want to get into Cloud
engineering but you don't want to code
this is not the career for you but don't
be scared today we're going to break
down how you can actually learn the
programming skill set so you can apply
to these jobs but then I'll also give
you a couple of tips if you want to
level up your programming skills and
potentially become like a full-on cloud
developer or maybe like a softare
engineer or something like that all
right with all that being said welcome
my name is GPS I do Cloud things at
Microsoft and here on YouTube and let's
dive right into the video I love
explaining things through diagrams and I
have a bunch of cloud diagrams that you
can purchase if you'd like I've whipped
up a diagram to explain this uh
beginner's guide for cloud programming
and you can also purchase this or if you
don't want to I completely understand
you can just watch this video all the
content will be there uh for you as well
but if you do want to purchase it I 100%
thank you and I am so grateful all
thatone I put back into the channel and
it's the reason why I don't have
sponsors uh because of support for uh
that I get from all of you also members
of the channel thank you so much to all
I think I have like about 15 members now
thank you all you all have access to
diagrams for free so be sure to check
the community post and you'll have a
link there and a code there for you so
we have kind of three areas that I think
beginners should primarily focus on and
like I mentioned there's going to be a
level up to all of these areas and some
additional areas as well but let's just
focus on you know you're potentially at
this zero land here and you want to get
hired right you want to end up and being
able to start and apply for roles
totally understand that so we're going
to start in this area and we have our
Basics we have our apis and we have our
cloud services so in our Basics it's
really like the basics of programming
side note which language you should pick
honestly I think you should go between
Python and go look I love net I use it
as much as possible it's the the the
language that I learned when I was in
assist admin and it's given me a bunch
of opportunities since then but I just
see more popularity with python and go
and check your Market I potentially
you'll see some donet or some other
language then go for that maybe you'll
see Java um but python or go is seems to
be the most popular so I would pick one
of those all right I don't have really
any recommended resources for go uh but
for python if you go to learn to cloud.
guu and you go to the programming phas
there are a bunch of books that I
recommend for python back to this step
the basic step this is all your your
basic stuff with uh you know programming
variables Loops basic data structures
input output working with files Version
Control Rejects and again you don't have
to get into because because these
specific skills can get as complex as
they need to get but for this step for
the basics just highle stuff and then I
have a project idea at each step as well
so the project idea for your Basics
again getting handson is crucial is to
develop a console application that reads
movie data from a locally stored CSV so
maybe you can find a CSV online or you
can use I don't know chat gbt or Bing or
one of these AI assistants to generate a
CSV for you and then you're going to use
a menu use so users can interact with
the data so it's going to be a console
application I wouldn't Focus too much on
UI and that's sort of a different
section of software engineering you can
if you want to but I wouldn't spend too
much time on it unless you really want
to so you have a little console
application and it prints uh type one to
search movie by name type two to search
movie by release year type three to
search movie by director then the user
types in all these and then you have to
use that information to work through
your data and return the data that the
user is requesting pretty simple right
now I also have a section
here that all projects should have
absolutely need to have a GitHub repo a
GitHub readme and then obviously since
you're using GitHub and git you'll have
Version Control cicd and infrastructure
as code more Belong To The Next Step so
we'll talk a little bit more about that
later okay and then we'll talk more
about these extra credits but first in
your Basics as soon as that project is
done get hubo make sure it's got to read
me and then make sure you understand the
basics of Version Control okay awesome
also these projects build on each other
so you can plug any idea but the reason
I sort of outlined it this way is so you
can build on your skills which I think
it makes things easier to understand to
work through and the momentum helps you
like stick with things so that's why I
did it this way next we're going to work
with apis you're going to work with apis
a lot a lot so that's why I've tried to
introduce it early on so your skills
here to develop making HTTP requests
parsing Json data and then handling any
errors that you potentially could
encounter while working with these apis
so the focus here is for you to learn
how to work with apis that exist already
not necessarily create your own and the
project idea here is to improve the
project you built in the basic steps so
again you built a cons application that
works with a locally stored to CSV right
your goal for the API section is to
maybe similar functionality but instead
of working with a local CSV go and find
a movie API that's available online
there's a bunch of them and you could of
course plug in a different idea maybe
you want like music albums maybe you
want I don't know Pokemon maybe you want
like book quotes it could be whatever it
is uh but I would say try to stick with
it from here to this one and then to the
following project all right okay
third step here cloud services again I'm
trying to keep it as high level to get
just the bare minimum that you need to
start applying for these roles but
honestly every area here has endless
potential for you to do more but let's
dive into the cloud services step store
files and cloud storage so instead of
storing stuff locally be able to use
something like blob storage or
S3 uh create cloud services with
sdks uh be able to create like um these
these storage accounts that we just
mentioned with codee uh or like the next
Point here is serverless functions
create create the actual infrastructure
for your function functions with
sdks authenticate with connection
strings and service principles so what
does this mean when you're working
locally you developing maybe use vs code
or something in order to connect with
your storage account from your code or
to any kind of service you have in the
cloud you're going to need to have a
connection string or better yet a
service principle so you're going to
learn how to use that in this step here
and I would say here this final point
the basic use of a cloud nosql database
I'm not diving too deep into SQL queries
at this step because that is a whole
other discipline on its own but being
able to store information OB C text
information into a nosql database I
think is pretty crucial to learn at this
step then your project idea here we're
moving into again favorite movies or
whatever you used in the last one but
here what your goal is now you're going
to build your own API so it's going to
be based off data that you build you put
into your your nosql database you store
some data there and I would highly
recommend for each movie or maybe it's a
Pokemon or it's a book like store some
kind of image of that maybe it's the
cover of the movie maybe it's a like I
don't know some kind of poster or the
photo of a Pokemon or the photo of your
author if you're working with books
whatever it is but store an image of
that in cloud storage right and then in
your database for the item of the movie
have the
link of the the the URL of the image
that's in cloud storage as as the so
you'll have like
um like an item will be movie and then
movie image and then the value would be
the URL right and then create a function
that's get movies and that's going to
return Json on all the uh I put quotes
I'll have to update this all the movies
information into your uh returns it to
the client right and then make sure it
returns that URL for the movie cover or
again whatever you plug in here and then
get movies by year and it's going to
return again a Json list but only of
movies that were released in that year
that's provided by the client so the
client will go to your API and it'll be
like SLG get movies by year and then
it'll either either be a parameter or it
can be part of the greas string or part
of like the body depends on how you want
to work and you'll understand what this
is the more you work with these things
right now this is what I consider the
basics for this project but I do have a
little extra credit here that I think
would be crucial for you to get handson
just because of how just popular and
explosive and and uh sort of buzzwordy
AI is at the moment but I have this
extra credit section here for you so
create a function that's get movie
summary where the client will call the
get movie summary and then provide a
name of the movie or it could be an ID
however you depend you want to make
structure that but it's going to return
a summary that is generated by AI so go
find a cloud API AI API that you
can uh have it generate a mve summary
based off the title of the movie and
then other data that you could
potentially provide it and then return
that summary via urpi I think that would
be pretty neat so this is the absolute
basics from here you are pretty much in
a good position to start applying to
things and go go apply now I mentioned
devops
practices all projects again should have
these things here so you'll have repos
and at this point you'll have like three
projects in your GitHub right each one
will have a readme h Version Control and
then cicd and infrastructure as code
makes sense more so for the API project
and then the cloud services project so
keep that in mind now extra credit in
this phase here blog post Maybe you can
make a video you share to socials share
it to the learn the cloud Discord
earlier today someone asked me like hey
I have a some code I was wondering if I
could get some feedback on it and I told
them hey you have it on GitHub just you
know uh create a new branch open a PR
and then we can be able to provide
feedback there and they did that and
then I went through all their code today
and provided them feedback comments and
now they can actually go through and
work on that uh GitHub and that code in
a way that you would actually do that in
a professional setting this is actually
how the things are done in in in roles
PRS are open code reviews are done there
and changes are requested and that back
and forth but you can get this
experience now so that's why I recommend
using learn Cloud Discord there will be
a a link in the description if you go to
Tech any Tech meetups maybe display show
off your your do a lightning talk show
off your project and then maybe even
open it up for open source projects uh
maintenance potentially again this is
extra credit but definitely like I think
definitely do at least these four here
all right so now let's talk about
leveling up I personally love
programming I can have my side projects
not really depend on anybody and I've
added this level up section in case you
want to be able to kind of just build
whatever you want so in your Basics I've
added objectoriented programming
depending on the language this is
something that you might have to do uh
in that first step um but definitely
something if you want to level up you
should you should look into basic unit
testing testing your code is very very
important I was hesitant to add this at
the beginning but just because I wanted
to keep it as lean as possible in order
for you to hit the ground running and
start applying for roles I've added it
to here but honestly I think I'm
probably going to move this to extra
credit
instead basic algorithms I've been
hearing more Cloud roles asking for like
data structures and algorithms questions
so keep this in mind recursion and
microservices
architecture uh your own personal
projects you can create them with
microservices I'm more of a fan of
serverless but these are things that you
know microservices containers messaging
uh that do get asked is more so for uh
higher level roles uh I guess with more
experience or potentially even like
dabop Solus roles in terms of like
containers and orchestration but
something to keep in mind I personally
don't dabble too much in it Marshal
servus but yeah so something to keep in
mind in terms of leveling up okay next
API section build a full restful API in
the API section in the in the just the
bare minimum one I recommended to you
know create an API but there's no like
um deleting there's no adding in your
API uh there's just really just
displaying and some querying so building
a restful API will have all those crud
function uh functionality uh so I think
it's important to also have have that as
a skill there and then obviously with
building an an actual restful API an
actual in production API rate limiting
caching strategies Asing programming and
your API calls are all things that you
need to keep in mind and authentication
authorization with apis maybe you want
to make uh that people can only access
your API with a API key or something
like that this is the skill for that in
the cloud services data I added the
transform data with Cloud AI services um
just level it up here I did add it as
extra credit which we spoke through a
little bit but here's just there's tons
of other things like maybe you can have
the summary be generated like an audio
uh MP4 that people can download instead
something like that right modeling data
nosql database you're going to do a
little bit about in this in the cloud
services project uh but here diving
deeper fully understanding the
difference between stuff like when would
you use no SQL versus a like a
relational database um yeah creating
different types of data different
databases for different uh data like
different collections in your database
for your different data um and stuff
like that I think is important embedding
information
within yeah there's so much yeah you can
do here look into that autoscaling low
balancing important concepts for you to
definitely understand at all levels but
actually getting hands on with it is
like different right it's kind of hard
when you don't have traffic so
definitely share your projects again
share it in the Discord you can get some
um traffic there keyo integration saving
your passwords any secrets into an
asress called keyal I don't know what
it's called in other services or in
other platforms but all of them have it
it's just better to save it instead of
using like uh like connection strings um
in and uh like uh yeah like a local.
settings. Json file for your secrets
it's better to use something like keyo
all right and then messaging if you're
using microservices if you have
different services that need to communic
Comm unicate with each other messaging
will be something important for you to
take a look at so things like events
things like cues something to dive
deeper into I've added a datab basis
section here so understanding seal
queries select uh insert delete uh
select insert update and delete which I
mentioned in the restful API these are
things we're only we would only really
use
select yeah really just select in the
basics uh in the yeah I guess the bare
minimum version but here really diving
into all these and then understanding
data models and relationships again
diving deeper into this uh Crow
operations with code so learning how to
delete uh select insert update I guess
it should be create read update uh and
delete uh your SQL or your data with
code I think is important too and then
with databases optimizing things like
indexing and querying transactions and
concurrency concurrency control uh and
then for the database infrastructure
itself scaling and replication
strategies something to look
into and finally when it comes to the
devops area containerize your
application uh orchestration and then
you can add tests to your cicd which are
things I feel like will level up all of
your projects containerization since
you're using a serverless API isn't
necessary but maybe you turn your API
into actually yeah you have something
different for your storage and you have
something different for your API and
then you can containerize uh
orchestration is kind of hard to get
hands on unless you have like a bunch of
different services but at the minimum
for this uh leveling up containerize and
then add tests to your cicd I had
mentioned adding tests in the basics so
these tests make sure tests are actually
part of your pipeline so when you push
code they run through tests before
they're actually um merged into anything
all right and that's kind of it for this
video uh I will have again the link to
this diagram available or you can just
watch this video pause take screenshots
whatever it is it'll be in the
description and yeah let me know what
projects you're working on hopefully
this was helpful and I'll see you in the
next video
تصفح المزيد من مقاطع الفيديو ذات الصلة
Les 5 règles pour devenir Data Engineer en 2023
Progresser Dans Les Matières Littéraires (Guide Complet HGGSP Français Prépa ECG / Lycée)
Comment Gagner De L'Argent Avec Fiverr En 2024 (Pour Debutants)
Démarque-toi: 5 Compétences à ultra haut revenu
SQL pour Data Engineer - 8 Concepts que tu dois MAITRISER
Comment FILMER une INTERVIEW professionnelle
5.0 / 5 (0 votes)