Top 50+ AWS Services Explained in 10 Minutes

Fireship
28 Jun 202111:45

Summary

TLDRThis informative video script delves into Amazon Web Services (AWS), starting from its 2006 launch with three products to its current expansive suite of over 200 services. It covers a range of topics from robotics simulation with RoboMaker and IoT Core, to quantum computing with Braket. The script explains foundational services like EC2 and introduces higher-level abstractions such as Elastic Beanstalk and serverless computing with Lambda. It also explores databases, analytics, machine learning, and essential tools for developers, emphasizing ease of use and the vast capabilities of AWS in cloud computing.

Takeaways

  • πŸš€ Amazon Web Services (AWS) has expanded from three products in 2006 to over 200 services today, catering to a wide range of developer needs.
  • πŸ€– Specialized services like RoboMaker, IoT Core, and Ground Station cater to developers working on robotics, IoT devices, and satellite data connectivity.
  • πŸ§ͺ AWS Bracket offers access to quantum computing, allowing users to experiment with this emerging technology.
  • πŸ’» The foundational EC2 (Elastic Compute Cloud) service allows users to create virtual computers in the cloud with customizable specs and pay-per-second pricing.
  • πŸ”„ Elastic Load Balancing and Auto Scaling services work together to distribute traffic and scale resources based on demand, optimizing application performance and cost.
  • πŸ“¦ Elastic Beanstalk simplifies the deployment process by providing a PaaS (Platform as a Service) layer that abstracts away much of the infrastructure management.
  • 🌟 AWS Lambda introduced serverless computing, where users only pay for the compute time and requests used, without managing servers.
  • πŸ›³ AWS Outposts allows enterprises to run AWS services on their own infrastructure, integrating with existing systems without discarding legacy hardware.
  • πŸ“¦ S3 (Simple Storage Service) is the original storage offering by AWS, designed for general-purpose file storage with high durability and availability.
  • πŸ” Amazon Redshift is a data warehouse service that enables large enterprises to consolidate and analyze data from various sources.
  • πŸ€– AWS SageMaker facilitates the building, training, and deployment of machine learning models, providing managed Jupyter notebooks and GPU instances for developers.

Q & A

  • When did Amazon Web Services (AWS) initially launch and what products did it start with?

    -Amazon Web Services launched in 2006 with three products: storage buckets, compute instances, and a messaging queue.

  • How many services does AWS offer as of the video's current date, and what is the comparison made to describe the variety?

    -As of the video's current date, AWS offers over 200 services, which is compared to shopping at a big grocery store with different aisles of product categories.

  • What AWS service is mentioned for simulating and testing robots at scale?

    -RoboMaker is the AWS service mentioned for simulating and testing robots at scale.

  • How does AWS support the management of robots in people's homes?

    -AWS supports the management of robots in people's homes through IoT Core, which allows for data collection, software updates, and remote management.

  • What AWS service can be used to connect data from a satellite orbiting Earth?

    -AWS Ground Station is the service that can be used to connect data from a satellite orbiting Earth.

  • What is the name of the service that allows interaction with a quantum computer for future computing research?

    -The service that allows interaction with a quantum computer for future computing research is called Braket.

  • What is the fundamental building block of AWS for creating a virtual computer in the cloud?

    -Elastic Compute Cloud (EC2) is the fundamental building block of AWS for creating a virtual computer in the cloud.

  • What AWS service was introduced in 2009 to distribute traffic across multiple instances automatically?

    -Elastic Load Balancing was introduced in 2009 to distribute traffic across multiple instances automatically.

  • How does AWS Elastic Beanstalk simplify the deployment of applications?

    -Elastic Beanstalk simplifies deployment by providing a template-based approach where developers can deploy their code and let auto-scaling happen automatically.

  • What is the AWS service that allows serverless deployment of containerized applications?

    -AWS Fargate is the service that allows serverless deployment of containerized applications.

  • What is the first product offered by AWS for storing any type of file or object?

    -The first product offered by AWS for storing any type of file or object is Simple Storage Service (S3).

  • What AWS service is designed for building and managing relational SQL databases?

    -Amazon Relational Database Service (RDS) is designed for building and managing relational SQL databases.

  • What AWS service is mentioned for creating data lakes to store a large amount of unstructured data?

    -AWS Lake Formation is the service mentioned for creating data lakes to store a large amount of unstructured data.

  • What AWS service is used for analyzing real-time data streams?

    -Amazon Kinesis is used for analyzing real-time data streams.

  • What is the serverless product in AWS that simplifies data extraction, transformation, and loading?

    -AWS Glue is the serverless product that simplifies data extraction, transformation, and loading.

  • What AWS service is mentioned for machine learning model building and deployment?

    -Amazon SageMaker is the service mentioned for machine learning model building and deployment.

  • What AWS tool is used for managing security rules and access on an AWS account?

    -AWS Identity and Access Management (IAM) is used for managing security rules and access on an AWS account.

  • What service in AWS helps with user authentication and session management for web or mobile apps?

    -Amazon Cognito helps with user authentication and session management for web or mobile apps.

  • What AWS service can be used to send push notifications to app users?

    -Amazon Simple Notification Service (SNS) can be used to send push notifications to app users.

  • What is the AWS service for sending emails to users?

    -Amazon Simple Email Service (SES) is the service for sending emails to users.

  • How can developers provision and manage AWS services using templates?

    -Developers can use AWS CloudFormation to create templates based on their infrastructure in YAML or JSON, enabling the provisioning of multiple services with a single click.

  • What AWS service provides SDKs for connecting front-end applications to cloud infrastructure?

    -AWS Amplify provides SDKs for connecting front-end applications to cloud infrastructure.

  • What is the importance of using AWS Cost Explorer and Budgets mentioned in the video?

    -AWS Cost Explorer and Budgets are important for managing and monitoring costs associated with AWS services to avoid unexpected expenses.

Outlines

00:00

πŸš€ AWS Evolution and Advanced Services Overview

Amazon Web Services (AWS) has expanded from its initial launch in 2006 with three products to offering over 200 services today. The script discusses the complexity of AWS's service offerings, which can be daunting due to their variety and overlapping functionalities. It highlights advanced services such as RoboMaker for robot simulation, IoT Core for smart device management, Ground Station for satellite connectivity, and Braket for quantum computing experimentation. The paragraph also touches on more practical services like Elastic Compute Cloud (EC2) for virtual server deployment, Elastic Load Balancing for traffic distribution, and Auto Scaling for dynamic resource allocation. The introduction of Elastic Beanstalk and Lightsail provides easier deployment options, while Lambda represents a serverless computing approach, only charging for the exact usage.

05:01

πŸ›  AWS Compute and Storage Solutions

This paragraph delves into AWS's compute options, starting with the foundational EC2 for virtual computing needs and moving on to serverless computing with AWS Lambda. It also covers Outpost for running AWS services on-premises and Snowball devices for data transfer in remote locations. For containerization, the script mentions Elastic Container Registry and Elastic Container Service (ECS), as well as EKS for Kubernetes management and Fargate for serverless container execution. App Runner is highlighted as a simplified deployment option for containerized applications. On the storage front, AWS offers Simple Storage Service (S3) for general file storage, Glacier for archival, Elastic Block Store for high-performance needs, and Elastic File System for managed file storage solutions. The paragraph also introduces various database services, from the original SimpleDB to the scalable DynamoDB, DocumentDB, and RDS, with its proprietary SQL variant, Aurora, and serverless option.

10:01

πŸ” Exploring AWS Analytics and Machine Learning Capabilities

The script explores AWS's suite of analytics and machine learning tools, starting with data storage options like Redshift for data warehousing and Lake Formation for unstructured data lakes. It discusses real-time data processing with Kinesis and alternatives like Apache Kafka via Amazon MSK. Glue is presented as a serverless data integration service. For machine learning, the script covers AWS's offerings like SageMaker for building ML models and various APIs for image and speech recognition. It also mentions Lex for conversational AI and the DeepRacer device for learning ML through a racing car game. The paragraph concludes with a brief mention of other essential developer tools like IAM for security, Cognito for authentication, SNS for notifications, SES for emails, CloudFormation for infrastructure management, and Amplify for front-end integration.

πŸ›‘οΈ AWS Security and Cost Management

The final paragraph focuses on AWS's security and cost management tools. It starts with IAM, which allows for the creation of access control rules within an AWS account. Cognito is highlighted for its ability to manage user authentication and sessions across web and mobile apps. The script then touches on SNS for push notifications and SES for email services. CloudFormation is introduced as a way to provision infrastructure through templates, and Amplify is mentioned for connecting front-end applications to AWS services. The video concludes with a reminder of the financial implications of using AWS services and the importance of using AWS Cost Explorer and Budgets to manage expenses effectively.

Mindmap

Keywords

πŸ’‘Amazon Web Services (AWS)

AWS is a comprehensive cloud computing platform launched by Amazon in 2006. It offers a wide range of services, from computing and storage to machine learning and analytics. In the video, AWS is the central theme, as it discusses the evolution from three initial products to over 200 services, highlighting its vast array of offerings for developers and businesses.

πŸ’‘Elastic Compute Cloud (EC2)

EC2 is a foundational AWS service that allows users to create virtual computers in the cloud, choosing the operating system, memory, and computing power as needed. It is pivotal for developers looking to deploy applications, as it provides the flexibility to scale resources up or down. The script mentions EC2 as one of the original AWS products, emphasizing its importance in cloud computing.

πŸ’‘Elastic Load Balancing

This AWS service automatically distributes incoming traffic across multiple EC2 instances, ensuring that no single instance is overwhelmed and improving the fault tolerance of applications. The video script discusses Elastic Load Balancing as a solution to distribute traffic as an application grows, enhancing the scalability and reliability of web applications.

πŸ’‘Elastic Beanstalk

Elastic Beanstalk is a PaaS (Platform as a Service) offering from AWS that simplifies the deployment and scaling of web applications. It abstracts away much of the infrastructure management, allowing developers to focus on their code. The script describes Elastic Beanstalk as a service that makes deploying applications like Ruby on Rails much easier by handling the auto-scaling processes automatically.

πŸ’‘AWS Lambda

Lambda is a serverless computing service that allows developers to run code without provisioning or managing servers. It executes code in response to events and automatically scales the application. The video mentions Lambda as a way to upload code and have it run in response to specific events, with AWS handling the underlying infrastructure.

πŸ’‘Elastic Container Service (ECS)

ECS is a service that supports the deployment, management, and scaling of containerized applications using Docker containers. It simplifies the process of running containers on AWS by providing an API to start, stop, and allocate virtual machines to the containers. The script refers to ECS as a tool for running containers, highlighting its role in modern application deployment strategies.

πŸ’‘Elastic File System (EFS)

EFS is a managed service that provides a simple, scalable, and fully compatible file storage system for use with AWS cloud services. It offers high performance and is ideal for applications that require a shared file system. The video script positions EFS as a fully managed, high-performance file storage solution for applications that demand more than basic file storage capabilities.

πŸ’‘Amazon RDS

Amazon RDS is a managed database service that supports various SQL database engines, simplifying the process of setting up, operating, and scaling a relational database. It handles time-consuming tasks such as hardware provisioning, database setup, patching, and backups. The script mentions RDS as a service that supports different SQL flavors and manages database operations, making it a go-to choice for relational database needs.

πŸ’‘Amazon Aurora

Aurora is a proprietary SQL database offered by AWS that is compatible with PostgreSQL and MySQL. It provides high performance, scalability, and is designed to be cost-effective. The video script introduces Aurora as an AWS-specific SQL database option that can be operated with better performance and at a lower cost than traditional SQL databases.

πŸ’‘AWS Glue

AWS Glue is a serverless data integration service that makes it easy to discover, prepare, and combine data for analytics, machine learning, and application development. It can automatically extract, transform, and load data without requiring code. The script describes Glue as a tool that simplifies the process of working with data, allowing users to create jobs without writing source code.

πŸ’‘Amazon SageMaker

SageMaker is a fully managed service that provides developers and data scientists the ability to build, train, and deploy machine learning models quickly. It removes the heavy lifting of setting up and managing the infrastructure required for machine learning tasks. The video script highlights SageMaker as a service that simplifies the process of building and deploying machine learning models with popular frameworks like TensorFlow or PyTorch.

Highlights

Amazon Web Services (AWS) launched in 2006 with three products and has expanded to offer over 200 services.

AWS services are diverse, with some catering to niche markets like robotics simulation with RoboMaker, IoT device management with IoT Core, satellite data connectivity with Ground Station, and quantum computing with Braket.

Elastic Compute Cloud (EC2) is a foundational AWS service allowing users to create virtual computers in the cloud with customizable operating systems, memory, and computing power.

Elastic Load Balancing was introduced in 2009 to automatically distribute traffic across multiple EC2 instances.

CloudWatch collects logs and metrics from EC2 instances, which can be utilized by Auto Scaling to adjust instance numbers based on traffic and utilization.

Elastic Beanstalk, launched in 2011, simplifies deployment by providing an abstraction layer for auto-scaling and other AWS features.

For users seeking an even simpler deployment process, Lightsail offers point-and-click deployment with minimal configuration.

AWS Lambda, introduced in 2014, enables serverless computing where users only pay for the exact number of requests and computing time used.

The Serverless Application Repository allows users to deploy pre-built functions with a single click.

Outpost allows enterprises to run AWS APIs on their own infrastructure, integrating existing servers without replacement.

AWS offers various storage solutions, including S3 for general file storage, Glacier for archiving, and Elastic Block Storage for intensive data processing.

Elastic File System provides a fully managed, high-performance file storage solution at a higher cost.

AWS provides a range of database services, from SimpleDB to DynamoDB, DocumentDB, and Amazon RDS for SQL databases.

Aurora is a proprietary SQL-compatible database option that offers better performance and lower costs.

Neptune is a graph database optimized for highly connected datasets, such as social graphs or recommendation engines.

Elasticache is a fully managed in-memory database that offers extremely low-latency data delivery.

AWS Lake Formation facilitates the creation of data lakes for storing and analyzing large amounts of unstructured data.

Kinesis and Amazon MSK are services for capturing and processing real-time data streams.

AWS Glue is a serverless data integration service that simplifies the extraction, transformation, and loading of data.

SageMaker enables users to build, train, and deploy machine learning models with popular frameworks like TensorFlow or PyTorch.

AWS provides pre-built machine learning services like the Recognition API for image analysis and Lex for conversational bots.

AWS DeepRacer is an educational device that allows users to experiment with machine learning through autonomous racing.

AWS Identity and Access Management (IAM) allows users to create access rules and manage permissions within AWS accounts.

Amazon Cognito simplifies user authentication and session management for web and mobile apps.

Amazon SNS and SES are services for delivering push notifications and emails to app users, respectively.

AWS CloudFormation allows users to create and manage infrastructure templates in YAML or JSON, enabling the deployment of multiple services with a single action.

AWS Amplify provides SDKs for connecting front-end applications to AWS services from various frameworks.

AWS Cost Explorer and Budgets are tools for managing and monitoring AWS service costs to avoid unexpected expenses.

Transcripts

play00:00

amazon web services launched in 2006

play00:02

with a total of three products

play00:04

storage buckets compute instances and a

play00:06

messaging queue

play00:07

today it offers a mind-numbing 200 and

play00:10

something services

play00:11

and what's most confusing is that many

play00:13

of them appear to do almost the exact

play00:15

same thing it's kind of like shopping at

play00:16

a big grocery store where you have

play00:18

different aisles of product categories

play00:19

filled with things to buy that meet the

play00:21

needs of virtually every developer

play00:23

on the planet in today's video we'll

play00:24

walk down these aisles to gain an

play00:26

understanding of over 50 different aws

play00:29

products so first let's start with a few

play00:31

that are above my paygrade that you may

play00:33

not know exist

play00:34

if you're building robots you can use

play00:35

robomaker to simulate and test your

play00:37

robots at scale

play00:38

then once your robots are in people's

play00:40

homes you can use iot core to collect

play00:42

data from them

play00:43

update their software and manage them

play00:45

remotely if you happen to have a

play00:46

satellite orbiting earth you can tap

play00:48

into amazon's global network of antennas

play00:50

to connect data through its ground

play00:52

station service

play00:53

and if you want to start experimenting

play00:54

and researching the future of computing

play00:56

you can use bracket to

play00:57

interact with a quantum computer but

play00:59

most developers go to the cloud to solve

play01:01

more practical problems and for that

play01:03

let's head to the compute aisle one of

play01:05

the original aws products was

play01:07

elastic compute cloud it's one of the

play01:09

most fundamental building blocks on the

play01:10

platform and allows you to create a

play01:12

virtual computer in the cloud

play01:14

choose your operating system memory and

play01:16

computing power

play01:17

then you can rent that space in the

play01:18

cloud like you're renting an apartment

play01:20

that you pay for by the second a common

play01:22

use case is to use an instance as a

play01:24

server for web application

play01:26

but one problem is that as your app

play01:27

grows you'll likely need to distribute

play01:29

traffic

play01:30

across multiple instances in 2009 amazon

play01:33

introduced elastic load balancing which

play01:35

allowed developers to distribute traffic

play01:37

to multiple instances

play01:38

automatically in addition the cloudwatch

play01:41

service can collect

play01:42

logs and metrics from each individual

play01:44

instance the data collected from

play01:46

cloudwatch can then be passed off to

play01:48

auto scale

play01:48

in which you define policies that create

play01:50

new instances as they become needed

play01:52

based on the traffic and utilization of

play01:54

your current infrastructure these tools

play01:56

were revolutionary at the time

play01:58

but developers still wanted an easier

play01:59

way to get things done

play02:01

and that's where elastic bean stock

play02:02

comes in most developers in 2011 just

play02:04

wanted to deploy a ruby on rails app

play02:07

elastic beanstalk

play02:08

made that much easier by providing an

play02:09

additional layer of abstraction

play02:11

on top of ec2 and other auto scaling

play02:14

features

play02:14

choose a template deploy your code and

play02:16

let all the auto scaling stuff happen

play02:18

automatically

play02:19

this is often called a platform as a

play02:21

service but in some cases

play02:22

it's still too complicated if you don't

play02:24

care about the underlying infrastructure

play02:25

whatsoever

play02:26

and just want to deploy a wordpress site

play02:28

lightsail is an alternative option where

play02:30

you can point and click at what you want

play02:32

to deploy and worry even less about the

play02:34

underlying configuration in all these

play02:36

cases you are deploying a static server

play02:38

that is always running in the cloud

play02:40

but many computing jobs are ephemeral

play02:42

which means they don't rely

play02:43

on any persistent state on the server so

play02:45

why bother deploying a server for code

play02:47

like that

play02:48

in 2014 lambda came out which are

play02:50

functions as a service

play02:51

or serverless computing with lambda you

play02:54

simply upload your code

play02:55

then choose an event that decides when

play02:57

that code should run

play02:58

traffic scaling and networking are all

play03:00

things that happen entirely in the

play03:01

background and unlike a dedicated server

play03:04

you only pay for the exact number of

play03:05

requests and computing time that you use

play03:08

now if you don't like writing your own

play03:09

code you can use the serverless

play03:11

application repository

play03:12

to find pre-built functions that you can

play03:14

deploy with the click of a button

play03:16

but what if you're a huge enterprise

play03:17

with a bunch of its own servers outpost

play03:19

is a way to run aws apis on your own

play03:22

infrastructure without needing to throw

play03:24

your old servers in the garbage

play03:25

in other cases you may want to interact

play03:27

with aws from remote or extreme

play03:29

environments like if you're a scientist

play03:31

in the arctic snow devices are like

play03:33

little mini data centers that can work

play03:34

without internet and hostile

play03:36

environments

play03:37

so that gives us some fundamental ways

play03:38

to compute things but many apps today

play03:40

are standardized with docker containers

play03:42

allowing them to run on multiple

play03:44

different clouds or computing

play03:45

environments with very little effort

play03:47

to run a container you first need to

play03:49

create a docker image and store it

play03:51

somewhere elastic container registry

play03:53

allows you to upload an image

play03:55

allowing other tools like elastic

play03:56

container service to pull it back down

play03:59

and run it ecs is an api for starting

play04:02

stopping and allocating virtual machines

play04:04

to your containers

play04:05

and allows you to connect them to other

play04:07

products like load balancers

play04:09

some companies may want more control

play04:10

over how their app scales in which case

play04:12

eks is a tool for running kubernetes but

play04:15

in other cases you may want your

play04:16

containers to behave

play04:18

in a more automated way fargate is a

play04:20

tool that will make your containers

play04:21

behave like serverless functions

play04:23

removing the need to allocate ec2

play04:25

instances for your containers but if

play04:27

you're building an application

play04:28

and already have it containerized the

play04:30

easiest way to deploy it to aws

play04:32

is app runner this is a new product in

play04:34

2021 where you simply point it to a

play04:36

container image

play04:37

while it handles all the orchestration

play04:39

and scaling behind the scenes

play04:40

but running an application is only half

play04:42

the battle we also need to store data in

play04:45

the cloud

play04:45

simple storage service or s3 was the

play04:48

very first product offered by aws

play04:50

it can store any type of file or object

play04:52

like an image or video

play04:54

and is based on the same infrastructure

play04:56

as amazon's ecommerce site

play04:57

it's great for general purpose file

play04:59

storage but if you don't access your

play05:00

files very often

play05:01

you can archive them in glacier which

play05:03

has a higher latency but a much lower

play05:05

cost

play05:06

on the other end of the spectrum you may

play05:07

need storage that is extremely fast and

play05:09

can handle a lot of throughput

play05:11

elastic block storage is ideal for

play05:13

applications that have intensive data

play05:15

processing requirements

play05:16

but requires more manual configuration

play05:18

by the developer now if you want

play05:20

something that's highly performant and

play05:21

also fully managed

play05:22

elastic file system provides all the

play05:24

bells and whistles but at a much higher

play05:26

cost in addition to raw files

play05:28

developers also need to store structured

play05:30

data for their end users

play05:31

and that brings us to the database aisle

play05:33

which has a lot of different products to

play05:35

choose from

play05:36

the first ever database on aws was

play05:38

simpledb

play05:39

a general purpose no sql database but it

play05:42

tends to be a little too simple for most

play05:43

people

play05:44

everybody knows you never go full

play05:46

it was followed up a few years later

play05:48

with dynamodb

play05:49

which is a document database that's very

play05:51

easy to scale horizontally

play05:53

it's inexpensive and provides fast read

play05:55

performance but it isn't very good at

play05:57

modeling relational data

play05:58

if you're familiar with mongodb another

play06:00

document database option

play06:02

is documentdb it's a controversial

play06:04

option that's technically not mongodb

play06:07

that has a one-to-one mapping of the

play06:09

mongodb api

play06:10

to get around restrictive open source

play06:12

licensing speaking of which

play06:14

amazon also did a similar thing with

play06:15

elasticsearch which itself is a great

play06:18

option if you want to build something

play06:19

like a

play06:20

full text search engine but the majority

play06:22

of developers out there will

play06:23

opt for a traditional relational sql

play06:25

database

play06:26

amazon relational database service rds

play06:29

supports a variety of different sql

play06:31

flavors

play06:31

and can fully manage things like backups

play06:34

patching and scale

play06:35

but amazon also offers its own

play06:37

proprietary flavor of sql called aurora

play06:40

it's compatible with postgres or mysql

play06:43

and can be operated with better

play06:44

performance at a lower cost

play06:46

in addition aurora offers a new

play06:48

serverless option that makes it even

play06:49

easier to scale

play06:50

and you only pay for the actual time

play06:52

that the database is in use

play06:54

relational databases are a great general

play06:55

purpose option but they're not the only

play06:57

option

play06:58

neptune is a graph database that can

play07:00

achieve better performance on highly

play07:02

connected data sets

play07:03

like a social graph or recommendation

play07:05

engine if your current database is too

play07:07

slow you may want to bring in

play07:08

elastic cache which is a fully managed

play07:10

version of redis an

play07:11

in-memory database that delivers data to

play07:14

your end users with extremely low

play07:15

latency if you work with time series

play07:17

data

play07:18

like the stock market for example you

play07:20

might benefit from time stream

play07:21

a time series database with built-in

play07:24

functions for time-based queries

play07:25

and additional features for analytics

play07:27

yet another option

play07:29

is the quantum ledger database which

play07:30

allows you to build an immutable set of

play07:32

cryptographically signed transactions

play07:35

very similar to decentralized blockchain

play07:37

technology

play07:38

now let's shift gears and talk about

play07:39

analytics to analyze data you first need

play07:42

a place to store it and a popular

play07:44

option for doing that is redshift which

play07:46

is a data warehouse that tries to get

play07:48

you to shift away from oracle

play07:49

warehouses are often used by big

play07:51

enterprises to dump multiple data

play07:53

sources from the business where they can

play07:54

be analyzed together when all your data

play07:57

is in one place it's easier to generate

play07:59

meaningful analytics and run machine

play08:01

learning on it

play08:02

data in a warehouse is structured so it

play08:04

can be queried but if you need a place

play08:05

to put a large amount of unstructured

play08:07

data you can use aws

play08:09

lake formation which is a tool for

play08:11

creating data lakes or repositories that

play08:13

store a large amount of

play08:15

unstructured data which can be used in

play08:17

addition to data warehouses to query a

play08:19

larger variety of data sources

play08:21

if you want to analyze real-time data

play08:23

you can use kinesis to capture real-time

play08:25

streams from your infrastructure then

play08:27

visualize them in your favorite business

play08:29

intelligence tool

play08:30

or you can use a stream processing

play08:32

framework like apache spark

play08:33

that runs on elastic mapreduce which

play08:36

itself is a service that allows you to

play08:38

operate on massive datasets efficiently

play08:40

with a parallel distributed algorithm

play08:42

now if you don't want to use kinesis for

play08:44

streaming data a popular alternative is

play08:46

apache kafka

play08:47

it's open source and amazon msk is a

play08:50

fully managed service to get you started

play08:52

but for the average developer all this

play08:54

data processing may be a little too

play08:56

complicated

play08:56

glue is a serverless product that makes

play08:59

it much easier to extract

play09:00

transform and load your data it can

play09:02

automatically connect to other data

play09:04

sources on aws

play09:05

like aurora redshift and s3 and has a

play09:08

tool called glue studio

play09:09

so you can create jobs without having to

play09:11

write any actual source code but one of

play09:13

the biggest advantages of collecting

play09:15

massive amounts of data

play09:16

is that you can use it to help predict

play09:18

the future and aws has a bunch of tools

play09:20

in the machine learning aisle to make

play09:22

that process easier

play09:23

but first if you don't have any high

play09:25

quality data of your own

play09:26

you can use the data exchange to

play09:28

purchase and subscribe to data from

play09:30

third-party sources

play09:31

once you have some data in the cloud you

play09:33

can use sagemaker to connect to it

play09:35

and start building machine learning

play09:36

models with tensorflow or pi torch

play09:38

it operates on multiple levels to make

play09:40

machine learning easier and provides a

play09:42

managed jupyter notebook that can

play09:44

connect to a gpu instance to train a

play09:46

machine learning model then deploy it

play09:47

somewhere useful

play09:48

that's cool but building your own ml

play09:50

models from scratch is still extremely

play09:52

difficult if you need to do image

play09:54

analysis

play09:54

you may as well just use the recognition

play09:56

api it can classify all kinds of objects

play09:59

and images and is likely way better than

play10:01

anything that you would build on your

play10:02

own

play10:02

or if you want to build a conversational

play10:04

bot you might use lex which runs on the

play10:06

same technology that powers alexa

play10:08

devices

play10:09

or if you just want to have fun and

play10:10

learn how machine learning works you

play10:12

might buy a deep racer device

play10:14

which is an actual race car that you can

play10:16

drive with your own machine learning

play10:17

code

play10:18

now that's a pretty amazing way to get

play10:19

people to use your cloud platform

play10:21

but let's change direction and look at a

play10:23

few other essential tools that are used

play10:25

by a wide variety of developers

play10:27

for security we have im where you can

play10:29

create rules and determine who has

play10:31

access to what

play10:32

on your aws account if you're building a

play10:34

web or mobile app where users can log

play10:36

into an account

play10:37

cognito is a tool that enables them to

play10:39

log in with a variety of different

play10:40

authentication methods and manages the

play10:42

user sessions for you

play10:44

then once you have a few users logged

play10:45

into your app you may want to send them

play10:47

push notifications

play10:48

sns is a tool that can get that job done

play10:51

or maybe you want to send

play10:52

emails to your users ses is the tool for

play10:54

that now that you know about all these

play10:56

tools you're going to want an

play10:57

organized way to provision them cloud

play10:59

formation is a way to create templates

play11:01

based on your infrastructure

play11:03

in yaml or json allowing you to enable

play11:05

hundreds of different services with the

play11:07

single click of a button from there

play11:08

you'll likely want to interact with

play11:10

those services from a front-end

play11:11

application like ios

play11:12

android or the web amplify provides sdks

play11:15

that can connect to your infrastructure

play11:17

from

play11:17

javascript frameworks and other

play11:19

front-end applications now the final

play11:21

thing to remember

play11:21

is that all this is going to cost you a

play11:23

ton of money which goes directly to

play11:25

getting jeff's rocket up so make sure to

play11:27

use aws cost explorer and budgets if you

play11:29

don't want to pay for these big bulging

play11:31

rockets

play11:32

that's the end of the video it took a

play11:33

ton of work so please like and subscribe

play11:35

to support the channel or become a pro

play11:37

member at fireship io to get access to

play11:39

more advanced content about building

play11:41

apps in the cloud thanks for watching

play11:43

and i will see you in the next one

Rate This
β˜…
β˜…
β˜…
β˜…
β˜…

5.0 / 5 (0 votes)

Related Tags
AWS ServicesCloud ComputingDeveloper ToolsElastic ComputeServerlessData StorageDatabase OptionsMachine LearningAnalytics SolutionsCloud Security