Deploying and implementing Cymbal Superstore’s cloud recommended solutions

Summary

The video highlights the responsibilities of an associate cloud engineer, focusing on deploying and implementing Google Cloud solutions. It emphasizes key services like Compute Engine, Kubernetes Engine, Cloud Functions, and Cloud SQL. The video also covers the importance of Google Cloud data solutions, network configurations, and tools like Cloud Marketplace. It uses Cymbal Superstore's eCommerce, transportation, and supply chain solutions as examples, showing how to manage resources using Google Cloud Console, command line, and infrastructure-as-code practices for efficient deployment and management.

Takeaways

• 🚀 You've successfully planned and configured cloud solutions for Cymbal Superstore's application requirements.
• 🛠 Solution deployment is critical, and as an associate cloud engineer, you're expected to implement specific compute solutions such as Compute Engine, Kubernetes Engine, Cloud Run, and Cloud Functions.
• 📊 Google Cloud provides data solutions like Spanner and BigQuery for scalable, transactional, and analytical use cases.
• 🔒 Proper implementation of software-defined networking ensures secure and accessible front-end and back-end application components.
• 🛍️ Cloud Marketplace simplifies the deployment of pre-built software stacks, reducing the need for custom builds.
• 🖥️ Infrastructure as code, with source-controlled configuration files, is a best practice for reducing human error and speeding up resource deployment.
• 📦 Cymbal Superstore's Ecommerce solution is based on Kubernetes Engine, Spanner, and external HTTPS load balancing, with BigQuery for sales data analysis.
• 🚚 The transportation management system uses Pub/Sub, Cloud Functions, and Dataflow to process sensor data and store it in Bigtable.
• 🔗 The supply chain app relies on managed instance groups in Compute Engine, with Cloud SQL for the backend and TCP internal VPC connectivity.
• 💻 You can interact with Google Cloud via the Cloud Console, command line interface (CLI), or programmatically, depending on your deployment needs.

Q & A

What are some key tasks of an associate cloud engineer in the context of solution deployment?

An associate cloud engineer is responsible for deploying and implementing compute solutions such as Compute Engine, Kubernetes Engine, Cloud Run, and Cloud Functions. They also need to understand availability, concurrency, connectivity, and access options for these services.

What are Google Cloud's data solutions used for?

Google Cloud offers data solutions that use both relational and NoSQL data structures. These solutions support transactional and analytical use cases, with some optimized for low latency and global availability.

Why is using Cloud Marketplace beneficial for setting up Compute Engine instances?

Cloud Marketplace provides pre-configured software stacks, allowing developers to quickly deploy frameworks without reinventing the wheel. This can significantly speed up the development or production setup.

What is a common DevOps practice when deploying infrastructure, and why is it important?

A common DevOps practice is deploying infrastructure using Infrastructure as Code (IaC) in a declarative way and storing configuration files in source control. This reduces human error and speeds up resource allocation.

What is Cymbal Superstore's proposed solution for their Ecommerce application?

Cymbal Superstore's Ecommerce solution is based on Google Kubernetes Engine for container management, Cloud Spanner for a globally available data store, external HTTPS load balancing for user access, and BigQuery for analyzing historical sales data.

How does the transportation management system handle sensor data in Cymbal Superstore's solution?

The transportation management system uses Pub/Sub to monitor incoming sensor data. When new messages are posted to a specific topic, a Cloud Function is triggered, which starts a Dataflow job to transform the data and save it in Bigtable.

What back-end architecture is used for the supply chain application?

The supply chain application uses managed instance groups in Compute Engine for its backend, with Cloud SQL as the back-end store. Connectivity between the Compute Engine instances and Cloud SQL is via TCP internal to the VPC, with external access provided by a regional HTTPS load balancer.

What are three ways to interact with Google Cloud to deploy services?

Three ways to interact with Google Cloud to deploy services are through the Google Cloud Console, the command line interface (CLI), and programmatically using SDKs or APIs.

What is the role of Cloud Functions in Cymbal Superstore's transportation management system?

Cloud Functions are used to deploy function code that is triggered by Pub/Sub events. The function processes sensor data messages and initiates further actions like starting a Dataflow job for data transformation.

How can you deploy a compute instance for Cymbal Superstore's development team using Google Cloud Console?

To deploy a compute instance via Google Cloud Console, you need to specify settings such as the instance name, region, zone, machine configuration, boot disk, network settings, and any persistent disks you want to attach to the virtual machine.

Outlines

00:00

🚀 Deploying Cloud Solutions for Cymbal Superstore

In this section, the speaker acknowledges the hard work put into planning and configuring cloud solutions for Cymbal Superstore. They emphasize the critical role of deploying and implementing resources to achieve the company's objectives. The role of an associate cloud engineer is highlighted, specifically their knowledge in deploying solutions like Compute Engine, Kubernetes Engine, Cloud Run, and Cloud Functions. Success depends on understanding service availability, concurrency, and access options. The speaker also discusses Google Cloud data solutions such as Spanner, BigQuery, and Cloud SQL for different use cases, alongside the importance of software-defined networking to secure applications. Infrastructure deployment using code is stressed, noting that it reduces human error and speeds up resource allocation.

05:02

⚙️ Cloud-Based Solutions for Cymbal Superstore

This section covers various cloud-based solutions proposed for Cymbal Superstore's applications. The Ecommerce solution will use Google Kubernetes Engine for container management, Spanner for globally available data storage, and external HTTPS load balancing for user access. The transportation management solution will utilize Pub/Sub, Cloud Functions, Dataflow, and Bigtable for sensor data processing. The supply chain application will use Compute Engine with managed instance groups, Cloud SQL for backend storage, and a regional HTTPS load balancer for external access. Different methods to interact with Google Cloud, such as through the Cloud Console, CLI, and programmatic interfaces, are outlined as key tools for managing cloud resources.

Keywords

💡Cloud Solutions

Cloud solutions refer to services and resources delivered over the internet, such as compute power, storage, and networking. In the context of the video, Cymbal Superstore is migrating its applications to Google Cloud, requiring the deployment of various cloud solutions to meet its business goals, such as Compute Engine, Kubernetes, and Cloud SQL.

💡Google Kubernetes Engine (GKE)

Google Kubernetes Engine (GKE) is a managed environment for deploying, managing, and scaling containerized applications using Kubernetes. The video references GKE as the solution for managing Cymbal Superstore's eCommerce application, which relies on container orchestration for scalability and reliability.

💡Compute Engine

Compute Engine is Google Cloud's Infrastructure-as-a-Service (IaaS) that provides virtual machines (VMs) to run various workloads. The video mentions using Compute Engine for Cymbal Superstore's supply chain application, highlighting how VMs are deployed and interact with Cloud SQL for backend services.

💡Cloud Functions

Cloud Functions is a serverless computing service on Google Cloud that allows developers to execute code in response to events without managing servers. The video discusses how Cymbal Superstore uses Cloud Functions to handle sensor data from its transportation management system via Pub/Sub triggers.

💡Pub/Sub

Pub/Sub (Publish-Subscribe) is a messaging service that enables event-driven architectures. In the video, Cymbal Superstore's transportation management system relies on Pub/Sub to collect sensor data, which triggers Cloud Functions to process the data and start a dataflow job for transformation.

💡BigQuery

BigQuery is a serverless, highly scalable, and cost-effective multi-cloud data warehouse designed for analytics. The video explains that Cymbal Superstore uses BigQuery to analyze historical sales data, demonstrating its role in providing insights from large datasets.

💡Spanner

Spanner is a globally distributed, horizontally scalable relational database service. The video highlights Spanner's use in Cymbal Superstore’s eCommerce platform, leveraging its low-latency, global availability to store and manage data in real time across multiple regions.

💡Cloud SQL

Cloud SQL is a fully-managed relational database service for MySQL, PostgreSQL, and SQL Server. In the video, Cloud SQL is used for Cymbal Superstore’s supply chain backend, with connectivity to Compute Engine instances via a Virtual Private Cloud (VPC) for secure internal communication.

💡Infrastructure as Code (IaC)

Infrastructure as Code (IaC) is the process of managing and provisioning computing infrastructure through machine-readable scripts or configuration files. The video emphasizes the importance of IaC in reducing human error and speeding up deployment processes, noting that Cymbal Superstore can automate resource provisioning this way.

💡Cloud Marketplace

Cloud Marketplace is a platform that offers pre-configured software solutions for deployment on Google Cloud. The video suggests using Cloud Marketplace to quickly set up frameworks for development or production environments, helping Cymbal Superstore avoid manual configurations and accelerate time to market.

Highlights

You've planned and configured cloud solutions for Cymbal Superstore's application requirements.

You're expected to implement specific compute solutions like Compute Engine, Kubernetes Engine, Cloud Run, and Cloud Functions.

Solutions you implement in Google Cloud will also require data stores, utilizing both relational and NoSQL data structures.

Google Cloud's data solutions include products optimized for transactional and analytical use cases, ensuring low latency and global availability.

Software-defined networking ensures application front-ends are accessible and back-ends are secure.

Cloud Marketplace allows you to quickly deploy specific software stacks on Compute Engine instances without reinventing the wheel.

Deploying resources via infrastructure as code reduces human error and speeds up resource allocation.

Cymbal Superstore's eCommerce solution uses Google Kubernetes Engine for container management and Spanner for data storage.

Historical sales data analysis is handled by BigQuery, Google Cloud's modern data warehouse solution.

The transportation management cloud solution utilizes Pub/Sub for incoming sensor data, triggering Cloud Functions, and transforming data with Dataflow.

Supply chain applications implement managed instance groups in Compute Engine with Cloud SQL as the back-end.

External access for the supply chain app is managed via a regional HTTPS load balancer.

Three ways to interact with Google Cloud services: Cloud Console, command line, and programmatically.

Creating a compute instance for development in Google Cloud involves specifying settings like name, region, machine configuration, and boot disk.

Deploying Cloud Functions from a local directory with a Pub/Sub trigger can be done using the Google Cloud CLI.

Transcripts

Person: Way to go!

You've planned and configured cloud solutions

for Cymbal Superstore's application requirements.

It's time to think about how you can deploy

and implement the resources needed to realize the company's goals.

You've worked hard to make sure resource entities and policies

are set up correctly for Cymbal Superstore's cloud architecture.

You've also selected cloud products for the application Cymbal Superstore

has decided to migrate to the cloud.

Solution deployment is a critical part of your role.

As an associate cloud engineer, you're expected to have the knowledge

to implement specific compute solutions,

including Compute Engine, Kubernetes Engine,

Cloud Run and Cloud Functions.

Understanding availability, concurrency,

connectivity and access options for these services

are keys to success as you deploy them to support your needs.

Solutions you implement in Google Cloud

will also require data stores.

Google Cloud's data solutions include products

that utilize relational and no SQL data structures.

There are different products that support transactional

and analytical use cases.

Some solutions are optimized for low latency and global availability.

Properly implementing software-defined

networking will ensure your application front ends are accessible,

and your application back ends are secured.

Cloud Marketplace is always a good place to go

if there's a specific software stack

you need to support on your Compute Engine instances.

With Cloud Marketplace, you don't have to reinvent the wheel

and can have a development or production framework up and running in no time.

A common dev op's practice is to deploy your infrastructure

in a declarative way,

and source control your configuration files.

Deploying resources via infrastructure as code reduces human error,

and speeds up resource allocation.

Knowing how to do this in the context of your role

as an associate cloud engineer is yet another tool you have at your disposal.

As I review, here are Cymbal Superstore's proposed solutions.

Their Ecommerce solution is based on container management

provided by Google Kubernetes Engine. Data provided by the globally available,

horizontally scalable capabilities of Spanner,

and external HTTPS load balancing for user access.

This use case also has a need for historical sales data

to be analyzed by BigQuery,

Google Cloud's modern data warehouse implementation.

The transportation management cloud solution monitors

Pub/Sub for incoming sensor data,

triggers a cloud function as new messages

are posted to a specific topic,

and starts a dataflow job to transform data

and save it into Bigtable.

Finally, the supply chain application implements

managed instance groups in Compute Engine.

The back end store for this solution is Cloud SQL.

Connectivity between the back end database

and Compute Engine instances is via TCP internal to the VPC.

For the supply chain app,

external access will be achieved via regional

HTTPS load balancer.

Three ways you can interact with Google Cloud

to work with and deploy services are via Cloud

Console, the command line, and programmatically.

Let's look at these in a little more detail.

You want to implement a compute instance for the Cymbal

Superstore development team to start developing code.

One of the ways you can do this is view the Google Cloud Console.

The screenshot shows some of the settings

you need to specify as you create this instance.

The name of the instance, the region and zone

where the instance resides, the machine configuration,

the boot disk, network settings and any other persistent disks

that you're going to attach to this virtual machine.

Cymbal Superstore's supply chain app needs this Cloud SQL back end.

Here is an example of how you would do this via the command line interface.

Notice the parameters required include the Name, Resources and Region.

Remember, you can access the CLI by loading the Google Cloud

SDK on your local machine. You can also use Cloud

Shell, a cloud based terminal with a G-Cloud CLI

already installed on it.

The transportation management system is using Cloud Functions.

Cloud Functions give you the option of deploying your function code

from the local directory where it resides.

Here is an example of the command to deploy a cloud function

with a Pub/Sub trigger from a directly on your local machine;

trans_mg_function is going to be the name of the deployed function

based on the logic in the directory.

The runtime parameter specifies the Python

interpreter you want to use as you parse the function.

The trigger topic parameter is the Pub/Sub topic you want to monitor.

The data sent to your function includes the Pub/Sub event data and metadata.