Hands-On Data Engineering in Google Cloud Platform | Python

Hands-On Data Engineering in Google Cloud Platform | Python

You are going to learn about how we can create data engineering solutions in Google Cloud Platform (GCP) using different available tools, mainly using Python as our core programming language. We will start from basic introduction of what each component is mainly used for, then dive straight into demos with detailed explanation on the design choice and reasonings behind. I am confident that you will come out of the course with a better understanding on what each component could possibly do and drive data engineering solutions in your team! 

There are the list of tech stacks that we will be covering

1. Integrating with GCP

   1. Google Cloud Platform Console, Cloud SDK and Client Libraries

2. Data Storage/ Messaging

   1. Google Cloud Storage, Google Pub/Sub

3. Databases

   1. Cloud SQL, BigQuery, Bigtable

4. Data Processing

   1. Cloud Functions, Cloud Dataflow, Cloud Dataproc

I have created a few specialised labs to integrate all the tools mentioned above instead of telling you what each component could do! It could help to accelerate your understanding so you can apply on your existing GCP workflow immediately. Detailed code and steps will also be shared in the video as well as self-written articles, so just sit back, relax and enjoy all the demos! 

Let's get onboard on the cloud journey now!

Non-stop hands-on videos on serverless and self-managed technology stacks within GCP for aspiring data professionals!

Url: View Details

What you will learn

• Extract and load data from local machine to Cloud Storage and Pub/Sub.
• Setup and use database such as Cloud SQL, BigQuery and Bigtable.
• Transform data using Google Cloud Functions, Dataflow and Dataproc.

Rating: 4.19231

Level: All Levels

Duration: 6 hours

Instructor: Chenming Yong