Batch Processing with Apache Beam in Python

Batch Processing with Apache Beam in Python

Apache Beam is an open-source programming model for defining large scale ETL, batch and streaming data processing pipelines. It is used by companies like Google, Discord and PayPal.

In this course you will learn Apache Beam in a practical manner, with every lecture comes a full coding screencast. By the end of the course you'll be able to build your own custom batch data processing pipeline in Apache Beam.

This course includes 20 concise bite-size lectures and a real-life coding project that you can add to your Github portfolio! You're expected to follow the instructor and code along with her.

You will learn:

• How to install Apache Beam on your machine

• Basic and advanced Apache Beam concepts

• How to develop a real-world batch processing pipeline

• How to define custom transformation steps

• How to deploy your pipeline on Cloud Dataflow

This course is for all levels. You do not need any previous knowledge of Apache Beam or Cloud Dataflow.

Easy to follow, hands-on introduction to batch data processing in Python

Url: View Details

What you will learn

• Core concepts of the Apache Beam framework
• How to design a pipeline in Apache Beam
• How to install Apache Beam locally

Rating: 3.15

Level: All Levels

Duration: 1 hour

Instructor: Alexandra Abbas