1d 8h EN / DE Max 16

Introduction to Data Engineering on Google Cloud

In this course, you learn about data engineering on Google Cloud, the roles and responsibilities of data engineers, and how those map to offerings provided by Google Cloud. You also learn about ways to address data engineering challenges.

€920,00 excl. VAT

Individual scheduling

The courses are held as dedicated group sessions. Once you've booked, we'll coordinate a date that works for your team and send invitations to all participants.

Prerequisites

  • Prior Google Cloud experience at the fundamental level using Cloud Shell and accessing products from the Google Cloud console.
  • Basic proficiency with a common query language such as SQL.
  • Experience with data modeling and ETL (extract, transform, load) activities.
  • Experience developing applications using a common programming language such as Python.

What you'll learn

  • Understand the role of a data engineer.
  • Identify data engineering tasks and core components used on
    Google Cloud.
  • Understand how to create and deploy data pipelines of varying
    patterns on Google Cloud.
  • Identify and utilize various automation techniques on Google Cloud.

Course modules
The role of a data engineer Data sources versus data sinks Data formats Storage solution options on Google Cloud Metadata management options on Google Cloud Sharing datasets using Analytics Hub
Replication and migration architecture The gcloud command-line tool Moving datasets Datastream
Extract and load architecture The bq command-line tool BigQuery Data Transfer Service BigLake
Extract, load, and transform (ELT) architecture SQL scripting and scheduling with BigQuery Dataform
Extract, transform, and load (ETL) architecture Google Cloud GUI tools for ETL data pipelines Batch data processing using Dataproc Streaming data processing options Bigtable and data pipelines
Automation patterns and options for pipelines Cloud Scheduler and Workflows Cloud Composer Cloud Run Functions Eventarc
Introduction to Data Engineering on Google Cloud