[go: up one dir, main page]
Scribd
Upload
209 views11 pages

GCP Data Engineering Cheet Sheet

This document is a cheat sheet for Google Cloud Platform, outlining various data engineering components including storage options like Cloud Spanner and BigQuery, data pipelines for real-time and batch processing, and tools for data analytics and science. It also covers workflow orchestration, data governance, security measures, visualization tools, and migration services. Overall, it serves as a quick reference guide for utilizing Google Cloud services in data engineering tasks.

Uploaded by

rudra.c.76
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
209 views11 pages

GCP Data Engineering Cheet Sheet

This document is a cheat sheet for Google Cloud Platform, outlining various data engineering components including storage options like Cloud Spanner and BigQuery, data pipelines for real-time and batch processing, and tools for data analytics and science. It also covers workflow orchestration, data governance, security measures, visualization tools, and migration services. Overall, it serves as a quick reference guide for utilizing Google Cloud services in data engineering tasks.

Uploaded by

rudra.c.76
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 11

Data

Engineering
Google Cloud Platform Cheat Sheet
Storage

Data
Relational Non-relational Data Lake
Warehouse

Cloud Spanner Bigtable BigQuery

Cloud SQL Firestore Filestore

Memorystore Cloud Storage

Datastore
Data Pipeline

Realtime Batch ETL ELT

IoT Core Cloud Storage Data Fusion


Ingest

Pub/Sub Dataproc

Transform
Datastream Composer

Dataflow BigQuery

Dataprep
Data Analytics

Descriptive Predictive

BigQuery

Dataproc Cloud AI

Dataflow Recommendation AI

Data Studio

Datalab
Data Science

Machine Learning Natural Language Computer Vision


Development Processing

AutoML
Translation API
Translation

Cloud Inference Video Intelligence


AutoML Cloud Vision
API API

AutoML Natural Natural Language


Language API

AutoML Video
Vertex AI Document AI AutoML Vision
Intelligence

Speech-to-Text Text-to-Speech
Workflow Orchestration

Cloud Run Cloud Composer Workflows


Data Governance

Data Quality Metadata


Data Archival Data Discovery
Management Management

Dataplex Cloud Storage Data Catalog


Data Security

Classification Access Control Encryption

Data Loss Prevention API Cloud IAM Cloud Key Management


Data Visualization

Data Studio Looker


Data Migration

Database Migration Storage Migration

Storage Transfer BigQuery Transfer


Service Service

Database Migration
Service
Cloud Data Transfer
Thank you!
Deepak Bhardwaj
Follow for more tips and insights

You might also like