State of Data Engineering 2024 Explore the table
DATA VERSION
INGEST DATA LAKE COMPUTE ENGINES PIPELINES PRACTITIONER APPS GOVERNANCE
CONTROL
Ingest Tech Object Storage Distributed Compute Orchestration MLOps End-to-End Data Catalog /
Governance
Google Cloud Pub/Sub
Cloud
Dataproc
Google
Cloud Storage
METADATA Data Quality /
Analytics Engines Observability Data Centric AI/ML
Metastores
Unity Catalog dstack
Azure Purview
Mosaic AI
Ingest SaaS
Apache
Data Lakehouse Impala ML/AI Observability & Monitoring
Cloud Dataproc
Vector DBs
Open Table
Formats
Reverse ETL
Notebooks Analytics Workflows
Delta Live Tables
Notebooks