A curated list of awesome big data frameworks, ressources and other awesomeness.
-
Updated
May 7, 2024
A curated list of awesome big data frameworks, ressources and other awesomeness.
The Cloud Operational Data Store: use SQL to transform, deliver, and act on fast-changing data.
Privacy and Security focused Segment-alternative, in Golang and React
Hydra: Column-oriented Postgres. Add scalable analytics to your project in minutes.
data load tool (dlt) is an open source Python library that makes data loading easy 🛠️
2019新型冠状病毒疫情时间序列数据仓库 | COVID-19/2019-nCoV Infection Time Series Data Warehouse
The dbt-native data observability solution for data & analytics engineers. Monitor your data pipelines in minutes. Available as self-hosted or cloud service with premium features.
[NOT MAINTAINED] Light-weight Python OLAP framework for multi-dimensional data analysis
Few projects related to Data Engineering including Data Modeling, Infrastructure setup on cloud, Data Warehousing and Data Lake development.
TensorBase is a new big data warehousing with modern efforts.
Open source SQL Query Assistant service for Databases/Warehouses
Useful scripts, udfs, views, and other utilities for migration and data warehouse operations in BigQuery.
Scratch is a swiss army knife for big data.
Personal Data Engineering Projects
🔥🔥🔥 Open Source Alternative to Hightouch, Census, and RudderStack - Reverse ETL & Customer Data Platform (CDP)
Optimus is an easy-to-use, reliable, and performant workflow orchestrator for data transformation, data modeling, pipelines, and data quality management.
Data API Framework for AI Agents and Data Apps
Supercharge BigQuery with BigFunctions
DomainMOD is an open source application written in PHP & MySQL used to manage your domains and other internet assets in a central location. DomainMOD also includes a Data Warehouse framework that allows you to import your web server data so that you can view, export, and report on your live data.
One framework to develop, deploy and operate data workflows with Python and SQL.
Add a description, image, and links to the data-warehouse topic page so that developers can more easily learn about it.
To associate your repository with the data-warehouse topic, visit your repo's landing page and select "manage topics."