Track Awesome Data Engineering Updates Daily

A curated list of data engineering tools for software developers

馃彔 Home馃攳 Search馃敟 Feed馃摦 Subscribe鉂わ笍 Sponsor馃樅 igorbarinov/awesome-data-engineering猸 5.8K馃彿锔 Big Data

[ Daily / Weekly / Overview ]

Apr 09, 2024

Data Comparison

Mar 27, 2024

Testing / Data Profiler

Mar 26, 2024

Data Ingestion

Mar 18, 2024

Data Lake Management

Community / Podcasts

Feb 29, 2024

Workflow

Feb 21, 2024

Workflow

Feb 06, 2024

Profiling / Data Profiler

Jan 29, 2024

Workflow

Jan 13, 2024

Data Ingestion

Dec 08, 2023

Workflow

Dec 01, 2023

Databases

Data Ingestion

File System

Serialization format

Stream Processing

Batch Processing

Charts and Dashboards

Workflow

Data Lake Management

ELK Elastic Logstash Kibana

Docker

Nov 22, 2023

Testing / Data Profiler

Feb 13, 2021

Community / Conferences

Jan 28, 2019

Datasets / Realtime

Datasets / Data Dumps

Aug 23, 2017

Community / Podcasts

Apr 12, 2017

Community / Forums

Mar 24, 2017

Datasets / Realtime

Datasets / Data Dumps

Sep 03, 2015

Datasets / Realtime

Jul 17, 2015

Monitoring / Prometheus

Jul 16, 2015

Monitoring / Prometheus