Awesome Data Engineering Overview

A curated list of data engineering tools for software developers

馃彔 Home馃敟 Feed馃摦 Subscribe鉂わ笍 Sponsor馃樅 igorbarinov/awesome-data-engineering猸 4.6K馃彿锔 Big Data

[ Daily / Weekly / Overview ]

Awesome Data Engineering

A curated list of data engineering tools for software developers Awesome

List of content

  1. Databases
  2. Ingestion
  3. File System
  4. Serialization format
  5. Stream Processing
  6. Batch Processing
  7. Charts and Dashboards
  8. Workflow
  9. Data Lake Management
  10. ELK Elastic Logstash Kibana
  11. Docker
  12. Datasets
  13. Monitoring
  14. Community

Databases

Data Ingestion

File System

Serialization format

Stream Processing

Batch Processing

Charts and Dashboards

Workflow

Data Lake Management

ELK Elastic Logstash Kibana

Docker

Datasets

Realtime

Data Dumps

Monitoring

Prometheus

Community

Forums

Conferences

Podcasts

Cheers to The Data Engineering Ecosystem: An Interactive Map

Inspired by the awesome (猸223k) list. Created by Insight Data Engineering fellows.

License

CC0

To the extent possible under law, Igor Barinov has waived all copyright and related or neighboring rights to this work.