Open Source Data Stack (Airflow, DBT, Airbyte, Minio, Openmetadata, PostgresSQL)

Presented by Alonso M. Donayre.
In this talk, I will teach you how to set up your environment to start building open-source data pipelines leveraging some of the best existing solutions:

- Airbyte: data extraction
- Dbt: data transformation
- Airflow: task orchestration
- PostgreSQL: data storage
- Openmetadata: data catalog
- Minio: object storage

Contents of this video:
0:00 Clone repository and initialize containers
2:05 Airflow configurations
5:18 Airbyte configurations
12:30 Airflow trigger dbt pipeline
14:56 Openmetadata configurations

The git repository:
https://github.com/alonsomedo/os-data-stack