What does your data stack look like?
Ours is simple, easily maintainable and almost always serves the purpose.
- Snowflake for warehousing
- Kafka & Connect for replicating databases to snowflake
- Airflow for general purpose pipelines and orchestration
- Spark for distributed computing
- dbt for transformations
- Redash & Tableau for visualisation dashboards
- Rudderstack for CDP (this was initially a maintenance nightmare)
Except for Snowflake and dbt, everything is self-hosted on k8s.