dbt Seattle Meetup: Adventures scaling dbt Core
·
1 min read
In August 2023 I spoke at Seattle's dbt Meetup about my and LaunchDarkly's accumulated battle scars running dbt Core and Apache Airflow in production. I walked through our experience from:
- Not using an orchestrator at all
- Using Apache Airflow + dbt Core wrong
- A hacky middle ground
- Eventually, a containerized workflow using ECS Fargate tasks. As of May 2026, that Airflow + ECS + dbt architecture is still in use by a few teams today.
This talk was not recorded, but you can view the slides here.
Previous post: AWS Big Data Blog: How LaunchDarkly migrated to Amazon MWAA
Next post: What is this site?