A practitioner's guide to federated dbt Mesh at scale with Data Project Factory
A central data team at a European parts wholesaler turned a single Terraform module into the mechanism that lets 15 domain teams provision their own governed dbt projects in minutes.
Overview
Kramp's centralized Enterprise Data Warehouse model created bottlenecks. Covers moving to a federated dbt Mesh, cutting domain provisioning from five days to one, scaling to 25+ projects with 50+ developers, and building the "Data Project Factory," an automated GitOps system for production-ready dbt environments.
What you'll take away
- 01
Data Project Factory, a Terraform module, provisions a secure, production-ready domain data product in minutes from just a team name and owner email, no Terraform knowledge required.
- 02
The results: analyst onboarding dropped from days to minutes, time-to-insight from weeks to hours, and an internal developer-experience survey scored 4.6 out of 5.
- 03
Eliminating legacy superuser access and routing confidential data out of a central landing zone closed a security gap that Kramp's earlier "shadow BI wild west" had created.
Session speaker
Trang Trinh
Kramp