Coalesce 2024: A look inside data teams managing 1,000+ dbt models
In this talk, we explore the challenges and strategies of data teams that have scaled their dbt over 1,000 models and often across multiple projects.
In this talk, we explore the challenges and strategies of data teams that have scaled their dbt over 1,000 models and often across multiple projects.
We'll dive into the types of organizations that reach this scale and the common challenges they face. From data democratization efforts to infrastructure and tooling requirements, we'll cover what it takes to effectively manage such a vast and complex dbt environment. What does their team structure look like? What type of processes do they have? What type of automation did they implement to enable efficient data operations at scale?
Whether you're just starting with dbt or looking to manage a growing number of models, this talk is to offer practical insights to help you navigate the complexities of large-scale dbt deployments.
Speaker: Rya Sciban, Head of Product, Select Star