class: title, center, middle # Why dbt? --- # Modern data stack & ETL
??? - Reliable out of the box data loader tools like Stitch and Fivetran made it easy to get data into your data platform, but the data is in a source conformed format. - MPP (massively parallel processing) data platforms such as Snowflake, Redshift, and BigQuery replaced the need for engineers to maintain data platform infrastructures. - BI tools (Looker, Mode, and others) allowed analysts and consumers to do their own deep dives into data. - The combination of these tools is what we call the modern data stack and it has created huge improvements for data teams however with great power comes great responsibility. - Problem: people only had access to the raw data Teaching notes: - flip back to traditional data team and annotate to show how it doesn't make sense anymore (cross parts out, arrow other parts around, particularly stakeholders not wanting to wait for the analysts) --- # Modern data stack: consequences - Ambiguous lineage -- - Poor documentation -- - Time-consuming, difficult updates -- - Delicate queries -- - Lack of testing -- - No collaboration ??? audience: Share your story of the silliest data problem you've had --- ### Enter: ELT & dbt .center[
] .center[_Read the [Viewpoint](https://docs.getdbt.com/docs/about/viewpoint/)_] ??? - At its core, dbt facilitates the application of software engineering best practices to analytics work - things like version control, logging, alerting, automated testing and deployment. - Enter: dbt. At its core, dbt facilitates the application of software engineering best practices to analytics work - things like version control, logging, alerting, automated testing and deployment. - Anyone who knows SQL can do this! - This role is neither data engineering nor data analysis... it's analytics engineering --- class: subtitle # Questions so far? --- # Resources * [Analytics Engineering Glossary](https://docs.getdbt.com/glossary) * [What is dbt?](https://docs.getdbt.com/docs/introduction) --- class: subtitle #Zoom Out
dbt Learn Norms
Why dbt?
--
Modeling
--
Project Design
Testing
Sources
Docs
Deployment