Complex Transformations and Quality Monitoring — Data Engineering | Learn by Directing AI

Learn by Directing AI

Home/Data Engineering/Complex Transformations and Quality Monitoring

Brief 1 2 3 4 5 6 7 Materials Chat

Complex Transformations and Quality Monitoring

Units

1Meet Roberto and understand the dyeing operation
2Plan the pipeline and set up the project
3Profile the data and build the staging layer
4Build transformations with window functions and macros
5Add layered quality testing with dbt and Soda Core
6Configure CI/CD quality gates and Dagster freshness
7Governance awareness and closing

Materials Chat with Roberto Hernandez

Materials

csvbatch-data-full.csv csvbatch-data-sample.csv mdCLAUDE.md mdclaudemd-template.md ymlgithub-actions-template.yml mdpipeline-spec-template.md mdsoda-core-guide.md