S1 E7 | A Deep Dive into SQLMesh: Structured Query Validation and Safe Pipeline Testing with Michiel De Muynck
•
Kris Peeters & Michiel De Muynck - The Data Playbook Podcast
Michiel De Muynck explores SQLMesh: semantic layer, virtual data environments, and unit testing for SQL-based analytics.
In this episode of The Data Playbook, we take a technical look at SQLMesh, a data transformation framework designed to improve the workflow and reliability of SQL-based data pipelines. Hosted by Kris Peeters, the episode features Michiel De Muynck, Senior Data Engineer at Dataminded, who provides a deep dive into SQLMesh’s internal mechanics, including its use of semantic analysis and isolated runtime environments. Michiel outlines how SQLMesh differentiates itself from tools like dbt by incorporating a semantic parser for SQL, enabling structural validation and more precise error diagnostics during pipeline development. He also explains the implementation of virtual data environments, which allow data engineers to stage, test, and version transformations without impacting production datasets, supporting safer iteration and deployment processes.
Listen & Watch on Spotify
Listen on Apple Podcasts
Latest
The Data Challenge behind the Einstein Telescope
Tjonnie Li explains gravitational waves, the Einstein Telescope, and why the future of science depends on data engineering.
Scaling Data in Aviation: Inside Brussels Airlines’ Data Strategy
How Brussels Airlines transformed a broken data setup into scalable data products, enabling self-service and real business impact.
Machine Learning in Energy: Forecasting, MLOps, and Business Impact
Inside Luminus: how machine learning models move from experimentation to production to forecast electricity demand.
