S1 E7 | A Deep Dive into SQLMesh: Structured Query Validation and Safe Pipeline Testing with Michiel De Muynck
•
Kris Peeters & Michiel De Muynck - The Data Playbook Podcast
Michiel De Muynck explores SQLMesh: semantic layer, virtual data environments, and unit testing for SQL-based analytics.
In this episode of The Data Playbook, we take a technical look at SQLMesh, a data transformation framework designed to improve the workflow and reliability of SQL-based data pipelines. Hosted by Kris Peeters, the episode features Michiel De Muynck, Senior Data Engineer at Dataminded, who provides a deep dive into SQLMesh’s internal mechanics, including its use of semantic analysis and isolated runtime environments. Michiel outlines how SQLMesh differentiates itself from tools like dbt by incorporating a semantic parser for SQL, enabling structural validation and more precise error diagnostics during pipeline development. He also explains the implementation of virtual data environments, which allow data engineers to stage, test, and version transformations without impacting production datasets, supporting safer iteration and deployment processes.
Listen & Watch on Spotify
Listen on Apple Podcasts
Latest
Data Contracts and Data Products: What AI Agents Need to Access Enterprise Data
AI agents need their own access rules. Simon Harrer, Entropy Data, on data contracts, data products and purpose-based access control.
Data Mesh After the Hype: Why Data Products Matter More Than Ever
Why Data Products outlasted Data Mesh, where Data Contracts fit, and how AI is changing modern data architecture.
Why AI Agents Need Knowledge Graphs, Not Just Data
Very few companies manage 10,000 of anything. Eric Broda on scaling AI agents like data mesh scaled data products.
