Understanding _dlt_id and _dlt_parent_id in dlt
Learn what _dlt_id and _dlt_parent_id mean in dlt, why they appear in normalized tables, and how to use them in SQL joins.
Data Engineer
As a Data Engineer, I collect, extract and transform raw data in order to provide clean, reliable and usable data.
179 posts
How dlt Loads Nested JSON into Tables in DuckDB
Learn how dlt normalizes nested JSON into parent and child tables in DuckDB using a simple students and courses example.
When to Use replace, append, or merge in a dlt Pipeline
Learn when to use replace, append, or merge in a dlt pipeline with practical DuckDB examples and beginner-friendly explanations.
How to Load JSON Data into DuckDB using dlt
Learn how to load a local JSON file into DuckDB with dlt, inspect the result with SQL, and understand a simple data pipeline pattern.
PySpark Structured Streaming Explained for Beginners: Build a Real-Time Data Pipeline
Learn PySpark Structured Streaming step by step by building a beginner-friendly real-time data pipeline with JSON files, readStream, writeStream, output modes, triggers, and checkpoints.
FastAPI vs Flask: Choosing the Right Python API Framework for Serving Your AI Agent
Compare FastAPI and Flask for serving AI agents, ML APIs, LLM backends, and production-ready Python services.
How to Load CSV Data into DuckDB using dlt
Learn how to load a local CSV file into DuckDB with dlt, inspect the result with SQL, and understand the basic pipeline pattern.
dbt Snapshots Explained: Track Historical Changes in Your Data Warehouse
Learn what dbt snapshots are, why they matter, and how to track historical changes in your data warehouse with a beginner-friendly customer status example.
dbt Exposures Explained for Beginners: Connect Models to Dashboards, Reports, and ML Models
Learn what dbt exposures are, why they matter, and how to connect dbt models to dashboards, reports, notebooks, and machine learning workflows.