As a Data Engineer, I collect, extract and transform raw data in order to provide clean, reliable and usable data.
📘Introduction If you're new to dbt (data build tool) and want to transform raw data into clean, analytics-ready tables using Python, you're in the right place. In this step-by-step tutorial, we’ll walk you through how to build your first Python model in dbt, step by...
📘Introduction If you're new to dbt (data build tool) and want to transform raw data into clean, analytics-ready tables — you're in the right place. In this step-by-step tutorial, we’ll walk you through how to build your first SQL model in dbt, step by step. 📌 This...
📘Introduction FastAPI is a modern, high-performance web framework for building APIs with Python. In real-world applications, you'll often need to connect to a relational database like PostgreSQL to store and retrieve data. But building that connection securely and cleanly—especially across development, staging, and production environments—requires a...
Introduction In the age of data-driven decision making, having a powerful data architecture is crucial. The Medallion Architecture is a proven data architecture pattern that helps in organizing data across different layers of refinement. When combined with dbt (data build tool), it becomes a powerful and scalable way to manage...
Introduction Keeping the data fresh in your data warehouse is crucial. In dbt (data build tool), source freshness checks help ensure that the data coming from your sources is up-to-date and trustworthy, enabling teams to confidently build reliable models downstream. This is where defining source freshness in the sources.yml...
Introduction Once you've defined sources in dbt, you can reference them using the source() function. This is essential for dbt to identify dependencies between sources and models. In this hands-on tutorial, we’ll show you how to use the source() function with a sample project. 📌 This is a...
Introduction In dbt (data build tool), sources represent raw data tables that already exist in your data warehouse - often provided by upstream systems like operational databases, APIs or other applications. Defining these sources in sources.yml is a crucial step in your data project. This tutorial will guide you...
Introduction FastAPI is a modern, fast (high-performance) web framework for building APIs with Python. When building real-world applications, you’ll often need to manage sensitive information like API keys, database URLs, or feature toggles that should vary across environments (development, testing, production). Using environment variables and Pydantic’s BaseSettings is...
Introduction Seeds in dbt are a simple and powerful way to load static data - such as reference tables, lookup data, or mapping tables - directly into your data warehouse. In this tutorial, you'll learn what seeds are and how to use them effectively. Since this topic is...