Data Engineering

Data Engineering

88 posts
Set up Medallion Architecture in Databricks: From Raw Data to Gold Standard
Academy Membership DatabricksData Engineering

Set up Medallion Architecture in Databricks: From Raw Data to Gold Standard

📘 Introduction In the age of data-driven decision making, a well-structured and scalable data architecture is essential. The Medallion Architecture is a proven framework that organizes data into multiple layers of refinement — ensuring clarity, governance, and trust as data flows from raw ingestion to business-ready insights. When combined with Databricks and...

How to Serve a React App with FastAPI Using Static Files
Academy Membership PythonFastAPI

How to Serve a React App with FastAPI Using Static Files

📘 Introduction FastAPI is a powerful Python framework for building APIs that is both fast and modern. But sometimes you want more than just an API—you also want a user-friendly interface. Instead of running React and FastAPI on two separate servers, you can bundle your React frontend inside FastAPI and...

Scheduling dbt models with Dagster: A Step-by-Step Guide
Academy Membership Dagsterdbt

Scheduling dbt models with Dagster: A Step-by-Step Guide

📘 Introduction In this hands-on tutorial, we’ll walk step-by-step through scheduling dbt models with Dagster. By integrating Dagster, you can easily orchestrate your dbt workflows and automating model runs. ✅ Prerequisites 🐍☑️ Installed Python 📦☑️Installed Pip 🌐☑️ Created a virtual environment (venv) 🗂️☑️ A dbt project set up 🧪☑️ Existing dbt models defined in your...

Running your dbt models via Dagster UI
Academy Membership Dagsterdbt

Running your dbt models via Dagster UI

📘 Introduction In this hands-on tutorial, we’ll walk you step-by-step through running dbt models directly from the Dagster UI. By integrating dbt with Dagster, you gain an easy way to orchestrate, run, and monitor your models — all from a clean web interface. ✅ Prerequisites 🐍☑️ Installed Python 📦☑️Installed Pip 🌐☑️ Created a virtual...

Exploring your dbt models in the Dagster UI
Academy Membership Dagsterdbt

Exploring your dbt models in the Dagster UI

📘 Introduction n this hands-on tutorial, we’ll walk you step-by-step through the Dagster UI and show you where to find your dbt models, along with important details such as column descriptions, SQL code, and data lineage. ✅ Prerequisites 🐍☑️ Installed Python 📦☑️Installed Pip 🌐☑️ Created a virtual environment (venv) 🗂️☑️ A dbt project set...

Defining dbt models as Assets in Dagster
Academy Membership Dagsterdbt

Defining dbt models as Assets in Dagster

📘 Introduction In this hands-on tutorial, we’ll walk you step-by-step through adding your dbt models as assets to your Dagster projects. Once done, your dbt models will appear in the Dagster UI, making it easy to orchestrate, run, and monitor them. ✅ Prerequisites 🐍☑️ Installed Python 📦☑️Installed Pip 🌐☑️ Created a virtual environment...

You’ve successfully subscribed to Deep Learning Nerds | The ultimate Learning Platform for AI and Data Science
Welcome back! You’ve successfully signed in.
Great! You’ve successfully signed up.
Success! Your email is updated.
Your link has expired
Success! Check your email for magic link to sign-in.