📘 Introduction In the age of data-driven decision making, a well-structured and scalable data architecture is essential. The Medallion Architecture is a proven framework that organizes data into multiple layers of refinement — ensuring clarity, governance, and trust as data flows from raw ingestion to business-ready insights. When combined with Databricks and...
Introduction In this tutorial, we will explain step-by-step how o read an Excel file into a PySpark DataFrame in Databricks. Configure Cluster First, install on a Databricks cluster the spark-excel library (also referred as com.crealytics.spark.excel). To do this, select your Databricks cluster in the "Compute"...
Introduction In this tutorial, we want to explain the characteristics of a Data Lakehouse. In order to do this, we will take a closer look at the key features of Data Lakes and Data Warehouses and how a Data Lakehouse combines the best of both worlds. Definition At its core,...