Apostolos Athanasiou

7.14K subscribers

140 videos

This channel is dedicated to Data Engineering tasks, exercises and tutorials. We go through simple examples of Data Pipelines, Integration methods, APIs, Dat...

Latest Videos

Build and Register a RAG model in Databricks 🚀 Retrieve, Augment, Generate Explained

Databricks Apps + Lakebase — Build Your First Data App Today

Databricks Lakebase - Integrate OLTP database (Postgres) in your Databricks Lakehouse

Introduction to Databricks Autoloader Ιncremental ingestion at scale

Databricks AIBI Dashboards - Introduction for beginners

Databricks - Integrate AI functions in your data pipelines

dbt & databricks - Complete beginner tutorial (Data Modelling - Medallion Architecture - CICD)

How to integrate CICD and Github in your dbt project (Data Build Tool) - Deploy to devprod

Incremental Load using dbt (Data Build Tool) in Databricks

Integrate Slowly Changing Dimension (SCD2) in dbt (data build tool) with Databricks

How to add data quality checks & tests with dbt (Data Build Tool) in Databricks

Introduction to DBT with Databricks and VSCode

Introduction to Unit Test (Pytest) in CICD with GitHub workflows and Azure DevOps in Databricks

Introduction to Stored Procedures in Databricks

Introduction to Recursive CTEs (Common Table Expressions) in Databricks

Introduction to Databricks Asset Bundles with GitHub Actions and from browser in Databricks

How to install PySpark on Windows (Py4 Error solved)

Introduction to configure SQL Alerts in Databricks

How to trigger Databricks Workflows from public internet (Azure Data Factory & Python) in Databricks

Databricks - Connect to Databricks Clusters from VS Code and run Notebooks

Databricks - What to use instead of UDFs (User Defined Functions) - Pandas UDF & PySpark functions

Databricks Repos - Azure DevOps - Work with multiple branches simultaneously

Databricks & Power BI - How to refresh your Power BI dashboard from Databricks (Python)

Create Remote Connection - Foreign Catalog in Databricks

Protect Sensitive Data - Column Masking in Databricks

Databricks & Azure DevOps - Deploy your first COMPLETE Databricks Asset Bundle in 10 minutes

Introduction to schema evolution in Databricks

Introduction to Incremental Loading with & without Change Data Feed (CDF) in Databricks

Databricks & Azure - Trigger Databricks Jobs upon File Arrival - Two ways

Databricks - For Each Loop - If Else Condition