Data Engineering Bootcamp for Analysts Cohort 1: All 18 Recorded Sessions

Session 3 - Production Python for Data Engineers

Modular Python architecture · OOP for pipelines · config-driven frameworks · logging · exception handling · retry mechanisms · environment management · secrets handling

Output: Hands-on: Build a reusable ingestion framework

Session 4 - Advanced Python Data Processing

APIs & ingestion patterns · async processing · parallel execution · file streaming · memory optimization · testing with pytest · packaging basics

Output: Hands-on: Build an API ingestion pipeline

Session 5 - PySpark Deep Dive

Spark architecture · executors & DAGs · lazy evaluation · partitioning · broadcast joins · shuffle optimization · Spark UI analysis · caching strategies

Output: Hands-on: Optimize large-scale Spark workloads

Session 6 - Delta Lake & Lakehouse Engineering

Delta internals · ACID transactions · OPTIMIZE & ZORDER · time travel · schema evolution · Change Data Feed · incremental ETL · Bronze / Silver / Gold architecture

Output: Hands-on: Build a medallion architecture pipeline

Session 7 - Azure Data Engineering Stack

ADLS Gen2 · Event Hubs · Key Vault · managed identities · Integration Runtime · networking basics · Synapse vs Databricks vs Fabric

Output: Hands-on: Build a secure cloud ingestion architecture

Session 8 - Microsoft Fabric Engineering

OneLake · Lakehouse · Warehouse · Fabric Data Factory · Eventstream · Real-Time Intelligence · DirectLake · Fabric governance

Output: Hands-on: End-to-end Fabric implementation

Session 9 - dbt Core Fundamentals

Models · sources · refs() · materializations · snapshots · incremental models · tests · documentation

Output: Hands-on: Build a modular dbt transformation project

Session 10 - Advanced Analytics Engineering

Macros & Jinja · semantic layer · MetricFlow · SQLFluff · lineage · data quality frameworks · governance · reusable transformation patterns

Output: Hands-on: Enterprise dbt framework implementation

Session 11 - Apache Airflow Engineering

DAG architecture · dynamic DAGs · sensors · XCom · scheduling · monitoring · retry patterns · failure handling

Output: Hands-on: Build orchestrated ETL workflows

Session 12 - Enterprise Data Pipelines

Azure Data Factory · Fabric Pipelines · Databricks Workflows · metadata-driven pipelines · config-based orchestration · parameterization · reusable frameworks

Output: Hands-on: Build a metadata-driven orchestration framework

Session 13 - Streaming Data Engineering

Kafka fundamentals · event-driven architecture · Structured Streaming · watermarking · windowing · event-time processing · CDC streaming · Event Hub integration

Output: Hands-on: Real-time streaming pipeline

Session 14 - CI/CD & Reliability Engineering

Git branching strategies · GitHub Actions · automated testing · deployment pipelines · monitoring · freshness checks · cost optimization · incident management

Output: Hands-on: CI/CD pipeline for data engineering workloads

Session 15 - End-to-End Capstone Project

API ingestion · lakehouse architecture · PySpark transformations · dbt modeling · Airflow orchestration · CI/CD · Power BI reporting · monitoring layer

Output: Hands-on: Enterprise-grade end-to-end implementation

Session 16 - Interview Preparation & System Design

SQL interview rounds · PySpark interview questions · data modelling rounds · system design · resume transformation · LinkedIn optimization · mock interviews

Output: Hands-on: Mock interview + architecture discussion sessions