Data Engineering
Building the pipelines, warehouses and lakehouses that feed analytics and AI.
Advanced
Once the basics are comfortable.
Document
Advanced
↗ External site
Airflow 101: Building Your First Workflow
The official Airflow tutorial on writing DAGs, tasks and schedules for data pipelines.
Apache Software Foundation
Document
Advanced
↗ External site
Apache Kafka Quickstart
Set up Kafka locally and send your first streaming events with producers and consumers.
Apache Software Foundation
Document
Advanced
↗ External site
Apache Spark: Quick Start
The official getting-started guide for Spark's interactive shell, Datasets and self-contained applications.
Apache Software Foundation