Databricks DABs Playbook
Production-ready Declarative Automation Bundle templates — scenario-based learning, visual architectures, and copy-paste-ready code.
What’s Inside
- Visual Architectures: Diagram-first approach for every scenario.
- Production Code: Copy-paste-ready
databricks.ymland project files. - Cost Optimisation: Built-in best practices for compute configurations.
Start from zero and build your way up to advanced DAB orchestration patterns.
Module 01
01. Introduction to DABs
Set up your local environment and deploy your first Hello World Databricks Asset Bundle
Module 02
02. Job with Parameters
Define job parameters and pass dynamic values into a PySpark script at runtime
Module 03
03. Schedule a Job
Automate job execution with Quartz cron expressions and deploy notebooks as Python files
Module 04
04. File Trigger
Trigger a job automatically when a new file lands in a Unity Catalog Volume
Module 05
05. Table Update Trigger
Trigger a job automatically when a Delta Table is updated
Module 06
06. Run Multiple Tasks
Build a Directed Acyclic Graph (DAG) with parallel tasks and sequential dependencies
Module 07
07. Task Parameters
Pass dynamic values from an upstream task to multiple downstream tasks using `taskValues`
Module 08
08. Conditional Execution
Implement success and failure routing using the `run_if` parameter
Module 09
09. SQL Tasks with Variable Lookup
Execute raw SQL files on a SQL Warehouse and resolve infrastructure IDs dynamically using `lookup`
Module 10
10. SQL Alerts
Provision SQL Alerts and trigger them from a Workflow using `alert_task`
Module 11
11. Run dbt on Databricks
Orchestrate a dbt Core project natively in Databricks Workflows using the `dbt_task` type
Module 12
12. Create a Pipeline
Provision a Serverless Delta Live Tables pipeline with Bronze and Silver layers
Module 13
13. Advanced Orchestration
Build a master orchestrator that triggers a notebook, a DLT pipeline, and a child job in a single workflow
Production-grade, real-world deployment patterns.
Scenario 01
01. Automate Databricks Resource Creation
Template-driven automation for deploying Databricks resources (Jobs, Pipelines, Monitors, Dashboards)
Scenario 02
02. Enterprise Databricks Orchestration
Modular enterprise repository structure with domain-driven workflows, dynamic glob loading, and cross-job/pipeline orchestrations
