Skip to content

Tutorials

Step-by-step guides to help you master dmp-af features and capabilities.

Getting Started Tutorials

Perfect for newcomers to dmp-af:

Basic Project

Learn the fundamentals with a single-domain project:

  • Setting up a simple dbt project with dmp-af
  • Understanding DAG structure and naming
  • Running small tests
  • Single target configuration

Time: 15 minutes | Level: Beginner

Quick Start

Get up and running with the Jaffle Shop example:

  • Docker Compose setup
  • First DAG execution
  • Verifying results

Time: 10 minutes | Level: Beginner

Intermediate Tutorials

Expand your knowledge with multi-domain setups:

Advanced Project

Build a complex multi-domain project:

  • Multiple domains (service and data mart layers)
  • Medium and large test separation
  • Different dbt targets per environment
  • Cross-domain dependencies

Time: 30 minutes | Level: Intermediate

Dependency Management

Master cross-domain and cross-schedule dependencies:

  • Configuring upstream dependencies
  • Skip policies for dependencies
  • Wait policies (last vs. all runs)
  • Cross-domain data flow

Time: 20 minutes | Level: Intermediate

Advanced Tutorials

Explore powerful features for production use:

Manual Scheduling

Control when models run:

  • @manual schedule tag
  • On-demand execution
  • Triggering from other DAGs

Time: 15 minutes | Level: Advanced

Maintenance Tasks

Keep your data warehouse clean:

  • TTL-based data deletion
  • Source freshness checks
  • Automated maintenance workflows

Time: 25 minutes | Level: Advanced

Specialized Tutorials

Integration with other systems and technologies:

Python Virtual Environments

Run dbt models with custom Python environments:

  • Creating isolated Python environments
  • Installing custom packages
  • Running Python models

Time: 20 minutes | Level: Advanced

Kubernetes Tasks

Scale dbt execution on Kubernetes:

  • Kubernetes Pod configuration
  • Resource limits and requests
  • Running models in K8s clusters

Time: 30 minutes | Level: Advanced

Integrations

Connect dmp-af with other tools:

  • Monte Carlo Data catalog integration
  • Tableau refresh tasks
  • Custom integrations

Time: 25 minutes | Level: Advanced

Tutorial Format

Each tutorial includes:

  • Prerequisites: What you need before starting
  • Learning Objectives: What you'll accomplish
  • Step-by-Step Instructions: Clear, actionable steps
  • Code Examples: Ready-to-use configurations
  • Troubleshooting: Common issues and solutions

Example Project

All tutorials use variations of the Jaffle Shop example project, modified to demonstrate dmp-af features.

The full example code is available in the examples/ directory of the repository.

Prerequisites

Before starting these tutorials, ensure you have:

  1. Completed Getting Started
  2. Working Airflow installation (local or Docker)
  3. dmp-af installed: pip install dmp-af
  4. Basic dbt knowledge (models, tests, dependencies)

Learning Path

We recommend following tutorials in this order:

graph TD
    A[Quick Start] --> B[Basic Project]
    B --> C[Advanced Project]
    C --> D[Dependency Management]
    D --> E{Choose Path}
    E --> F[Manual Scheduling]
    E --> G[Maintenance Tasks]
    E --> H[Python Venv]
    E --> I[Kubernetes]
    F --> J[Integrations]
    G --> J
    H --> J
    I --> J

Need Help?