The DAG

Introduction

A DAG or directed acyclic graph helps you to understand the ecosystem of your data sources, extracts and transforms, and their dependencies in a single view. Think of it like a map of how the data flows through the system.

We have revamped the DAG (in November 2022) to help you manage your transforms and extracts more easily, and to help you navigate quickly around the product.

The DAG shows all the active transforms in the system, though not the extracts, and is quickly populated, however if there are hundreds of transforms this can take up to a minute to load the data.

Canvas Actions

• To move around the canvas click and hold left mouse button
• To zoom in and out use the scroll wheel on your mouse, pinch zoom on a laptop or click the zoom buttons in the top right corner
• To filter and find a specific transform click in the All jobs box

• To open the mini map click the map icon top right and drag the bounding box to quickly navigate the whole DAG

• To open a new tab click on the plus symbol at the top of the page

Nodes

Each Transform node will show you its status using colour and when it was last run. Even zoomed out, it's easy to see which Transform has failed due to it being coloured red.

Each node has various actions that can be performed on it by left or right clicking.

Left click node actions

• Click Run to execute the transform immediately
• Click Edit to jump to the SQL editor for that transform
• Click Show subgraph to isolate the transform and its upstream and downstream dependent transforms. To return to the full DAG click the X next to the filter selection.

Right click node actions

• Click Run to open a menu where you can select Run only this one, Run upstream and Run downstream
• Click Edit to jump to the SQL editor for that transform
• Click Focus to save the last place you were working in the DAG if you go out to the SQL console and back
• Click Show subgraph to isolate the transform and its upstream and downstream dependent transforms. To return to the full DAG click the X next to the filter selection.
• Click Show subgraph in a new tab to do the same, but in a new tab
• Click Delete to completely remove the transform from the system. THIS IS PERMANENT note: the object may stay on screen until the DAG is refreshed.

Feature Requests

To suggest a new feature go into Resource Center and add a suggestion.