Skip to content

Commit 1c2d6c8

Browse files
committed
added images
1 parent 583dcf2 commit 1c2d6c8

3 files changed

Lines changed: 4 additions & 0 deletions

File tree

learn-pr/wwl-databricks/implement-manage-data-quality-constraints-unity-catalog/includes/5-manage-data-quality-pipeline-expectations.md

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -6,6 +6,8 @@ With expectations, you specify what valid data looks like using SQL constraints.
66

77
Every expectation consists of three parts: a name, a constraint, and an action. Understanding these components helps you design effective data quality checks.
88

9+
:::image type="content" source="../media/5-define-expectations.png" alt-text="Diagram defines expectations with three components." border="false" lightbox="../media/5-define-expectations.png":::
10+
911
The **name** identifies the expectation and appears in monitoring dashboards. Choose names that clearly describe what you're validating. For example, `valid_customer_age` communicates the rule's purpose better than `check_1`.
1012

1113
The **constraint** is a SQL Boolean expression that evaluates to true or false for each record. When a record fails the constraint, the expectation triggers. You can use any valid SQL syntax except custom Python functions, external service calls, or subqueries.
@@ -128,6 +130,8 @@ To view expectation metrics:
128130
3. Select a dataset that has expectations defined.
129131
4. Open the **Data quality** tab in the right sidebar.
130132

133+
:::image type="content" source="../media/5-monitor-expectation-results.png" alt-text="Screenshot of the declarative pipeline editor, highlighting expectations." border="false" lightbox="../media/5-monitor-expectation-results.png":::
134+
131135
The metrics show you how many records passed or failed each expectation during pipeline runs. For `warn` and `drop` actions, you see counts of violations. For `fail` actions, the pipeline stops before metrics are recorded, but error messages include details about the violating record.
132136

133137
When a `fail` expectation triggers, the error message provides context to help you investigate:
396 KB
Loading
937 KB
Loading

0 commit comments

Comments
 (0)