Skip to content

Commit d64506a

Browse files
committed
Dataflow articles getting ready to publish
1 parent 61f498c commit d64506a

4 files changed

Lines changed: 43 additions & 43 deletions

File tree

articles/iot-operations/connect-to-cloud/concept-dataflow-graphs-expressions.md

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -15,7 +15,7 @@ ai-usage: ai-assisted
1515

1616
[!INCLUDE [kubernetes-management-preview-note](../includes/kubernetes-management-preview-note.md)]
1717

18-
<!-- This reference applies to both [data flows](overview-dataflow.md) and [data flow graphs](concept-dataflow-graphs.md). Both use the same expression language for map, filter, and enrichment transforms. Data flow graphs also support branch and window (accumulate) transforms, which are noted where applicable. -->
18+
This reference applies to both [data flows](overview-dataflow.md) and [data flow graphs](concept-dataflow-graphs.md). Both use the same expression language for map, filter, and enrichment transforms. Data flow graphs also support branch and window (accumulate) transforms, which are noted where applicable.
1919

2020
## Positional variables
2121

@@ -149,7 +149,7 @@ These functions are available only in accumulation rules within window transform
149149
| `first($n)` | First value in the window | Error |
150150
| `last($n)` | Last value in the window | Error |
151151

152-
<!-- For details on using aggregation functions, see [Aggregate data over time](howto-dataflow-graphs-window.md). -->
152+
For details on using aggregation functions, see [Aggregate data over time](howto-dataflow-graphs-window.md).
153153

154154
## Conditional logic
155155

@@ -262,8 +262,8 @@ JSON objects and arrays are preserved as-is when fields are copied without an ex
262262
## Related content
263263

264264
- [Map data by using data flows](concept-dataflow-mapping.md)
265-
<!-- - [Filter data in a data flow](howto-dataflow-filter.md)
265+
- [Filter data in a data flow](howto-dataflow-filter.md)
266266
- [Transform data with map in data flow graphs](howto-dataflow-graphs-map.md)
267267
- [Filter and route data in data flow graphs](howto-dataflow-graphs-filter-route.md)
268268
- [Aggregate data over time](howto-dataflow-graphs-window.md)
269-
- [Enrich with external data](howto-dataflow-graphs-enrich.md) -->
269+
- [Enrich with external data](howto-dataflow-graphs-enrich.md)

articles/iot-operations/connect-to-cloud/concept-dataflow-graphs-schema.md

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -89,7 +89,7 @@ Data flow graph destinations support an `outputSchemaSettings` field to control
8989
}
9090
```
9191

92-
<!-- When using storage destinations (ADLS, Fabric, ADX), the output schema and serialization format are configured on the destination endpoint. See [Configure a data flow destination](howto-configure-dataflow-destination.md#serialize-the-output-with-a-schema). -->
92+
When using storage destinations (ADLS, Fabric, ADX), the output schema and serialization format are configured on the destination endpoint. See [Configure a data flow destination](howto-configure-dataflow-destination.md#serialize-the-output-with-a-schema).
9393

9494
# [Kubernetes (preview)](#tab/kubernetes)
9595

@@ -101,7 +101,7 @@ Data flow graph destinations support an `outputSchemaSettings` field to control
101101
dataDestination: my-container
102102
```
103103

104-
<!-- When using storage destinations (ADLS, Fabric, ADX), the output schema and serialization format are configured on the destination endpoint. See [Configure a data flow destination](howto-configure-dataflow-destination.md#serialize-the-output-with-a-schema). -->
104+
When using storage destinations (ADLS, Fabric, ADX), the output schema and serialization format are configured on the destination endpoint. See [Configure a data flow destination](howto-configure-dataflow-destination.md#serialize-the-output-with-a-schema).
105105

106106
---
107107

@@ -120,5 +120,5 @@ Data flow graph destinations support an `outputSchemaSettings` field to control
120120
## Related content
121121

122122
- [Understand message schemas](concept-schema-registry.md)
123-
<!-- - [Data flow graphs overview](concept-dataflow-graphs.md)
124-
- [Configure a data flow destination](howto-configure-dataflow-destination.md) -->
123+
- [Data flow graphs overview](concept-dataflow-graphs.md)
124+
- [Configure a data flow destination](howto-configure-dataflow-destination.md)

articles/iot-operations/connect-to-cloud/overview-dataflow-comparison.md

Lines changed: 5 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -24,7 +24,7 @@ Data flows are generally available and support all endpoint types.
2424

2525
## What are data flow graphs?
2626

27-
<!-- A [data flow graph](concept-dataflow-graphs.md) is a composable, graph-based pipeline that connects multiple transforms in any topology you define. You can chain, branch, and merge processing steps. Each transform is a pre-built processing unit (map, filter, branch, window, enrichment) that you configure with rules. You configure a data flow graph by creating a `DataflowGraph` custom resource. -->
27+
A [data flow graph](concept-dataflow-graphs.md) is a composable, graph-based pipeline that connects multiple transforms in any topology you define. You can chain, branch, and merge processing steps. Each transform is a pre-built processing unit (map, filter, branch, window, enrichment) that you configure with rules. You configure a data flow graph by creating a `DataflowGraph` custom resource.
2828

2929
Data flow graphs are in preview and support MQTT, Kafka, and OpenTelemetry endpoints.
3030

@@ -49,9 +49,9 @@ Data flows and data flow graphs share:
4949

5050
- **Endpoints**: Both use `DataflowEndpoint` resources to connect to MQTT brokers, Kafka, storage, and other services. See [Prepare endpoints](howto-configure-dataflow-endpoint.md).
5151
- **Profiles**: Both reference a `DataflowProfile` for scaling and instance configuration. See [Manage data flow profiles](howto-configure-dataflow-profile.md).
52-
<!-- - **Source configuration**: Both support the same source endpoint options (default broker, asset, custom endpoint) and data source (topic) configuration. See [Configure a source](howto-configure-dataflow-source.md).
52+
- **Source configuration**: Both support the same source endpoint options (default broker, asset, custom endpoint) and data source (topic) configuration. See [Configure a source](howto-configure-dataflow-source.md).
5353
- **Destination configuration**: Both support static and dynamic destination topics. See [Configure a destination](howto-configure-dataflow-destination.md).
54-
- **Disk persistence**: Both support `requestDiskPersistence` to survive restarts. See [Configure disk persistence](howto-configure-disk-persistence.md). -->
54+
- **Disk persistence**: Both support `requestDiskPersistence` to survive restarts. See [Configure disk persistence](howto-configure-disk-persistence.md).
5555

5656
## When to use which
5757

@@ -73,6 +73,6 @@ For new projects that use supported endpoint types, we recommend data flow graph
7373
## Related content
7474

7575
- [Data flows overview](overview-dataflow.md)
76-
<!-- - [Data flow graphs overview](concept-dataflow-graphs.md)
76+
- [Data flow graphs overview](concept-dataflow-graphs.md)
7777
- [Create a data flow](howto-create-dataflow.md)
78-
- [Create a data flow graph](howto-create-dataflow-graph.md) -->
78+
- [Create a data flow graph](howto-create-dataflow-graph.md)

articles/iot-operations/toc.yml

Lines changed: 30 additions & 30 deletions
Original file line numberDiff line numberDiff line change
@@ -195,9 +195,9 @@ items:
195195
- name: Local storage or ACSA
196196
href: connect-to-cloud/howto-configure-local-storage-endpoint.md
197197
displayName: data flow, endpoint, northbound, Azure Container Storage enabled by Azure Arc
198-
# - name: Source
199-
# href: connect-to-cloud/howto-configure-dataflow-source.md
200-
# displayName: data flow, source, MQTT, Kafka, topic, asset, broker, shared subscription
198+
- name: Source
199+
href: connect-to-cloud/howto-configure-dataflow-source.md
200+
displayName: data flow, source, MQTT, Kafka, topic, asset, broker, shared subscription
201201
- name: Data flows
202202
items:
203203
- name: Overview
@@ -217,39 +217,39 @@ items:
217217
displayName: data flow, serialize, deserialize, schema registry
218218
- name: Data flow graphs
219219
items:
220-
# - name: Overview
221-
# href: connect-to-cloud/concept-dataflow-graphs.md
222-
# displayName: data flow, graph, transform, map, filter, branch, window, compose, pipeline
223-
# - name: Create a data flow graph
224-
# href: connect-to-cloud/howto-create-dataflow-graph.md
225-
# displayName: data flow, graph, create, deploy, pipeline, source, destination
226-
# - name: Transform data with map
227-
# href: connect-to-cloud/howto-dataflow-graphs-map.md
228-
# displayName: data flow, graph, map, rename, restructure, wildcard, copy, compute
229-
# - name: Filter and route data
230-
# href: connect-to-cloud/howto-dataflow-graphs-filter-route.md
231-
# displayName: data flow, graph, filter, drop, branch, concat, merge, route, condition
232-
# - name: Aggregate data over time
233-
# href: connect-to-cloud/howto-dataflow-graphs-window.md
234-
# displayName: data flow, graph, window, aggregate, average, sum, min, max, tumbling
235-
# - name: Enrich with external data
236-
# href: connect-to-cloud/howto-dataflow-graphs-enrich.md
237-
# displayName: data flow, graph, enrich, dataset, state store, context, lookup
238-
# - name: Route messages to different topics
239-
# href: connect-to-cloud/howto-dataflow-graphs-topic-routing.md
240-
# displayName: data flow, graph, topic, routing, metadata, dynamic
220+
- name: Overview
221+
href: connect-to-cloud/concept-dataflow-graphs.md
222+
displayName: data flow, graph, transform, map, filter, branch, window, compose, pipeline
223+
- name: Create a data flow graph
224+
href: connect-to-cloud/howto-create-dataflow-graph.md
225+
displayName: data flow, graph, create, deploy, pipeline, source, destination
226+
- name: Transform data with map
227+
href: connect-to-cloud/howto-dataflow-graphs-map.md
228+
displayName: data flow, graph, map, rename, restructure, wildcard, copy, compute
229+
- name: Filter and route data
230+
href: connect-to-cloud/howto-dataflow-graphs-filter-route.md
231+
displayName: data flow, graph, filter, drop, branch, concat, merge, route, condition
232+
- name: Aggregate data over time
233+
href: connect-to-cloud/howto-dataflow-graphs-window.md
234+
displayName: data flow, graph, window, aggregate, average, sum, min, max, tumbling
235+
- name: Enrich with external data
236+
href: connect-to-cloud/howto-dataflow-graphs-enrich.md
237+
displayName: data flow, graph, enrich, dataset, state store, context, lookup
238+
- name: Route messages to different topics
239+
href: connect-to-cloud/howto-dataflow-graphs-topic-routing.md
240+
displayName: data flow, graph, topic, routing, metadata, dynamic
241241
- name: Use WASM transforms
242242
href: connect-to-cloud/howto-dataflow-graph-wasm.md
243243
displayName: data flow, WASM, WebAssembly, graph, transform, custom, developer, deploy
244244
- name: Schemas
245245
href: connect-to-cloud/concept-dataflow-graphs-schema.md
246246
displayName: data flow, graph, schema, nodeConnections, serialization
247-
# - name: Destination
248-
# href: connect-to-cloud/howto-configure-dataflow-destination.md
249-
# displayName: data flow, destination, MQTT, Kafka, topic, container, table, dynamic
250-
# - name: Disk persistence
251-
# href: connect-to-cloud/howto-configure-disk-persistence.md
252-
# displayName: data flow, persistence, disk, restart, state
247+
- name: Destination
248+
href: connect-to-cloud/howto-configure-dataflow-destination.md
249+
displayName: data flow, destination, MQTT, Kafka, topic, container, table, dynamic
250+
- name: Disk persistence
251+
href: connect-to-cloud/howto-configure-disk-persistence.md
252+
displayName: data flow, persistence, disk, restart, state
253253
- name: Expressions
254254
href: connect-to-cloud/concept-dataflow-graphs-expressions.md
255255
displayName: data flow, expression, function, operator, metadata, variable, conversion

0 commit comments

Comments
 (0)