You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/sentinel/datalake/data-federation-overview.md
+2-7Lines changed: 2 additions & 7 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -6,7 +6,7 @@ author: EdB-MSFT
6
6
ms.service: microsoft-sentinel
7
7
ms.subservice: sentinel-platform
8
8
ms.topic: concept-article
9
-
ms.date: 03/22/2026
9
+
ms.date: 03/29/2026
10
10
ms.author: edbaynash
11
11
ms.collection: ms-security
12
12
@@ -22,7 +22,7 @@ Data federation in Microsoft Sentinel enables seamless querying of multiple exte
22
22
Data federation allows you to query external data sources directly from the Microsoft Sentinel data lake using Kusto Query Language (KQL) or Jupyter notebooks using the Microsoft Sentinel Visual Studio Code extension. Instead of ingesting the data into Sentinel, federation creates connections to external data stores, enabling:
23
23
24
24
-**Unified analytics**: Query federated sources alongside native Microsoft Sentinel data lake tables.
25
-
-**Cost optimization**: Avoid data duplication by querying data where it resides.
25
+
-**Preserve governance and compliance controls**: Maintain data security and compliance by querying data in place without moving it.
26
26
-**Enhanced insights**: Combine security data with business data, logs, or other datasets stored in external systems.
27
27
-**Flexible data access**: Access historical or specialized datasets that complement your security operations.
28
28
@@ -96,11 +96,6 @@ Combine security event data in Sentinel with context from external sources, such
96
96
- Historical logs stored in ADLS Gen 2
97
97
- Business application data from Microsoft Fabric
98
98
99
-
### Cost efficiency
100
-
101
-
- Reduce data ingestion costs by querying data in place
Copy file name to clipboardExpand all lines: articles/sentinel/datalake/data-federation-setup.md
+4-3Lines changed: 4 additions & 3 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -6,7 +6,7 @@ author: EdB-MSFT
6
6
ms.service: microsoft-sentinel
7
7
ms.subservice: sentinel-platform
8
8
ms.topic: how-to
9
-
ms.date: 03/23/2026
9
+
ms.date: 03/29/2026
10
10
ms.author: edbaynash
11
11
ms.collection: ms-security
12
12
@@ -136,6 +136,8 @@ Before configuring the Fabric connector instance, you must set up permissions wi
136
136
137
137
1. Select **Connect** to create the connection instance.
138
138
139
+
> [!NOTE]
140
+
> The files in your target data source must be in delta parquet format to be read from the Sentinel data lake.
139
141
140
142
# [Azure Data Lake Storage Gen 2](#tab/adls)
141
143
@@ -147,8 +149,7 @@ Before creating the connector, prepare your storage account:
147
149
1. Assign the **Storage Blob Data Reader** role to the service principal you created earlier. For more information on granting access through the Azure portal, see [Assign Azure roles using the Azure portal - Azure RBAC](/azure/role-based-access-control/role-assignments-portal).
148
150
149
151
150
-
> [!NOTE]
151
-
> The files in your ADLS Gen 2 storage account must be in delta parquet format to be read from the Sentinel data lake.
152
+
152
153
153
154
154
155
1. On the **Data federation** > **Catalog** page, select **Azure Data Lake Storage**.
Copy file name to clipboardExpand all lines: articles/sentinel/datalake/using-data-federation.md
+11-2Lines changed: 11 additions & 2 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -6,7 +6,7 @@ author: EdB-MSFT
6
6
ms.service: microsoft-sentinel
7
7
ms.subservice: sentinel-platform
8
8
ms.topic: how-to
9
-
ms.date: 03/22/2026
9
+
ms.date: 03/29/2026
10
10
ms.author: edbaynash
11
11
ms.collection: ms-security
12
12
@@ -22,7 +22,7 @@ After setting up federated data connectors, you can access your federated tables
22
22
Before you begin, ensure:
23
23
24
24
- Your tenant must be onboarded to the Sentinel data lake. For more information, see [Onboard to Microsoft Sentinel data lake](./sentinel-lake-onboard-defender.md)
25
-
- You have appropriate permissions to query data in the Sentinel data lake.
25
+
- You have appropriate permissions to query data in the Sentinel data lake. For more information,see [Roles and permissions in the Microsoft Sentinel platform](../roles.md#microsoft-sentinel-data-lake-read-permissions).
If multiple tables in the connector instance have the same table name, a numerical identifier is appended to the connector instance name, for example `widgets_ADLS01_1` when two tables within the `ADLS01` connector instance are called `widgets`.
38
+
37
39
Use the federated table name when querying data from the Sentinel data lake.
38
40
39
41
## View federated tables in table management
@@ -73,6 +75,9 @@ The KQL queries page in Microsoft Sentinel allows you to query federated tables
73
75
1. Expand the federation type to see your federated tables.
74
76
1. Expand a table to view its columns.
75
77
78
+
> [!NOTE]
79
+
> Due to query performance optimization in KQL, it can take up to 15 minutes for new data in a federated table to become available for query.
80
+
76
81
:::image type="content" source="./media/using-data-federation/kql-schema-federated.png" alt-text="Screenshot showing the KQL queries schema tab with federated tables expanded." lightbox="./media/using-data-federation/kql-schema-federated.png":::
77
82
78
83
### Write and execute queries
@@ -127,6 +132,10 @@ Working with federated tables in Jupyter notebooks follows the same patterns as
127
132
1.**Don't specify a workspace name**: Read operations don't require a workspace specification.
128
133
1.**Read-only access**: Federated tables are read-only; you can't write data back to federated sources.
129
134
135
+
> [!NOTE]
136
+
> After enabling data federation the first time, it can take up to 24 hours before you see federated tables within Jupyter notebooks.
137
+
138
+
130
139
### Jupyter notebook jobs
131
140
132
141
You can create scheduled Jupyter notebook jobs that utilize federated tables in the same way that you would create a notebook job for native data lake tables:
0 commit comments