Skip to content

Commit 5ecebc3

Browse files
committed
updates
1 parent 5957a93 commit 5ecebc3

3 files changed

Lines changed: 17 additions & 12 deletions

File tree

articles/sentinel/datalake/data-federation-overview.md

Lines changed: 2 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@ author: EdB-MSFT
66
ms.service: microsoft-sentinel
77
ms.subservice: sentinel-platform
88
ms.topic: concept-article
9-
ms.date: 03/22/2026
9+
ms.date: 03/29/2026
1010
ms.author: edbaynash
1111
ms.collection: ms-security
1212

@@ -22,7 +22,7 @@ Data federation in Microsoft Sentinel enables seamless querying of multiple exte
2222
Data federation allows you to query external data sources directly from the Microsoft Sentinel data lake using Kusto Query Language (KQL) or Jupyter notebooks using the Microsoft Sentinel Visual Studio Code extension. Instead of ingesting the data into Sentinel, federation creates connections to external data stores, enabling:
2323

2424
- **Unified analytics**: Query federated sources alongside native Microsoft Sentinel data lake tables.
25-
- **Cost optimization**: Avoid data duplication by querying data where it resides.
25+
- **Preserve governance and compliance controls**: Maintain data security and compliance by querying data in place without moving it.
2626
- **Enhanced insights**: Combine security data with business data, logs, or other datasets stored in external systems.
2727
- **Flexible data access**: Access historical or specialized datasets that complement your security operations.
2828

@@ -96,11 +96,6 @@ Combine security event data in Sentinel with context from external sources, such
9696
- Historical logs stored in ADLS Gen 2
9797
- Business application data from Microsoft Fabric
9898

99-
### Cost efficiency
100-
101-
- Reduce data ingestion costs by querying data in place
102-
- Avoid storage duplication across systems
103-
10499
### Operational flexibility
105100

106101
- Access data across organizational boundaries

articles/sentinel/datalake/data-federation-setup.md

Lines changed: 4 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@ author: EdB-MSFT
66
ms.service: microsoft-sentinel
77
ms.subservice: sentinel-platform
88
ms.topic: how-to
9-
ms.date: 03/23/2026
9+
ms.date: 03/29/2026
1010
ms.author: edbaynash
1111
ms.collection: ms-security
1212

@@ -136,6 +136,8 @@ Before configuring the Fabric connector instance, you must set up permissions wi
136136

137137
1. Select **Connect** to create the connection instance.
138138

139+
> [!NOTE]
140+
> The files in your target data source must be in delta parquet format to be read from the Sentinel data lake.
139141
140142
# [Azure Data Lake Storage Gen 2](#tab/adls)
141143

@@ -147,8 +149,7 @@ Before creating the connector, prepare your storage account:
147149
1. Assign the **Storage Blob Data Reader** role to the service principal you created earlier. For more information on granting access through the Azure portal, see [Assign Azure roles using the Azure portal - Azure RBAC](/azure/role-based-access-control/role-assignments-portal).
148150

149151

150-
> [!NOTE]
151-
> The files in your ADLS Gen 2 storage account must be in delta parquet format to be read from the Sentinel data lake.
152+
152153

153154

154155
1. On the **Data federation** > **Catalog** page, select **Azure Data Lake Storage**.

articles/sentinel/datalake/using-data-federation.md

Lines changed: 11 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@ author: EdB-MSFT
66
ms.service: microsoft-sentinel
77
ms.subservice: sentinel-platform
88
ms.topic: how-to
9-
ms.date: 03/22/2026
9+
ms.date: 03/29/2026
1010
ms.author: edbaynash
1111
ms.collection: ms-security
1212

@@ -22,7 +22,7 @@ After setting up federated data connectors, you can access your federated tables
2222
Before you begin, ensure:
2323

2424
- Your tenant must be onboarded to the Sentinel data lake. For more information, see [Onboard to Microsoft Sentinel data lake](./sentinel-lake-onboard-defender.md)
25-
- You have appropriate permissions to query data in the Sentinel data lake.
25+
- You have appropriate permissions to query data in the Sentinel data lake. For more information,see [Roles and permissions in the Microsoft Sentinel platform](../roles#microsoft-sentinel-data-lake-read-permissions).
2626

2727
## Understand federated table naming
2828

@@ -34,6 +34,8 @@ Federated table names follow the pattern `<tableName>_<connectorInstanceName>`.
3434
| `sales_data` | `AzureDBX01` | `sales_data_AzureDBX01` |
3535
| `inventory` | `Fabric01` | `inventory_Fabric01` |
3636

37+
If multiple tables in the connector instance have the same table name, a numerical identifier is appended to the connector instance name, for example `widgets_ADLS01_1` when two tables within the `ADLS01` connector instance are called `widgets`.
38+
3739
Use the federated table name when querying data from the Sentinel data lake.
3840

3941
## View federated tables in table management
@@ -73,6 +75,9 @@ The KQL queries page in Microsoft Sentinel allows you to query federated tables
7375
1. Expand the federation type to see your federated tables.
7476
1. Expand a table to view its columns.
7577

78+
> [!NOTE]
79+
> Due to query performance optimization in KQL, it can take up to 15 minutes for new data in a federated table to become available for query.
80+
7681
:::image type="content" source="./media/using-data-federation/kql-schema-federated.png" alt-text="Screenshot showing the KQL queries schema tab with federated tables expanded." lightbox="./media/using-data-federation/kql-schema-federated.png":::
7782

7883
### Write and execute queries
@@ -127,6 +132,10 @@ Working with federated tables in Jupyter notebooks follows the same patterns as
127132
1. **Don't specify a workspace name**: Read operations don't require a workspace specification.
128133
1. **Read-only access**: Federated tables are read-only; you can't write data back to federated sources.
129134

135+
> [!NOTE]
136+
> After enabling data federation the first time, it can take up to 24 hours before you see federated tables within Jupyter notebooks.
137+
138+
130139
### Jupyter notebook jobs
131140

132141
You can create scheduled Jupyter notebook jobs that utilize federated tables in the same way that you would create a notebook job for native data lake tables:

0 commit comments

Comments
 (0)