Skip to content

Commit 5479789

Browse files
Merge pull request #306524 from KrishnakumarRukmangathan/patch-59
Update HDInsight linked service with Managed Identify support
2 parents 83b4b73 + 121b055 commit 5479789

1 file changed

Lines changed: 62 additions & 6 deletions

File tree

articles/data-factory/compute-linked-services.md

Lines changed: 62 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,7 @@ description: Learn about compute environments that can be used with Azure Data F
55
ms.topic: conceptual
66
author: nabhishek
77
ms.author: abnarain
8-
ms.date: 07/23/2025
8+
ms.date: 10/06/2025
99
ms.subservice: orchestration
1010
ms.custom: synapse
1111
---
@@ -268,7 +268,7 @@ This type of configuration is supported for the following compute environments:
268268
## Azure HDInsight linked service
269269
You can create an Azure HDInsight linked service to register your own HDInsight cluster with a data factory or Synapse workspace.
270270

271-
### Example
271+
### Example using Basic Authentication
272272

273273
```json
274274
{
@@ -295,6 +295,57 @@ You can create an Azure HDInsight linked service to register your own HDInsight
295295
}
296296
```
297297

298+
### Example using System assigned managed identity
299+
300+
```json
301+
{
302+
"name": "HDInsightLinkedService",
303+
"properties": {
304+
"type": "HDInsight",
305+
"typeProperties": {
306+
"clusterUri": " https://<hdinsightclustername>.azurehdinsight.net/",
307+
"clusterAuthType": "SystemAssignedManagedIdentity",
308+
"linkedServiceName": {
309+
"referenceName": "AzureStorageLinkedService",
310+
"type": "LinkedServiceReference"
311+
}
312+
},
313+
"connectVia": {
314+
"referenceName": "<name of Integration Runtime>",
315+
"type": "IntegrationRuntimeReference"
316+
}
317+
}
318+
}
319+
```
320+
321+
### Example using User assigned managed identity
322+
323+
```json
324+
{
325+
"name": "HDInsightLinkedService",
326+
"properties": {
327+
"type": "HDInsight",
328+
"typeProperties": {
329+
"clusterUri": " https://<hdinsightclustername>.azurehdinsight.net/",
330+
"clusterAuthType": "UserAssignedManagedIdentity",
331+
"credential": {
332+
"referenceName": "CredentialName",
333+
"type": "CredentialReference"
334+
},
335+
"linkedServiceName": {
336+
"referenceName": "AzureStorageLinkedService",
337+
"type": "LinkedServiceReference"
338+
}
339+
},
340+
"connectVia": {
341+
"referenceName": "<name of Integration Runtime>",
342+
"type": "IntegrationRuntimeReference"
343+
}
344+
}
345+
}
346+
```
347+
348+
298349
### Properties
299350
| Property | Description | Required |
300351
| ----------------- | ------------------------------------------------------------ | -------- |
@@ -305,17 +356,22 @@ You can create an Azure HDInsight linked service to register your own HDInsight
305356
| linkedServiceName | Name of the Azure Storage linked service that refers to the Azure blob storage used by the HDInsight cluster. <p>Currently, you cannot specify an Azure Data Lake Storage (Gen 2) linked service for this property. If the HDInsight cluster has access to the Data Lake Store, you can access data in the Azure Data Lake Storage (Gen 2) from Hive/Pig scripts. </p> | Yes |
306357
| isEspEnabled | Specify '*true*' if the HDInsight cluster is [Enterprise Security Package](../hdinsight/domain-joined/apache-domain-joined-architecture.md) enabled. Default is '*false*'. | No |
307358
| connectVia | The Integration Runtime to be used to dispatch the activities to this linked service. You can use Azure Integration Runtime or Self-hosted Integration Runtime. If not specified, it uses the default Azure Integration Runtime. <br />For Enterprise Security Package (ESP) enabled HDInsight cluster use a self-hosted integration runtime, which has a line of sight to the cluster or it should be deployed inside the same Virtual Network as the ESP HDInsight cluster. | No |
359+
| clusterAuthType | Specify the HDInsight cluster authentication type. Supported auth types are "BasicAuth", "SystemAssignedManagedIdentity", "UserAssignedManagedIdentity". | Required for using Managed Identity auth. If field is not there, will default to BasicAuth |
360+
| credential | Specify the credential reference containing Managed Identity object information for the HDInsight cluster. | Only required for "UserAssignedManagedIdentity" auth |
361+
362+
#### Authentication
363+
The Azure Storage linked service for ADLS Gen2 now supports system-assigned and user-assigned managed identities in addition to the existing authentication methods. This support is available by default when using Azure Integration Runtime (Azure IR) and is supported in Self-hosted Integration Runtime (SHIR) starting from version 5.55.9306.2 or later.
364+
For Azure Blob Storage, the Azure Storage linked service continues to support only account key authentication.
365+
Cluster managed identity authentication is also now available by default when using Azure IR and supported on SHIR beginning with version 5.58 or later. When creating a cluster, only one authentication method can be used per cluster. For details on creating and managing clusters with managed identity, see [Create and manage Azure HDInsight cluster with Entra ID authentication](../hdinsight/hdinsight-with-entra-authentication/create-clusters-with-entra.md)
366+
308367

309368
> [!IMPORTANT]
310369
> HDInsight supports multiple Hadoop cluster versions that can be deployed. Each version choice creates a specific version of the Hortonworks Data Platform (HDP) distribution and a set of components that are contained within that distribution. The list of supported HDInsight versions keeps being updated to provide latest Hadoop ecosystem components and fixes. Make sure you always refer to latest information of [Supported HDInsight version and OS Type](../hdinsight/hdinsight-component-versioning.md#supported-hdinsight-versions) to ensure you are using supported version of HDInsight.
311370
>
312371
> [!IMPORTANT]
313372
> Currently, HDInsight linked services does not support HBase, Interactive Query (Hive LLAP), Storm.
314373
>
315-
> [!IMPORTANT]
316-
> In addition to the already supported authentication methods, the Azure Storage linked service for ADLS Gen2 now supports both system-assigned and user-assigned managed identities as authentication types. This support is available by default when using Azure Integration Runtime (Azure IR). For Self-hosted Integration Runtime (SHIR), it is supported starting from version 5.55.9306.2 and above. The Azure Storage linked service configured with Azure Blob Storage continues to support only account key authentication.
317-
>
318-
>
374+
319375

320376
## Azure Batch linked service
321377

0 commit comments

Comments
 (0)