Skip to content

Latest commit

 

History

History
58 lines (36 loc) · 3.45 KB

File metadata and controls

58 lines (36 loc) · 3.45 KB
title Azure Machine Learning activity
description Learn how to add an Azure Batch activity to a pipeline and use it to connect to an Azure Machine Learning instance and run a command.
ms.reviewer xupxhou, abnarain
ms.topic how-to
ms.custom pipelines
ms.date 11/15/2023

Use the Azure Machine Learning activity to run a job on an Azure Machine Learning instance

The Azure Machine Learning activity in Data Factory for Microsoft Fabric allows you to run a job on an Azure Machine Learning instance.

Prerequisites

To get started, you must complete the following prerequisites:

[!INCLUDEbasic-prerequisites]

Add an Azure Machine Learning activity to a pipeline with UI

To use an Azure Machine Learning activity in a pipeline, complete the following steps:

Create the activity

  1. Create a new pipeline in your workspace.

  2. Search for Azure Machine Learning in the pipeline Activities pane, and select it to add it to the pipeline canvas.

    [!NOTE] You may need to expand the menu and scroll down to see the Azure Machine Learning activity as highlighted in following the screenshot.

    :::image type="content" source="media/azure-machine-learning-activity/add-azure-machine-learning-activity-to-pipeline.png" alt-text="Screenshot of the Fabric UI with the Activities pane and Azure Machine Learning activity highlighted.":::

  3. Select the new Azure Batch activity on the pipeline editor canvas if it isn't already selected.

    :::image type="content" source="media/azure-machine-learning-activity/azure-machine-learning-activity-general-settings.png" alt-text="Screenshot showing the General settings tab of the Azure Machine Learning activity.":::

Refer to the General settings guidance to configure the General settings tab.

Azure Machine Learning activity settings

  1. Select the Settings tab, then you can choose an existing or create a new Azure Machine Learning connection.
  2. Choose and Endpoint type, either Batch Endpoint or Pipeline (v1).
  3. Provide a Batch endpoint and Batch deployment and configure **Job settings for the Batch Endpoint type, or provide the pipeline details to run an Azure Machine Learning Pipeline (v1).

:::image type="content" source="media/azure-machine-learning-activity/azure-machine-learning-activity-settings.png" alt-text="Screenshot showing the Settings tab of the Azure Machine Learning activity.":::

Save and run or schedule the pipeline

[!INCLUDEsave-run-schedule-pipeline]

Known issues

  • Using Service Principal to run a notebook that contains Semantic Link code has functional limitations and supports only a subset of semantic link features. See the supported semantic link functions for details. To use other capabilities, you're recommended to manually authenticate semantic link with a service principal.
  • Azure Machine Learning (AML) activity may fail in some configurations due to a missing dual‑token audience during authentication. The fix is currently being worked on.

Related content