You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/data-factory/how-to-upgrade-your-azure-synapse-analytics-pipelines-to-fabric-data-factory.md
+32-26Lines changed: 32 additions & 26 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -13,10 +13,10 @@ ai-usage: ai-assisted
13
13
14
14
Modernizing your workflows in Microsoft Fabric often starts with bringing your existing Azure Synapse Analytics pipelines forward. The preview migration experience helps you assess pipeline readiness, understand compatibility gaps, and migrate supported pipelines into a Fabric workspace—so you can move in a controlled, low-risk way.
15
15
16
-
17
16
## What you can do with the migration experience
18
17
19
18
With the Synapse pipelines migration experience, you can:
19
+
20
20
- Assess pipeline readiness directly in your Synapse workspace.
21
21
- See compatibility gaps at the pipeline and activity level.
22
22
- Migrate supported pipelines to a Fabric workspace.
@@ -25,34 +25,44 @@ With the Synapse pipelines migration experience, you can:
25
25
## Prerequisites
26
26
27
27
Before you start:
28
+
28
29
- You have an **Azure Synapse Analytics workspace** that contains pipelines.
29
30
- You have access to a **Microsoft Fabric tenant** and a **Fabric workspace**.
30
31
- To preserve your folder structure, **create the same folders in your Fabric workspace first**, then migrate pipelines one folder at a time.
31
32
32
33
## Migrate Spark items to Fabric first
33
-
If your Synapse pipelines include Notebook and/or Spark job definition (SJD) activities, migrate those Spark artifacts to Fabric first. This ensures the pipeline migration experience can map those activities to the correct Fabric items instead of leaving them unmapped.
34
34
35
-
Use the [Synapse-to-Fabric Spark Migration Assistant](/fabric/data-engineering/synapse-to-fabric-spark-migration-assistant) to migrate Spark-related items from your Synapse workspace into a Fabric workspace.
36
-
The assistant supports migrating Spark pools (to Fabric environments), notebooks, Spark job definitions, and lake databases (to Fabric lakehouses/shortcuts).
35
+
If your Synapse pipelines include Notebook and/or Spark job definition (SJD) activities, migrate those Spark artifacts to Fabric first. This separation ensures the pipeline migration experience can map those activities to the correct Fabric items instead of leaving them unmapped.
37
36
37
+
Use the [Synapse-to-Fabric Spark Migration Assistant](/fabric/data-engineering/synapse-to-fabric-spark-migration-assistant) to migrate Spark-related items from your Synapse workspace into a Fabric workspace.
38
+
The assistant supports migrating Spark pools (to Fabric environments), notebooks, Spark job definitions, and lake databases (to Fabric lakehouses/shortcuts).
38
39
39
40
## Migrate Synapse pipelines
41
+
40
42
After creating your Spark artifacts in Fabric, migrate pipelines using the Synapse pipelines migration experience.
43
+
41
44
When the pipelines migration runs:
42
45
43
-
- If matching Fabric notebooks/SJDs already exist, the migration can map the corresponding activities to those Fabric items.
44
-
- If the target Fabric notebooks/SJDs don’t exist yet, those activities may be left unmapped/deactivated until you create the required Fabric items and update the reference.
46
+
- If matching Fabric notebooks/SJDs already exist, the migration can map the corresponding activities to those Fabric items.
47
+
- If the target Fabric notebooks/SJDs don’t exist yet, those activities could be left unmapped/deactivated until you create the required Fabric items and update the reference.
48
+
49
+
To migrate your Synapse pipelines to Fabric:
50
+
51
+
1.[Run an assessment in Azure Synapse Analytics](#run-an-assessment-in-azure-synapse-analytics)
52
+
1.[Select pipelines to migrate](#select-pipelines-to-migrate)
53
+
1.[Map linked services to Fabric connections](#map-linked-services-to-fabric-connections)
54
+
1.[Complete migration](#complete-migration)
55
+
56
+
### Run an assessment in Azure Synapse Analytics
45
57
46
-
### Step 1. Run an assessment in Azure Synapse Analytics
58
+
1. In **Azure Synapse Analytics**, open the workspace you want to assess.
59
+
1. In the **Integrate** hub, select **Migrate to Fabric (Preview)**, then select **Get started**.
60
+
1. Review the [assessment](#understand-assessment-statuses) pane. Expand pipelines to see activity-level details.
61
+
1. (Optional) Export assessment results as a **.csv** file to support offline planning and remediation.
47
62
48
-
- In **Azure Synapse Analytics**, open the workspace you want to assess.
49
-
- In the **Integrate** hub, select **Migrate to Fabric (Preview)**, then select **Get started**.
50
-
- Review the assessment pane. Expand pipelines to see activity-level details.
51
-
- Export assessment results as a **.csv** file to support offline planning and remediation (optional)
52
-
53
63
:::image type="content" source="media/how-to-assess-and-upgrade-your-azure-synapse-analytics-pipelines-to-fabric/start-synapse-pipelines-migration-assessment.png" alt-text="Screenshot showing how to run the Azure Synapse Analytics migration assessment." lightbox="media/how-to-assess-and-upgrade-your-azure-synapse-analytics-pipelines-to-fabric/start-synapse-pipelines-migration-assessment.png":::
54
64
55
-
### Understand assessment statuses
65
+
####Understand assessment statuses
56
66
57
67
Each pipeline is categorized using one of the following statuses:
58
68
@@ -63,34 +73,32 @@ Each pipeline is categorized using one of the following statuses:
63
73
|**Coming soon**| Support is in progress; migrate later. |
64
74
|**Unsupported / Not compatible**| No equivalent in Fabric; refactor required. |
65
75
66
-
67
-
### Step 2. Select pipelines to migrate
76
+
### Select pipelines to migrate
68
77
69
78
After reviewing results, select the Synapse pipelines you want to migrate to your Fabric workspace.
70
79
71
80
:::image type="content" source="media/how-to-assess-and-upgrade-your-azure-synapse-analytics-pipelines-to-fabric/view-synapse-pipelines-assessment-results.png" alt-text="Screenshot showing Synapse Analytics migration assessment results with option to select pipelines for migration." lightbox="media/how-to-assess-and-upgrade-your-azure-synapse-analytics-pipelines-to-fabric/view-synapse-pipelines-assessment-results.png":::
72
81
73
82
A phased approach works well:
83
+
74
84
- Start with **Ready** pipelines to validate end-to-end behavior.
75
85
- Then address **Needs review** items and rerun assessment to confirm progress.
76
86
77
-
### Step 3. Map linked services to Fabric connections
87
+
### Map linked services to Fabric connections
78
88
79
89
In the migration flow, select a destination **Fabric workspace**, then map **Synapse linked services** to **Fabric connections**.
80
90
81
91
- If you already created the required Fabric connections, select them from the dropdown.
82
92
- Otherwise, create new Fabric connections from workspace settings.
83
93
84
-
For guidance on creating and managing connections in Fabric, see
85
-
[Data source management - Microsoft Fabric | Microsoft Learn](/fabric/data-factory/data-source-management).
94
+
For guidance on creating and managing connections in Fabric, see: [Data source management in Fabric](/fabric/data-factory/data-source-management).
86
95
87
96
:::image type="content" source="media/how-to-assess-and-upgrade-your-azure-synapse-analytics-pipelines-to-fabric/synapse-linked-service-to-connection-mapping.png" alt-text="Screenshot showing Fabric migration workspace selection followed by Synapse linked services to Fabric connection mapping." lightbox="media/how-to-assess-and-upgrade-your-azure-synapse-analytics-pipelines-to-fabric/synapse-linked-service-to-connection-mapping.png":::
88
97
89
98
> [!IMPORTANT]
90
99
> Pipelines can migrate even if you don’t map connections, but **activities that use those connections remain deactivated** until you configure them in Fabric and reactivate them.
91
100
92
-
93
-
### Step 4. Complete migration
101
+
### Complete migration
94
102
95
103
After you map linked services to Fabric connections, select **Confirm** to complete migration.
96
104
@@ -99,17 +107,17 @@ After you map linked services to Fabric connections, select **Confirm** to compl
99
107
When migration completes, open the destination folder in your Fabric workspace and review the migrated pipelines.
100
108
101
109
> [!NOTE]
102
-
> Pipelines migrate safely, with **triggers disabled by default**, so you stay in control of execution.
110
+
> Pipelines migrate safely with **triggers disabled by default**, so you stay in control of execution.
103
111
104
-
### Step 5. Post-migration validation
112
+
## Post-migration validation
105
113
106
114
After migration:
115
+
107
116
1. Validate connections and credentials.
108
117
2. Re-enable and configure triggers as needed (triggers are disabled by default).
109
118
3. Run end-to-end tests to confirm behavior.
110
119
4. Validate in a nonproduction environment before switching production workloads.
111
120
112
-
113
121
## Related migration resources
114
122
115
123
Use these resources to round out your end-to-end Synapse-to-Fabric migration plan:
@@ -118,6 +126,4 @@ Use these resources to round out your end-to-end Synapse-to-Fabric migration pla
118
126
-[Upgrade your Azure Data Factory pipelines to Fabric](/fabric/data-factory/how-to-upgrade-your-azure-data-factory-pipelines-to-fabric-data-factory)
119
127
-[Migration Assistant for Fabric Data Warehouse - Microsoft Fabric | Microsoft Learn](/fabric/data-warehouse/migration-assistant)
120
128
-[Spark Synapse to Fabric Spark Migration Assistant (Preview)](/fabric/data-engineering/synapse-to-fabric-spark-migration-assistant)
0 commit comments