You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: articles/sap/business-process-solutions/monitor-data-extraction.md
+5-5Lines changed: 5 additions & 5 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -23,12 +23,12 @@ Once the field metadata is processed, the **System Lookup** pipeline (p_s2s_syst
23
23
2. Extracting data from dimensions (p_s2s_dimension_extract)
24
24
25
25
These two jobs run sequentially, with the dimension extraction pipeline dependent on the successful completion of the fact extraction pipeline. If there's an issue with extracting facts, the subsequent dimension processing doesn't start.
26
-
:::image type="content" source="./media/monitoring-data-extraction-in-azure-data-factory/data-extraction-steps.png" alt-text="Screenshot showing different steps to extract data." lightbox="./media/monitoring-data-extraction-in-azure-data-factory/data-extraction-steps.png":::
26
+
:::image type="content" source="./media/monitoring-data-extraction/data-extraction-steps.png" alt-text="Screenshot showing different steps to extract data." lightbox="./media/monitoring-data-extraction/data-extraction-steps.png":::
27
27
28
28
Each pipeline executes a series of actions. If any step encounters an error, the entire pipeline registers a failure. This failure is reported back to the initiating pipelines, including System Lookup and Orchestration Master. Additionally, a failure in one pipeline prevents subsequent pipelines from starting. For example, a problem in the fact extraction step blocks the dimension extraction process.
29
29
30
30
Below is an example of the monitoring view when a data processing step fails:
31
-
:::image type="content" source="./media/monitoring-data-extraction-in-azure-data-factory/data-processing-failure.png" alt-text="Screenshot showing monitoring view if data processing fails." lightbox="./media/monitoring-data-extraction-in-azure-data-factory/data-processing-failure.png":::
31
+
:::image type="content" source="./media/monitoring-data-extraction/data-processing-failure.png" alt-text="Screenshot showing monitoring view if data processing fails." lightbox="./media/monitoring-data-extraction/data-processing-failure.png":::
32
32
33
33
Each pipeline automatically determines the required actions based on the CDS View metadata. The following steps outline the logic:
34
34
@@ -38,7 +38,7 @@ Each pipeline automatically determines the required actions based on the CDS Vie
38
38
4.**Convert to Delta**: Processes data extracted via the **SAP Table connector** and pushes it to the lakehouse. Applicable only if you process the initial extraction using the SAP Table connector.
39
39
40
40
Here's an example of the dimension extraction pipeline encountering some failed activities. Failures in specific actions can cascade back to the initiating actions, like pipeline failures. The For-Each loop iterates through all objects set for extraction, and the Select Connector action determines the appropriate processing steps based on the CDS View metadata. Generally, each issue will manifest as two failed actions.
When an extraction process fails, the first step is to review the error details. The nature of the error guides the corrective actions required.
44
44
@@ -57,11 +57,11 @@ This error indicates that the specified CDS View doesn't support delta extractio
57
57
There are three possible root causes for this issue.
58
58
59
59
1.**Verify the view is available in your SAP release** - To check whether the CDS View is available, you need to examine the view annotations. Open transaction SE16n and access the table DDHEADANNO, which stores all CDS View annotations. Enter the CDS View name in the STRUCOBJN field. Keep in mind, the error message shows the SQL View Name (ODPName) and not the CDS View Name. If the system returns list of annotations, the CDS View exists and you can proceed to step (b) for troubleshooting.
60
-
:::image type="content" source="./media/monitoring-data-extraction-in-azure-data-factory/view-sap.png" alt-text="Screenshot showing view is available in SAP release." lightbox="./media/monitoring-data-extraction-in-azure-data-factory/view-sap.png":::
60
+
:::image type="content" source="./media/monitoring-data-extraction/view-sap.png" alt-text="Screenshot showing view is available in SAP release." lightbox="./media/monitoring-data-extraction/view-sap.png":::
61
61
62
62
If the CDS View doesn’t exists in your system remove the failed table from the dataset to resolve the issue.
63
63
64
64
2.**Verify if the view is extractable** - Not all views defined in the system support extraction using the SAP CDC connector. To determine if a view can be extracted, review the list of annotations in the table DDHEADANNO and check for the annotation ANALYTICS.DATAEXTRACTION.ENABLED. This annotation confirms that the view is extractable using the ODP framework and the SAP CDC connector. If the required annotation is missing, you should switch the connector used for data extraction to SAP Table. This can be achieved by changing the context of the CDS View to SAP Table.
65
-
:::image type="content" source="./media/monitoring-data-extraction-in-azure-data-factory/view-sap-extractable.png" alt-text="Screenshot showing if view is extractable." lightbox="./media/monitoring-data-extraction-in-azure-data-factory/view-sap-extractable.png":::
65
+
:::image type="content" source="./media/monitoring-data-extraction/view-sap-extractable.png" alt-text="Screenshot showing if view is extractable." lightbox="./media/monitoring-data-extraction/view-sap-extractable.png":::
66
66
67
67
3.**Check if you have the right authorizations** - Another common reason for extraction failures is missing authorizations in the source SAP system. Ensure that all required data sources are included in the SAP profile assigned to the user and pay special attention to the authorization objects S_RS_CDS_X and S_DHCDCCDS. To troubleshoot authorization issues, run the extraction using the test report RODPS_REPL_TEST with the same user defined in Business Process Solutions. After the test, execute transaction SU53 to review any missing authorizations. This process helps identify gaps that might be causing the extraction to fail.
0 commit comments