- SAP Managed Tags
SAP Datasphere Replication Flow:
SAP Datasphere has introduced a new feature, 'Replication Flows’ which allows for the process of copying multiple tables/extractors from one source to another, offering a fast and seamless experience in data management. For detailed insights into replication flows and their functionalities, please refer below link
Configure Your Replication Flow | SAP Help Portal
Scenario –
In the current landscape, SAP Data Services is used for moving the SAP ECC Data to Azure Data Lake. The customer was moving to S4HANA and wanted to use SAP DataSphere for analytics and loading data to Azure Data Lake.
Datasphere is the best tool for analytics and data warehousing. After technical discussion , SAP Datasphere replication flow was finalized to move the data from S4HANA to Azure Data Lake. We did do the POC using the Datasphere trial version, and all looked fine.
Creating Connection in Datasphere:
Issue: In Datasphere replication flow, extractor enabled ABAP CDS view were not available
Solution:
The extractor enabled ABAP CDS views were not visible when replication flow was selected for development. These views were available if we select the option for Import Entities in Data Builder. I checked lot of forums and raised a query.
The issue was also raised in SAP Customer Influence:
The below SAP note had to be implemented to resolve the issue. We raised the issue with SAP as well and they also asked us to apply the SAP Note. Please go through the note as it talks about implementing 60+ SAP Notes.
3130827 - SAP Data Intelligence - ABAP Integration - SAP S/4HANA 2022
After the note implementation the issue was resolved.
I will come up with a step-by-step blog on loading data from S4HANA to Azure Data Lake using Datasphere replication flow. Currently working on it 😊
Issue -
SAP Datasphere: I_CustSalesPartnerFunc CDC enabled but not working
As seen it is delta enabled, but when trying to trigger it from SAP Datasphere, you get error in SLG1
Error - table for CDS view cannot be determine.
I tried to check that via the RODPS_REPL_TEST program it gives error - The source does not support delta.
Solution: Implement the below SAP Note:
3104226-BW delta extraction enablement and C1 release for Business partner , Customer and Supplier related CDS views
Business Scenario:
Currently data is moved from ECC to Data Lake using SAP Data Service. ECC is migrated to S4HANA and DataSphere will be used for moving the data to DataLake. We will be using the Cloud Connector the connect Datasphere to S4HANA. Business wants to understand how the data will flow to Azure DataLake using Datasphere.
SAP Dataservice loads to DataLake use to send the DI Sequence number which helped in understanding the sequence of delta record update in delta queue.
Analysis:
DataSphere replication flow was used for the above scenario as no data had to be stored in Datasphere i.e. Pass through . The CDC delta extractors were exposed to Datasphere and loaded to DataLake. We tested for the data for Purchasing extractor and noticed that if multiple changes happen between 2 delta interval , the extractor will load only the latest change for the particular Purchasing document.
For deletion scenario , we will receive the key columns populated and all other columns will be blank. As DataLake is a append of records the record had to be flagged as deletion in DataLake as no deletion flag is sent from extractor.
Next Update -
While testing we noticed that we do not see the records getting updated in DHCDCMON or ODQMON. Ideally any changes in source table of a CDC delta extractor it should be loaded in the Master logging table and Subscriber logging table. We will be connecting with SAP to understand in detail and see if it is a product issue or the behaviour in case of Cloud connector /Replication flow/ CDC Delta extractor. I will be updating the blog once I have further update.
Below blog will give detail on the logic of CDC Change Data Capture and DHCDCMON working.
Helpful link:
3297105 - Important considerations for SAP Datasphere Replication Flows
3471218 - Datasphere - CDS View list in Data Flow and Replication Flow
| User | Count |
|---|---|
| 7 | |
| 6 | |
| 5 | |
| 5 | |
| 5 | |
| 4 | |
| 4 | |
| 4 | |
| 4 | |
| 4 |
