SAP Datasphere: Using REPLICATIONFLOW_RUN_DETAILS ($TEC schema) in an SQL View to export delta count

[#1]

Hello everyone,

We use SAP Datasphere to replicate data from SAP S/4HANA to Azure Data Lake Storage (ADLS). We replicate about 100 S/4HANA tables, and most replication flows contain several tables. The flows run on a schedule with delta loads enabled, so each run sends only the records that changed since the previous run.

For reconciliation, the ADLS team needs to know how many delta records SAP Datasphere sent per table in each replication flow run. We'd like to export these statistics to ADLS as a daily file. To build that file, we need system information about each run: which replication flows completed successfully with the number of records transferred per table.

What we have done so far

1. Database Analysis User: We created a Database Analysis User with Enable Space Schema Access checked. We connected to the SAP HANA Cloud database through Database Explorer.

2. Reading the technical table: From Database Explorer, the following query works and returns the information we need :

   SELECT *

   FROM "<space>$TEC"."REPLICATIONFLOW_RUN_DETAILS"

   WHERE DATASET_EXTERNAL_STATUS = 'COMPLETED';

3. Creating an SQL View in Datasphere: We created an SQL View in the Data Builder on the same technical table so we could replicate it to ADLS. Deployment fails with this error:

   Status 404 is not accepted: "Entities <space>$TEC.REPLICATIONFLOW_RUN_DETAILS cannot be found in the repository

   Questions

   • Can the REPLICATIONFLOW_RUN_DETAILS table (schema <schema>$TEC) be used in a View or Data Flow in SAP Datasphere? If so, how?
   • If this isn't supported, what's the recommended way to expose this information?

   Thanks in advance for any guidance!

    @ThierryAudas