SAP Replication flow from SAP Datasphere to S3

[Sandyk]

Hello experts, @Matthew_Shaw 

Need a help please?

I am trying to create a replication flow to replicate data from a local table in datasphere to AWS S3.  I want to replicate delta updates on hourly basis, not the full load. I can only see initial only option, I cannot see initial and delta. Can you please help me how to achieve delta replication as I need to run it every hour and don't want to load the systems with full load every time?

Thanks in advance. 

Regards

SK

[Ian_Henry · Accepted solution]

For a replication flow to use initial and delta you need to enable delta capture on your local table.

You will need to create a new local table and set the toggle "Delta Capture" ON in the general table properties.

[Sandyk · Accepted solution]

thank you for the help.

[RichT · Accepted solution]

If you want to only send deltas to the S3 bucket then you will need a transformation flow that sends only deltas to a new local table from the existing delta enabled table then another replication flow to send the deltas from the new table to AWS

[Tanumay · Accepted solution]

Hi all, I am having the same scenario to be built, I have the following questions:

1. If i am using replication flow, is there any way that we can push the data to redshift rather than s3 bucket?

2.Can we use Aws glue to pull the data from tables/views odata service option enabled on the top?

[shubham521]

Hi @Sandyk 

delta only was recently introduced in wave14. Its possible to push delta from a local table to s3

more details can be found here - https://help.sap.com/docs/SAP_DATASPHERE/c8a54ee704e94e15926551293243fd1d/10891192186c4920b08939a7b4...