cancel
Showing results for 
Search instead for 
Did you mean: 

Enabling delta in Data services while extracting from BW

0 Kudos

Hi Experts,

We have the requirement to enable delta mechanism in DS while extracting data from SAP BW active data tables and loading into DS Staging area Oracle db.

Ex:

Day 1 - Active data table in BW

Sales order NumberSales order ItemMaterialCreated DateAmountQuantity
0000048635100JS-NETDIR07-NOV-131020
0000048635101SVC-JS-NETDIR-1Y07-NOV-132030
0000049272100CHAS-BP-MX480-S08-DEC-1331

First day when we run the DS load we got all the 3 records from BW to DS Staging.

Day 2 - Active data table in BW, we have few records modified and added as highlighted below in red and blue.

Sales order NumberSales order ItemMaterialCreated DateAmountQuantity
0000048635100JS-NETDIR07-NOV-131020
0000048635101SVC-JS-NETDIR-1Y07-NOV-133090
0000049272100CHAS-BP-MX480-S08-DEC-1356
00000003431045W454120-AUG-1357
000000042830DR74X27-AUG-13323
000000093810CHAS-BP-MX480-S01-OCT-131034

So when I run delta on 2nd day only it should load the 5 records i.e. changed records (2 Highlighted in Red) and newly added records(3 Highlighted in Blue)

Please suggest the ways how the delta extraction can be enabled in DS while extracting from SAP BW.

Thanks & Regards,

Raju.

View Entire Topic
0 Kudos

Hi Experts,

Can any one suggest the way to implement the delta in Data services without using Table Comparision , as in source we have huge data.

Regards,

Raju

former_member198401
Active Contributor
0 Kudos

Hi Raju,

You will have to use Sales order Number(If this is Primary key) as the Input primary column and use Sales order item and Material under Compare columns. If your data is huge to compare then use Cache comparison table option under Comparison method.

You also need to add a Map operation after the Table comparison such that only the updates and inserts are passed to the target table. Use Update>Update and Insert>Insert

Regards

Arun Sasi

former_member187605
Active Contributor
0 Kudos

You have to distinguish between source CDC and target CDC.

The table_comparison transform is typically used for target CDC, comparing a data flow's input stream against a target table. Refer to for more details.

For source CDC you can choose between several methods, depending on the capabilities of your data source. The most popular method is based on timestamping: select all records that have been modified or created since a certain point in time.

former_member198401
Active Contributor
0 Kudos

Hi Raju,

Please go through this useful SCN Article

Delta Load Implementation - Enterprise Information Management - SCN Wiki

Regards

Arun Sasi

former_member198401
Active Contributor
0 Kudos

Any update..