HCI DS , How to restrict data at extract level in HCI DS

[former_member457993]

Hi,

I would like to restrict data for a table , lets say ekko , before load entire data into HCI DS and then do a filter validation at transform level.

I know that at task-data flow filter level, we can do transformation rules like ekko.bukrs = '1000' , but here entire data will be loaded into HCI DS and then each record would be validated . Instead of this , at Extract level , I want to fetch data from ekko where bukrs =1000.

Has anyone come across this type of requirement.

[former_member423067]

Hello Syed,

we have used the required filters in Transform1 using simple query. based on the monitor log, data entering Flow are filtered and only data satisfying the condition enters the flow. I don't think, they download enter table and filter the particular records alone.

if performance is a major concern, Best option will be is to use ABAP Query for extract of data. If you have the filter as BUKRS='1000', the query runs in ECC system. The data enters HCI after applying all the filters inside the ABAP query.

with regards,

Nazeer

[former_member596468]

Dear Nazeer ,

Could you pls help me out ,I need to move table and source structure from ECC to cloud Platform using SAP HCI DS..Any manual document or step. ..Loading and then transferring.

Best regards,

[former_member423067]

Hello Zaheen,

CPI DS community is still growing. you might not find a direct step by step guide. you can still search for new blogs and Q&A's. but, please check, below links and you may get some idea to start with ABAP query development.

https://answers.sap.com/questions/270387/hci-ds-abap-query.html

https://blogs.sap.com/2014/04/18/sap-hci-ds-hana-cloud-integration-for-data-services-extract-data-fr...

https://archive.sap.com/documents/docs/DOC-47511

For starters, here are some suggestions.

1. If you are using simple transformation and the expected table size is less with not many look up and join, you can use simple query and directly read from ECC tables. then do your further processing based on your requirement. you can save the tables as files in HCI agent and use separate flow to merge these flow also. (splitting the requirement into multiple flows)

2. if you have high volume tables with simply logic, then you can use ABAP Query transform to create the ABAP Query from HCI and deploy in ECC system. you can start with ECC Sandbox system, where you can get admin roles added to your HCI user and easily work on the POC.

3. if you have high volume tables and complex transformation, then you can work on creating custom ABAP program and get that deployed in ECC D,Q and P. if you have achieved step 2 successfully, you can share the same .aba file to any ABAP developer and ask him to modify the code section to achieve your logic. This will have better performance and code standard than option 2.

with regards,

Nazeer