Part 1: SDI - DP Agent and Remote Source Configuration in HANA to Read Data from S/4HANA

[Geetha_Madhuri_Bobbili]

Author: Geetha Madhuri Bobbili
LinkedIn Profile: https://www.linkedin.com/in/geetha-madhuri-bobbili-971268184/

HANA Smart Data Integration (SDI) Introduction:

 

SDI is HANA database native technology to support all styles of data integration. It can be used for data federation (Smart Data Access), real-time data replication and to apply complex transformations on the data.

SDI is available on SAP Cloud Platform and every HANA database since HANA SPS09.

Data Federation or Smart Data Access (SDA):

Smart Data Acces replicates the table meta-data from the source and not its data. We get the table structure in remote data source, on which we can create a “Virtual table”.

SDI Components:

SDI has two main components. They are

1. The Data Provisioning Server (DPServer)

2. The Data Provisioning Agent (DPAgent)

1. Data Provisioning Server (DPServer):

DPServer is natively available in the HANA database. We need to activate the DPServer in the HANA configuration.

2. Data Provisioning Agent (DP Agent):

The Data Provisioning Agent manages all SDI Adapters and connections to HANA database. It acts as the communication interface between HANA and the Adapter. The DP Agent version must match with the HANA version.

On this agent,different types of adapters are deployed, these adapters will take care of the communication between the HANA database and the source systems.

Steps to install DP Agent and to register Adapters:

The DP Agent can be downloaded from SAP Service Marketplace as SAR file.

1. Search for Smart Data Integration in SAP Service Marketplace.

2. From the results list, select the latest available SAP HANA SDI release (maintenance product). Example: SAP HANA SDI 2.0

3. Select the button Comprised software component version.

4. Select HANA DP AGENT x.x



5. Download the latest Service pack.

6. After you download the right DP Agent you must install it.

7. Click on Register Agent and give the Agent Name.

8. Click on Connect to HANA - Provide your HANA System Details.

9. After entering the HANA details, the DPAgent Configuration Tool should show that it is connected to Hana successfully. We can see the agent name is registered, and the agent status started.

10. Select ABAPAdapter and click on Register Adapter.

ABAPAdapter:

The SDI agent includes many adapters. It includes real-time enabled and batch extraction adapters. In addition to these adapters, to create custom adapters a JAVA based adapter SDK is also available.

This ABAPAdapter retrieves data from virtual tables through RFC for ABAP table and ODP extractors. It also provides Real-Time change data capture for ODP extractors.



11. Once the ABAPAdapter is registered in DP Agent, we can check in HANA under SYS Schema->Expand VIEWS->Right click on ADAPTER and select data preview to check whether an entry is created.



Steps to set up the Remote Source:

The first step of accessing data virtually is to create remote data source in SAP HANA. Let’s see how to create remote data source in SAP HANA Studio.

1. Create remote data source by open the folder called “Provisioning” in HANA.

2. Then right click on the “Remote Sources”, select “New Remote Source…”.



3. Create the new remote source by maintaining the following fields:

• Source Name: Give a proper Name.


• Adapter Name: Choose the relevant adapter for SDI – in this case ABAPAdapter.


• Source Location: Select the data provisioning agent installed in the previous steps.


• Fill in the right Credentials to use the S/4HANA source tables.

4. Choose one adapter from the adapter list in the popup dialog and select the source location, fill in corresponding connection and authentication information of the remote data source.



5. After filling the connection information, press the run button to create remore data source. Now, we can see the newly created remote source connection under Provisioning folder.



Steps to Create Virtual Table:

After the Remote data source is created in SAP HANA Studio, we need to map the tables in remote data source as “Virtual Table” to our schema.

Let's take Sales Document Header and Item tables (VBAK and VBAP) as an example.



1. Create Virtual Table.

2. Right click on the table in Remote Source, Select Add as Virtual Table.

3. Select your Schema.



4. Execute a quick smoke test and get a preview of VBAK data by running the following SQL statement in the console.



5. Repeat the steps for all the Virtual Tables based on the individual Requirements. In this example we’d like to use two tables (VBAK & VBAP) from the Source (S/4HANA) as Virtual tables.





6.Click on create.



Conclusion:

Now the Source Tables are connected via SDI, the Data Provisioning Agent is installed, and the Data Provisioning Adapter is deployed. Furthermore, the Remote Source and the related Virtual Tables are created.

In Part 2 of the blog series, Data Integration between S/4HANA and BW/4HANA has been covered.

Reference:

https://help.sap.com/

[former_member675454]

you showed to use virtual table's data, the same thing done by SDA...

 

Then what is the difference.

 

Can you show the replication done by SDI?

 

[former_member457838]

Hi Geetha,

very good indroduction, do you habe also experiences with EXCEL as an Remote Source for HANA?

BR

Matthias

[Geetha_Madhuri_Bobbili]

Hi Matthias,

Hope you are doing good!

Yes, I do have experience in using Flat Files as Remote Source in HANA by registering File Adapter in DP Agent.

Once File Adapter in DP Agent is registered , we can check in HANA under SYS->VIEWS->ADAPTER whether an entry is created.

In DP Agent, Select the location of the folder in which the files to be accessed via Remote Source are saved. For that do the following in preferences of DP Agent.

Go to DPAgent -> Configure menu ->Preferences -> Adapters-> FileAdapter

Come back to HANA and Create a Remote Source

Provisioning -> Remote Sources -> Create New Remote Source.

Do let me know, if you need further information.

Thanks & Regards,

Geetha.

[Geetha_Madhuri_Bobbili]

Hi,

 

I haven't worked on replication by SDI. I don't want to create a blog, unless I have handson experience on that particular topic.

There are many useful blogs on replication by SDI in the SAP Community. Check, if you haven't gone through.

Hope this clarifies your query!

 

Regards,

Geetha.

[Giuseppe_Miceli]

Hi Geetha,

 

I am trying to configure SDI for HANA database on SCP NEO

I am not able to switch the dpserver on. Do you have any suggestions?

 

Many thanks

Giuseppe

[madhu575]

Hi Team,


Is there a possibility to avoid SDI agents with HANA Cloud for data replication.

 

Regards,

Madhu

[rama_shankar3]

Nice blog - thanks !

[DanielSilva1]

Very good blog!

What is the hardware requirement to install the DP agent?

Thanks.

[DanielSilva1]

Very good blog!

What is the hardware requirement to install the DP agent?

Thanks.

[werner_daehn]

Essentially zero. It acts as a translator from one language (source system) to the Hana system. So the minimum is good enough.

[former_member690424]

Such a nice Blog! very easy to understand and for the consultants who already worked on this technology, it provides excellent clarity and re-cap.

 

Thanks

[lcastelang]

Hi Geetha,

What would be the difference between using the HANA adapter and the ABAP adapter?

 

Thanks

[former_member119206]

Hello guys, nice blog!

Do you know what type of license SDI requires?

Thanks

[Diggeshhjoshi]

Hi, 

Nice blog.  How do I get configuration UI screen for step 8?  I tried on localhost:5051 but I don't see config screen. 

Thanks,