Part 1: SAP Cloud Platform Integration for Data Services (CPI-DS)

[Geetha_Madhuri_Bobbili]

Author: Geetha Madhuri Bobbili
LinkedIn Profile: https://www.linkedin.com/in/geetha-madhuri-bobbili-971268184/

Introduction:

SAP Cloud Platform Integration for data services allows you to efficiently and securely use ETL (extract, transform, load) tasks to move data between on premise systems and the cloud.

SAP Cloud Platform Integration interacts with your local SAP landscape via the SAP Data Services Agent and secure HTTPS and RFC connections. SAP ERP Systems are registered with the HCI Agent as data stores via RFC.

Before you can use SAP Cloud Platform Integration, your administrator needs to prepare your environment.Agents:

The SAP Data Services Agent provides connectivity to on-premise sources in your system landscape.

At design-time, the agent is used to provide metadata browsing functionality for on-premise sources to the web based user interface. At run-time, the agent manages the secure data transfer from your on-premise sources to your cloud-based target application.

Agent groups ensure high-availability by clustering one or more agents and making sure tasks and processes get assigned only to available agents in the group.

Download & Install the Agent:

Create a New Agent, download the configuration file (AgentConfig.txt).

Select Agents tab -> Click on “New Agent”.

Enter the Name and Description for the Agent. Select the Agent Group.

An agent group is a collection of agents that are logically grouped. When scheduling or running tasks and processes, an agent group is specified. At run-time, tasks and processes are automatically assigned to an available agent within the group.Download the Configuration File. Save the configuration file in your local system where you want to install the agent.After downloading the Configuration file, select Save and Close. Once you click on Save and Close, you can see the Agent Information under the group “GBOBBILI”.Install above agent by right click on it and run it with elevated/admin rights.After the above step, you will see below screen. You need to provide your Windows credentials and password over there and click install.

After clicking Install button you will see below screen click finish and YES.

Then you will see below screen. Provide your credentials of CPIDS and password. Attach the AgentConfig.txt file and provide the proxy host & port and then click Upload and yes.

Login to CPIDS (from the above link) and check if the agent is active or not.

Create Datastore:

Datastores are the objects that connect SAP Cloud Platform Integration for data services to your cloud and on-premise applications and databases.

Through these connections, SAP Cloud Platform Integration for data services can access metadata from and read and write data to your applications and databases.

Within the Datastores tab, you can create and manage datastores, which connect SAP Cloud Platform Integration for data services to your applications and databases.

From this tab, you can:

• Create and delete datastores


• Test the connection to a datastore


• View and edit a datastore's configuration options (Configuration)


• Browse a datastore's metadata objects (File Formats or Tables)


• Import and manage file format or table metadata objects for a datastore


• View data loaded to a table in a target datastore to ensure it is correct

Select Datastores tab -> Create “+” icon to create New Datastore.

SAP CPI - DS supports datastores the following types of applications and databases:

• SAP Business Suite applications


• SAP BW sources


• SAP HANA application clouds


• SAP HANA cloud applications such as SAP IBP and SuccessFactors BizX


• Applications that have pre-packaged or user-written adapters


• Databases


• File format groups


• SOAP and REST Web services

Once the Datastore is created Test the connection.

Import Metadata Objects:

Importing metadata objects adds the table and file names from your source and target databases and applications to your datastores.

In the Datastores area, select a datastore.

Open the Tables or File Format tab (which one appears depends on the datastore type).

Do one of the following:

If the datastore has a Tables tab, click Import Objects or Import Object by Name and select the tables whose metadata you want to import. (To import a web service object, the web service must be up and running.)

If it has a File Formats tab, click Create File Format and select the option you want to create.

Select the Type of Meta data to be imported and enter the Name.

Table: A table is a collection of related data held in a table format within an SAP (or non-SAP) system. It consists of columns, and rows.

Extractor: An extractor is a pre-defined SAP program that gathers data from various tables in an SAP source system (typically SAP ECC) then processes this data to create specific business content for insertion into another SAP system (such as SAP BW or SAP IBP).

Function: An SAP Function (or Function Module) is a pre-written custom program that typically extracts data from an SAP system and writes this to output fields or tables (that can be read by SAP CPI-DS).

Once the table meta data is imported we can see the column Names and data types in details tab, as shown below.

Create the Target Datastore by following the above steps and import the target table meta data.

Conclusion:

Now we have imported the Source and Target tables metadata. In Part 2 of the blog series, we will create Tasks, Processes, and Projects in SAP CPI-DS.

Reference:

https://help.sap.com/

[MichaelMack]

Great start. I like it. Can't wait to read part 2!

[Geetha_Madhuri_Bobbili]

Thank you Michael 🙂

[Manish]

Well articulated blog 👍🏻👍🏻

[former_member182998]

Very Well Articulated ! !

[Geetha_Madhuri_Bobbili]

Thank you Yogesh 🙂

[former_member678011]

A Good blog to start with !

[Geetha_Madhuri_Bobbili]

Thank you Sivakumar 🙂

[former_member690424]

Thank you. Very informative and detailed. I could easily co-relate with sap data services designer functionality. Nice blog!

[Geetha_Madhuri_Bobbili]

Thank you Parvaiah 🙂

[former_member609638]

Hi Geetha/All

Its a informative blog.

We are trying to find out

1. how we can migrate SAP Data Services on premise to SAP Cloud Platform? Is this possible?


2. Also, how the jobs are migrated from on-prem to cloud platform?

Please provide some inputs.

Thanks,

Shubha

[former_member774823]

Nice Explanation.

 

May I request you what is the future CPI-DS roadmap

[former_member664857]

Hello Geetha, great blog. I have a quick question, what is the difference between CPI DI and CPI DS? Cant CPI DI perform the same function?

[IADEJOH]

Thank you.

Well articulated

[MarceloMorais]

Excellent blog!

 

Can you confirm if CPI is now part of BTP?

 

Thanks!

[former_member5846]

Impressive Documentation with full of information

[jidnesh_ap]

Do you have any pointers for connecting EDL (Enterprise Data Lake) to CPIDS?

[Yogesh14]

Hi Geetha,

Very good article on integration of SAP IBP with on-prem server.

Can you please share some insight on SAP IBP integration with S/4HANA cloud server (not on-prem)? is there any different method to integrate cloud-based S/4HANA server with SAP IBP?

Thanks & regards,

Yogesh

[narutoboruto]

Hi Geetha,

 

Excellent blog! Thank you for this.

 

We are also trying to setup CPI DS. SAP CPI DS is now part of SAP BTP and I am having hard time finding the agents page.

 

Could you please share the URL or the path from where I can download the agent.

 

Thanks & Regards,

Sumanth

[praveensahu123]

Hi Geetha,

 

Please help to share details it is urgent .

 

I am  trying to setup CPI DS. SAP CPI DS is now part of SAP BTP and I am having hard time finding the agents page.

 

Could you please share the URL or the path from where I can download the agent.

 

Thanks & Regards,

Praveen

[praveensahu123]

Hi Geetha,

I am also trying to setup CPI DS and having hard time finding the agents page.

Please help to share the URL or the path from where I can download the agent.

 

Thanks,

Praveen Sahu

[bruno202006]

Hi Praveen,

CPI-DS is an integration interface specific to IBP, the agent can be downloaded from the original Logon page of CPI-DS and you have separate agent tab as shown in the first screen by the blogger.

Check if you are using CPI-DS for IBP or any other purpose. Because each Agent has different purpose to serve example: HANA SDI DPO (Data provisioning Agent) meant for Data sphere etc and like wise.

If you are talking about CPI (Cloud Platform Integration for S4HANA and other Cloud integration )  it comes with additional license and it shared by SAP.

You need access and License with S-user Administrator account to download from the software center.

https://me.sap.com/softwarecenter/template/products/%20_APP=00200682500000001943&_EVENT=DISPHIER&HEA...

The below highlighted in yellow says that you have access and it will direct you to the download center.

Cheers..

[rajeshps]

 Hello @Geetha_Madhuri_Bobbili 

Is it possible to connect from SAP DI to SAP CPI using CPI-PO operator?

or

CPI can use https sender(BW4System and TokenService) to consume data from BW4HANA ADSO directly?

Please throw some heavy light since this topic is too non transparent.

Flow: BW4HANA -> SAP DI -> SAP CPI -> S4HANA /ECC

[Mahesh_Reddy_CPI]

Excellent blog! Good Work @Geetha_Madhuri_Bobbili