what is the most efficient to ccnnect PI with ERP

[angeloruggiero]

Hello,

I have an on prem PI system is connected via REST to an ERP system

The PI system is using an kafka adaper to read lets say 5 million records. I can easily test this.

I am trying to make it run quicker by scaling up first. i.e i can add cpu and ram fairly easily.

The reading of the kafka topic is ok. About 1.5 hours but the calling of the REST service and the custom code on the other side takes so much cpu and time on both sides. I just did a test and it took 4 hours just to send that many requests.  I know as I loaded all the kafka messages first into PI/PO then stopped the kafka connection and let it run the REST adapter.

I known how to scale up the ICM and disp processes etc and just about to do so in the next few days in my test environment. And I know there is some parallism thing I am playing with to scale up the PI REST Adapter to ERP.

But then i had a thought..... is REST between SAP PO/PI and SAP ERP really the most efficient way. 

PI/PO is surely for non-sap systems my source Kafka is non PO ok but my sink is ERP! 🙂

Is there not some more native connection between the two that is more efficient. I am not a SAP person and for various reasons do not have full access to a Basis Person so sort of learning by myself with some great help.

This is an onprem  ERP R3 running on oracle as is the PI all running on either LPAR for the ERP or RHEL on vmware for the PI. I do not need PI/PO for anything else as the Kafka adapter part. 

Looking forward to some creative ideas to make this run much quicker with less hardward. Which I can do but.... 🙂

Cloud even the adapter in the cloud is not an option.