Products loading from SAP to Hybris taking long time through datahub.

[Former Member]

Hi Team,

• We are trying to load product data(contains 20 attributes like article number, description, name etc.,) from SAP to Hybris.

• We are loading approximately 1000000 products from SAP to hybris.

• Initially around 200000 data loaded fast into hybris, after that product loading is slowed down.

• At the initial stage, it was loaded around 30 items/sec after that it reduced to less than 1 items/sec.

• Due to this, our seeding process from SAP to Hybris is taking long time and waiting. Other publication id's are in PENDING or IN_PROGRESS State.

• I assume each and every product will verify internally in Hybris to see if the same product does not exist in hybris then it will load the data otherwise throws an error saying that product already exists in the Hybris.

• How to control this internal checking to increase the processing speed.

• Due to this slow processing speed, all the remaining pending items are added to one publication and trying to get loaded into hybris through one publication and hanging in hybris.

• Can anyone help me to resolve this issue?

Thanks,

Suresh G.

[Former Member]

Hi Suresh,

Please see the following document regarding suggestions for improving Datahub performance: https://help.hybris.com/6.7.0/hcd/ee4c3f4f726e4b39ada3ae3896b9f4b0.html

[nicolabeghin-263]

Hi Suresh did you try enabling Datahub cleanup extension? If the datahub db does not get cleaned up performance rapidly degrades.

https://help.hybris.com/1808/hcd/64eb8ab0622046459cdbe9af78cdc80c.html

 datahub.cleanup.rawitem.enabled=true
 datahub.cleanup.canonicalitem.enabled=true
 datahub.cleanup.targetitem.enabled=true
 datahub.cleanup.publisheditems.enabled=true

[Former Member]

Hi Nicola,

Thanks for your reply,

We already enabled the properties which you have mentioned in datahub.