Raw items in pending status, data loading is complete

[former_member570877]

I am getting an error in production,

Data is loaded into raw in ABC pool and raw item is in pending state for more that 12 hrs , meanwhile orders are getting processed by datahub in order pool and invoice in global pools in parallel continuously .

items are getting loaded in ABC pool where no other item is processing ,

Why composition of ABC pool is getting stucked due to composition running in other pools.

Here data set is huge in all the pools. Any lead would be appreciated.

Thanks

[Slava]

1. What is DataHub version?

2. Does it run in IN_MEMORY or STANDARD mode?

3. Do you use SAP extensions?

[former_member570877]

Hi Slave

I am using datahub 5.2, How to check mode in datahub? Yes i am using sap extensions as well custom extenstions.

This issue is happening only in production , where datahub is processing lots of data simultaneously but in different pools.

Thanks

[former_member387866]

Hi Vikram,

Updated Answer: If manually triggering the Compositions work, please write an extension, based on the "Monitoring Long Running Publications" link below. This extension will poll the pool to see if there's a Composition running, if not it will check for the PENDING, then trigger the Composition on the pool.

Otherwise, I suggest upgrading your hybris Commerce Suite to 6.x and the 6.x Data Hub versions have Hybrid Adapters that'll allow you to keep Data Hub Versions up to date without needing to upgrade hybris Commerce Suite.

---

Older Answer: Examine your Hybris Commerce Suite logs for the data that is imported by this pool and feed for errors.

The Pool and Feed could still be waiting on a Hanging Publication to finish. You may need to manually fail this publication, there is a Long Running Publications feature that will automatically fail the hanging publications.

Documentation: Troubleshooting Guide | Monitoring | Monitoring Long Running Publications.

Regards,
Luke

[former_member570877]

Hi Luke

There is no error in logs,

Composition is not failed, it is in pending status. Failing will hinder the replication of already pushed items.

Thanks

[former_member387866]

Hi Vikram,

I have updated my answer, suggesting that your team write a Data Hub Extension to monitor this behaviour.

Regards,
Luke

[Former Member]

Probably the autocompose is not enabled for ABC pool.
Check your properties file for "yourExtension.autocompose.pools" property.

You should have something like this:
myextension.autocompose.pools=ABC,DEF,GLOBAL

[former_member570877]

It is enabled. This issue is happening only in production.

In local everything is working fine.