DataHub - remove items leading to error

[nicolabeghin-263]

Hi everyone does anyone know how to delete [target] items failing from the DataHub?

Failed to create a target item from CanonicalItem{id='1111269', integrationKey='XXX_MK|300|PRG_LG|F018282822', status=SUCCESS, dataPool='DataHubPoolEntity{id=0, name=GLOBAL}', batchId=0000000002139262|PRG_LG|MATMAS05, traceId=eb43bd3a-9f28-3dbf-92bc-55a9944e2978, uuid=6d5c1a90-190c-4411-8812-ad5c18b00905, documentId=F018282822, fields='{categoryType=300, attributeID=C_ZERO3_MK, productID=F018282822, attributeValue=[000 com.hybris.datahub.service.spel.TransformationExpressionException: Could not transform by expression resolve('CanonicalProduct').baseProductID + ':Default:Staged'

When a client sends incorrect data we would like to have a way to delete canonical items leading to erroneous/failing target items, in order to avoid daily retries leading to daily errors.

thanks nicola

[former_member333910 · Accepted solution]

By default, a Canonical item which fails to publish (either due to Target item creation failure or a publication error reported from the target system) will remain eligible for publication on subsequent publication actions. The datahub.max.publication.retry.count property drives the number of times an item will be attempted to be published. The default value for this property is 10. You can lower this value to reduce the number of times an item will be attempted to be published. Lowering the value to 0 will eliminate retry behavior altogether.

Data Hub does have delete functionality. See the Deleting a Canonical Item section of this documentation page. And also the Deleting Canonical Items by Raw Item page. However, this will result in the Canonical item being published to the Target system with a delete status. It won't prevent it from being published altogether.

[nicolabeghin-263 · Accepted solution]

thanks a lot, really helpful!