Download of IBP Master Data via CPI

[willsuus]

I have a task set up in CPI to download master data from IBP (CustomerProduct). When the file is generated, I have the following 2 issues:

1. Missing entries

2. Entries in the file are listed 3x each

Does anyone have any idea why either of these would be occurring or what needs to be done to resolve each issue?

Thank you in advance for any help you can provide.

[riyazahmed_ca2 · Accepted solution]

Hi Susan,

1) Missing entries - Check the filters, lookups and joins.

2) Duplicated or nX entries. - I'm not sure whether you use features like Row Generation or Performing the joins. This may result from either of this case. If you aren't using any of them, Enable 'Distinct Rows' under Filter tab for each Transformation.

Some more analysis specific inputs are

1) Use 'Monitor Logs' option to see how many records are collected by the 1st Transform, how it is segregated or transferred to 2nd Transform and so on.

2) Also see whether you are downloading from Master Data table or from the Calculated view.

Let me know your issues further with the snapshot of the data flow and monitor log.

Best Regards,

Riyaz

[willsuus · Accepted solution]

Hello Riyaz,

Thank you for your feedback. Enabling the 'Distinct Rows' resolved the duplicate entries. I hadn't seen that check box - I appreciate you pointing it out.

I still have the issue of the missing entries. I only have the source feeding into the data flow which goes to the target - so only one transformation - which has no filters. I am doing the download from the Master Data table (not the calculated view). I will see if I can find anything in the log.

Again, thank you,

Susan

[willsuus]

The first issue, missing entries, was resolved by changing the source. I had originally used the staging table not the actual table in the system.