Group BY Issue in CPI-DS

[former_member627794]

Hi CPI-DS Experts,

We have a flat file (.CSV) and it contains 3 fields as below.

Field1 Varchar(4)

Field2 Varchar(18)

Field3 Varchar(14)

In the aggreagration transformation, i have used Group By option and mentioned all the 3 fields to delete the duplicates rows. However, few rows which are not duplicated is also getting deleted.

For Example (Flat file contains):

Field1 Field2 Field3

1234 3456789 20210322045300

1234 3456789 20210322045300

1235 3456789 20210322045300

1235 3456789 20210322045300

Expected Result

1234 3456789 20210322045300

1235 3456789 20210322045300

Somehow for some of the records only one record 1234 3456789 20210322045300 is coming and other record is getting deleted. Could you please let us know the issue.

Thanks & Regards,

Nagaraju.

[former_member678011]

Hi Nagaraj,

Instead of using aggregation try using a Query transform (one to one mapping) and enable SELECT DISTINCT in Filter step.

Hope that solves your requirement.

Regards,

Sibi