How to handle source data split over multiple files?

[Former Member]

Hi All,

I have a requirement to process source data where the data maybe split over multiple files. The data maybe split as shown below.

I am only concerned with the section header and row data. I need to be able to refer to the section header data from file1 when processing the data in file n+1.

The file naming convention is xxx-yyyymmdd.sequenceNumber.version.format. The final file is determined by the fact that it contains a record footer and record count section. My initial thinking is that stitching the files together prior to processing in PI would be cumbersome since you can't just append the data to the end of the previous file.

Any suggestions where I may start looking to find how to handle this scenario would be much appreciated.

regards

Julian

[anupam_ghosh2]

Hi Julian,

                   You can use java mapping to resolve this problem.

The mapping will split the source file and produce smaller files as per your requirement. No need to use FCC inreceiver file adapter. You can make use of ASMA to generate the filenames.

Regards

Anupam

[Former Member]

This message was moderated.