Question Re: Reading CSV file using Message Transforom Bean in Technology Q&A

Reading CSV file using Message Transforom Bean

former_member270218 — Tue, 25 Oct 2016 10:47:43 GMT

Hi All,

I was working on SFTP adapter which picks the CSV file that needs to convert into XML. So i am using Message Transform Bean module for conversion. PI version is 7.31 dual stack.

Below are the config done in channel.

When the channel is picked the file payload is looks like below.

The channel was reading the filed names from the CSV file. I want to ignore that and also there is "" symbol for the values that needs to be ignore. So please suggest to resolve this.

Regards,

Raju

Re: Reading CSV file using Message Transforom Bean

Ryan-Crosby — Tue, 25 Oct 2016 13:22:15 GMT

HI Raju,

Add xml.enclosureSign = " for it to remove the double quotes around each field. As far as the header stuff you are getting information from the structure based upon the key xml.processFieldNames = fromConfiguration. That is instructing the MTB to read the data from your configuration so you should not observe any case where it is reading from the file itself.

Regards,

Ryan Crosby

Re: Reading CSV file using Message Transforom Bean

former_member270218 — Tue, 25 Oct 2016 13:39:26 GMT

Hi Ryan,

Thanks for the reply. How to ignore the header line from file. Header line contains the field names.

Regards,

Raju

Re: Reading CSV file using Message Transforom Bean

Ryan-Crosby — Tue, 25 Oct 2016 14:06:11 GMT

Hi Raju,

You could try xml.documentSkipFirstRows = 1 to see if it ignores the header line. If that does not work for the SimplePlain2XML then you would have to handle that in some type of mapping or request that the header line be dropped from the source.

Regards,

Ryan Crosby

Re: Reading CSV file using Message Transforom Bean

former_member270218 — Tue, 25 Oct 2016 14:53:39 GMT

Thanks Ryan for the response. Now the " was removed from the data. But now " was coming in the nodes.

Example: <"Form Template ID">321</"Form Template ID">

How to remove the " from the tag. Please respond asap.

Re: Reading CSV file using Message Transforom Bean

Ryan-Crosby — Tue, 25 Oct 2016 15:10:33 GMT

Hi Raju,

Can you share a screenshot of your current MTB configuration?

Regards,

Ryan Crosby

Re: Reading CSV file using Message Transforom Bean

Ryan-Crosby — Tue, 25 Oct 2016 15:12:53 GMT

Hi Raju,

Also, you can try adding xml.enclosureSignEsc = "" into your configuration but not sure if that impacts node names. That should be reflected from the value in xml.fieldNames.

Regards,

Ryan Crosby

Re: Reading CSV file using Message Transforom Bean

former_member270218 — Tue, 25 Oct 2016 15:14:54 GMT

Above is the configuration from the channel

Re: Reading CSV file using Message Transforom Bean

former_member270218 — Tue, 25 Oct 2016 15:17:36 GMT

I have tried as suggested. But it didn't worked out.

Re: Reading CSV file using Message Transforom Bean

Ryan-Crosby — Tue, 25 Oct 2016 15:21:16 GMT

Hi Raju,

Change your configuration on the xml.processFieldNames from "fromFile" to "fromConfiguration" and switch xml.documentSkipFirstRows = 1. If you intend to keep the header with the "fromFile" option then you would need to remove the " characters from the header line in the file.

Regards,

Ryan Crosby

Re: Reading CSV file using Message Transforom Bean

former_member270218 — Tue, 25 Oct 2016 15:25:57 GMT

Hi Ryan,

I have tried as suggested by you. Now the " removed. But field names from the files is also coming in payload which should be ignored.

used xml.documentSkipFirstRows = 1.

Regards,

Raju

Re: Reading CSV file using Message Transforom Bean

Ryan-Crosby — Tue, 25 Oct 2016 15:30:51 GMT

Hi Raju,

It appears that that parameter xml.documentSkipFirstRows does not work for SimplePlain2XML so you would have to suppress it in a mapping or use StructPlain2XML instead.

Regards,

Ryan Crosby

Re: Reading CSV file using Message Transforom Bean

former_member270218 — Tue, 25 Oct 2016 15:41:27 GMT

Could you please share any link which specifies the StructPlain2XML

Re: Reading CSV file using Message Transforom Bean

Ryan-Crosby — Tue, 25 Oct 2016 15:44:03 GMT

Hi Raju,

I would refer to this blog by Eng Swee: MTB Blog

Regards,

Ryan Crosby