Delimiter in the Source Data

[Former Member]

Hi All,

We are using BODS 3.2 on linux.

How should we handle when a delimiter is present in the source data.

For example:

We have CSV file as the source, The file has comma ',' as part of the data in one of the columns. When we execute the job it throws an error :

"A row delimiter was seen for row number <1> while processing column number <n> in file"

How do we handle these ( if a column delimiter is present in data)?????

[jones_joseph]

In the File Format editor set the delimiter for text to " (default is {none})

[Former Member]

Hello

I am facing the same issue, actually client doesn't have any idea about his data.

How should we handle when a delimiter is present in the source data (Flat File) through BODS.

We are on SAP BW 7.4 & BODS 4.2.

Any solution on same…? Its very argent.

Thanks in advance

[former_member186897]

pre-process the source data and replace the delimiter (comma) with any uncommon character like tilt ( ~ ). Later this new character shall become your column seperator (when you generate the text file) instead of comma.

I had faced this issue of delimiter in one of the earlier project and solved that this way.

[Former Member]

Hi Mohammad,

can you please tell me how to preprocess the souce data ?

The source file in my case has column delimiter as |

but the text also has pipe |

can you tell me how to read the CSV and preprocess and the replace the delimiters ?

or is it not possible ?

Thanks

[paul_kessler]

You did not say if you change the source file's field delimiter or added field framing characters. If you changed the delimiter in the source file, did you also change the delimiter setting in the File Format object?

[Former Member]

Hi Paul Kessler,

We have added field framing characters.

Regards,

Santosh

[warwick_tagg]

If you haven't done so already, you need to specify the text delimiter in the File Format. This will bypass any commas present within a field that are not actual field delimiters.

[Former Member]

Under Delimiters/Text within the file format type in ". The error should go away. The Delimiters section should look this:

Column - Comma

Row - {new line}

Text - "

[warwick_tagg]

Do you have any scope to change how the source file is produced?

Can you get the file produced with a different delimiter?

If not, could you use a text delimiter (") to indicate the start and end of a column, which is then comma delimited? (i.e. "Column 1 text","Details of column, and other information","Column 3")

[Former Member]

Thanks Warwick Tagg,

We are getting the source data just the way u have mentioned, but still facing the error.

Regards,

Santosh