Application Development and Automation Discussions
Join the discussions or start your own on all things application development, including tools and APIs, programming models, and keeping your skills sharp.
cancel
Showing results for 
Search instead for 
Did you mean: 
Read only

OPEN DATASET UTF-8

former_member299080
Participant
0 Likes
721

Hi,

As a part of Unicode conversion project activities, we have changed

about 300 programs dealing with the uploading and downloading of the

files on the application server. The changes applied into these

programs are mainly with the "OPEN DATASET" syntax. Below is the new

Unicode compatible syntax added by the development team:

OPEN DATASET <outfile> FOR OUTPUT IN TEXT MODE ENCODING UTF-8 IGNORING

CONVERSION ERRORS.

(Please note that the encoding is hard coded as UTF-8)

The issue is that even though we are forcing the encoding to be

UTF-8, the format of the output file is not consistent. We are getting

two different formats i.e. Unicode UTF-8 and Western European ISO-8859,

depending whether Unicode characters like (Euro symbol), special

characters are present in the file data.

Per our observation, the file format is Western European if the data

contains only A to Z (characters) and/or 0 to 9 (numbers) & the file

format is UTF-8 for anything other than A to Z and 0 to 9.

Thanks.

Marco

1 ACCEPTED SOLUTION
Read only

nils_buerckel
Product and Topic Expert
Product and Topic Expert
0 Likes
582

Hi Marco,

actually there is no difference between ISO-8859-1 (Western European ISO-Latin-1) and UTF-8 regarding the "US7ASCII characters" (mainly A-Z and 0-9).

Therefore the format should be always UTF-8.

Best regards,

Nils Buerckel

Hi Marco,

actually there is no difference between ISO-8859-1 (Western European ISO-Latin-1) and UTF-8 regarding the "US7ASCII characters" (mainly A-Z and 0-9).

Therefore the format should be always UTF-8.

Best regards,

Nils Buerckel

1 REPLY 1
Read only

nils_buerckel
Product and Topic Expert
Product and Topic Expert
0 Likes
583

Hi Marco,

actually there is no difference between ISO-8859-1 (Western European ISO-Latin-1) and UTF-8 regarding the "US7ASCII characters" (mainly A-Z and 0-9).

Therefore the format should be always UTF-8.

Best regards,

Nils Buerckel