Question Marks in Black Diamond_ Encoding Issue

[#1]

Hi Experts,

I have a csv file encoded in UTF-8 (without BOM) coming from a sender system. The file has spanish characters in it.
When read in PI, the spanish characters are converting to a question mark in black diamond.

Shouldn't UTF-8 be able to handle this?

Can you please help in resolving this issue? I am using SFTP adapter at sender.

Thanks,

Shubham

[sawantsup]

Hi Shubham,

Could you please check with your source application team if the file encoding is properly done or no? If the file has properly been encoded, then changing the encoding in channel should solve the issue.

Regards,
Supriya.

[Former Member]

Hi Supriya,

Yes, the file is encoded correctly in UTF-8.
I found out that all lower case special characters are translating correctly,but special characters in upper case are not.

Would you have any idea why could this be happening?

Thanks in advance.

Regards,

Shubham

[sawantsup]

Hi,

You can change the encoding to the required one (Eg: ISO-8859-1) using encodingFormat parameter on sender channel. Please check SAP note 2544233.

Regards,
Supriya.

[Former Member]

Hi Supriya,

Thanks for your response. I tried doing that and was able to retrieve only of the special characters successfully, but not all. For other it still showed diamond question marks along with what I think is character reference (Not sure though).

I tried with encodingFormat= ISO-8859-1 and ISO-8859-15.

Input:

Output:

Can you please tell what could be wrong?

Thanks,
Shubham