Query with SAP Note 3508244 - Incompatible Change in Data Lake SQL on Files Behavior in QRC 4/2024

[KarthikKumar31]

As the Data lake Relational Engine native SQL on Files will be removed in QRC 4/2024, I was checking the SAP Note 3508244 - Incompatible Change in Data Lake SQL on Files Behavior in QRC 4/2024 

According to this Note, I created a Remote Source REMOTE_SOF and Virtual Table in SAP HANA Database using the below command 

CREATE VIRTUAL TABLE NATION(N_NATIONKEY INT, N_NAME VARCHAR(25), N_REGIONKEY INT, N_COMMENT VARCHAR(152)) AT REMOTE_SOF."/nation.csv" AS CSV FIELD DELIMITED BY ',';

The table was created successfully. However, when I try to execute the below select query

SELECT * FROM NATION;

The last entry in the nation.csv file is not getting displayed in the query output. Has anyone encountered a similar issue? If so, could anyone please provide guidance or kindly suggest a resolution?"

[KarthikKumar31 · Accepted solution]

Hi @RobertWaywell / @Dan_vL , 

Thanks for taking your time in checking my query.

This is to confirm that upgrading HANA Cloud DB to version 2024.40.10 (QRC 4/2024) will fix this issue. We tried from our end. It worked!. 

[RobertWaywell]

You should be opening a Support case for this. Since you are able to query the SoF table and get the rest of the records from the CSV file, it is clear that you have properly created the the SoF table. Since the the table is configured properly, the fact that the last record from the CSV file is not being returned in the result set is something that you should submit as a Support incident. 

[KarthikKumar31]

Thanks Robert, we will raise the SAP OSS incident for this. Just wanted to check if anyone faced similar issue

[Dan_vL]

I have also seen this issue. A workaround is to ensure that the last row of the CSV file ends with a newline character.