Problem with Push Down SQL while using Validation transform SAP Data Services 4.3

[former_member701816]

Hi,

I have a job where I have a Validation transform. To improve performance I have added a data transfer as below.

Dataflow Logic.

Source file >> Query Transform>> Validation transform >>> Data Transfer (Validation fail)

>> Query Transform ( Validation fail Left outer 2 more QTs)>> HANA Target

Data Transfer Type: Table (HANA Datastore)

Problem: The validation fail columns such as DI_ROWID, DI_ERROCOLUMNS are not being pushed down properly.

Error: DI_RowID not present in 'TBL02_001' (code Highlighted in Italics).

Pushed Down Query:

CREATE PROCEDURE "DS_DATASOURCE"."DS_PROC_2E543CD49C237680318D12_CV_LDR" (OUT VAR_DS_TT_2E543CD49C237680318D12 "DS_DATASOURCE"."TBL_MASTER_FAIL_1", OUT VAR_NUM_ROWS INTEGER )

LANGUAGE SQLSCRIPT AS

BEGIN

TBL02_001 = SELECT "KEY_ID" "KEY_ID","Col1" "Col1","Col2" "Col2","DI_FILENAME" "DI_FILENAME","LAST_LOAD_DATETIME" "LAST_LOAD_DATETIME"

# ---------------------------------------------------------------------------------------------------DI_RowID not appearing here.

FROM "DS_DATASOURCE"."LOAN_MASTER";

TBL02_002 = SELECT count( * ) "Total_Record_Count", "DIDT_Data_Transfer_Q41"."DI_FILENAME" "DI_FILENAME"

FROM "DS_DATASOURCE"."MASTER" "DIDT_Data_Transfer_Q41"

GROUP BY "DIDT_Data_Transfer_Q41"."DI_FILENAME" ;

TBL02_004 = SELECT count( * ) "Rejected_Record_Count", "DIDT_Data_Transfer_240_1_2"."DI_FILENAME" "DI_FILENAME"

FROM "DS_DATASOURCE"."MASTER" "DIDT_Data_Transfer_240_1_2"

GROUP BY "DIDT_Data_Transfer_240_1_2"."DI_FILENAME" ;

QRY02_005 = SELECT "TBL02_001"."DI_FILENAME" "FileName", "TBL02_002"."Total_Record_Count" "Total_Record_Count", "TBL02_004"."Rejected_Record_Count" "Rejected_Record_Count", "TBL02_001"."DI_ERRORCOLUMNS" "Rejected_Reason", "TBL02_001"."Key_ID" "Key_ID", "TBL02_001"."Col1" "Col1", "TBL02_001"."Col2" "Col2", "TBL02_001"."Last_Load_Datetime" "Last_Load_Datetime", "TBL02_001"."DI_ERRORACTION" "ERRORACTION", "TBL02_001"."DI_ERRORCOLUMNS" "ERRORCOLUMNS", "TBL02_001"."DI_ROWID" "ROWID"

# -----------Error here-----------------------------------------------------------------------------------DI_RowID appearing here.

FROM (:TBL02_001 "TBL02_001" LEFT OUTER JOIN :TBL02_002 "TBL02_002" ON "TBL02_001"."DI_FILENAME" = "TBL02_002"."DI_FILENAME" ) LEFT OUTER JOIN :TBL02_004 "TBL02_004" ON "TBL02_001"."DI_FILENAME" = "TBL02_004"."DI_FILENAME" ;

SELECT COUNT(*) INTO VAR_NUM_ROWS FROM :QRY02_005;

VAR_DS_TT_2E543CD49C237680318D12 = SELECT "FileName" "FILENAME","Total_Record_Count" "TOTAL_RECORD_COUNT","Rejected_Record_Count" "REJECTED_RECORD_COUNT","Rejected_Reason" "REJECTED_REASON","Key_ID" "Key_ID","Col1" "Col1","Col2" "Col2","Last_Load_Datetime" "LAST_LOAD_DATETIME","ERRORACTION" "ERRORACTION","ERRORCOLUMNS" "ERRORCOLUMNS","ROWID" "ROWID" FROM :QRY02_005;

END;

Kindly Help.

[denise_meyer]

Hello,

Suggest you log a case for support so they can take a look at the job with the issue in detail.

Thanks,
Denise
SAP Support