SAP BPC EPM Data Manager Package fails with error on default logic ()

[leonel_mario]

Hello,

I recently came across an issue in my project where a data manager package that was running fine, for quite sometime suddenly starts failing with below-

-----------------------------------------------
'Error running Default logic'

Member XXXX does not exist
-----------------------------------------------

An overview of the process - The data manager loads data from the BW ADSO to BPC through a [Delta Load from BW Infoprovider]. Sometimes, the master data doesn't exist for the data that is being loaded from the ADSO but this has been overlooked and it runs with a warning. But, very recently, the Data manager started failing and the message with Default Logic error.

The Default Logic has an Include Logic which calls the BADI 'UOM_CONVERSION' while passing it parameters. I read through some similar posts like this to validate and save Logic files. I have done all that but to no avail.

Another observation was if the include logic file is commented out of the default logic then the Package runs with a warning.

Please review and advise.

Also before I forget -

SAP BPC 10.0 for SAP NW SP35

Thank you.

Regards,

Leonel

[former_member186338]

Sorry, but do you really want an answer without providing the text of your default.lgf file? And some info about badi? Is it a jpke?

[leonel_mario]

Thanks Vadim.
This is the include in the Default file
*INCLUDE CALC_UOM_CONVERSION.LGF

And this is the Calc_UOM_CONVERSION logic file

==============================================================
*SELECT(%CONV_GRP_ACCTS%,[ID],ACCOUNT,[UOM_CONV_GRP]<>'')

*SELECT(%AUDITS_TO_BE_CONVERTED%,[ID],AUDIT_MARGIN,[UOM_CONV_SRC] = 'Y')

*FOR %CATEG% = %CATEGORY_SET%

*XDIM_MEMBERSET CATEGORY = %CATEG%

*XDIM_MEMBERSET PROFITCENTER = %PROFITCENTER_SET%

*XDIM_MEMBERSET ACCOUNT = %CONV_GRP_ACCTS%

*XDIM_MEMBERSET AUDIT_MARGIN = %AUDITS_TO_BE_CONVERTED%

*XDIM_MEMBERSET FUNCTIONALAREA = BAS(ABC)

*XDIM_FILTER RPTCURRENCY = [RPTCURRENCY].Properties("ID") = LC

*START_BADI UOM_CONVERSION

QUERY = ON

WRITE = OFF //BADI will save results by package

DONT_RUN_ON_CAT_TYPES = ACTUAL//Don't run on Category type = ACTUAL

SKIP_FCST_ACTUAL_PERS = Y//Skip Actual Periods for FORECAST Categories

SKIP_BLINE_ACTUAL_PERS = Y//Skip Actual Periods for BASELINE Categories

*END_BADI

*NEXT

===================================================================

[former_member186338]

Full default.lgf - please!!!

Not only include!

Full log with error.

[leonel_mario]

The Load Transaction from BW Infoprovider Delta - Package Log

/CPMB/MODIFY completed in 0 seconds

/CPMB/SOURCE_DELTA_IP completed in 1 seconds

ZBPC_SEND_EMAIL completed in 0 seconds

/CPMB/CLEAR completed in 0 seconds

[Selection]

--------------------------------------------------------------

INFOPROV_INIT_NAME = DELTA_XXX_ACT

RUNLOGIC = Yes

CHECKLCK = No

KEEPREJDATA = Yes

EMAIL_IF_SUCCESS = No

ADD_PACK_LOG_TO_EMAIL = Yes

[Message]

--------------------------------------------------------------

Task name SOURCE DELTA INFOPROVIDER:

Suppressed zero-value records: 906

Error running default logic ()

Member "E9476" not exist

Submit count: 906

Reject count: 697

model: MRG.

Package status: ERROR

======================================================================

The UJKT returns this when executing the Code.
LOG:

FILE:\ROOT\WEBFOLDERS\CASCADESGOLD \ADMINAPP\MARGIN\TEST.LGF

USER:SLEO00364A

APPSET:CASCADESGOLD

APPLICATION:MARGIN

Data Region:

[WARNING!] NO MEMBER SPECIFIED FOR DIMENSION:PARTNER_PCTR WILL QUERY ON ALL BASE MEMBERS.

[WARNING!] NO MEMBER SPECIFIED FOR DIMENSION:PLANT WILL QUERY ON ALL BASE MEMBERS.

[WARNING!] NO MEMBER SPECIFIED FOR DIMENSION:PRODUCT WILL QUERY ON ALL BASE MEMBERS.

[WARNING!] NO MEMBER SPECIFIED FOR DIMENSION:SHIP_TO WILL QUERY ON ALL BASE MEMBERS.

[WARNING!] NO MEMBER SPECIFIED FOR DIMENSION:SOLD_TO WILL QUERY ON ALL BASE MEMBERS.

[WARNING!] NO MEMBER SPECIFIED FOR DIMENSION:TIME WILL QUERY ON ALL BASE MEMBERS.

[WARNING!] MEASURES IS NOT SPECIFIED!

CATEGORY:ACTUAL,1 in total.

PROFITCENTER:9476,1 in total.

ACCOUNT:QTY_PROD_BUOM,QTY_PROD_CS,QTY_PROD_CSC,QTY_PROD_CSE,QTY_PROD_KG...52 in total.

AUDIT_MARGIN:VOLUME_DIST_CALC,VOLUME_INP,2 in total.

FUNCTIONALAREA:FA_NA,NO_FUNCTIONALAREA,Z001,Z003,Z004...82 in total.

RPTCURRENCY:LC,1 in total.

PARTNER_PCTR:[All base members]

PLANT:[All base members]

PRODUCT:[All base members]

SHIP_TO:[All base members]

SOLD_TO:[All base members]

TIME:[All base members]

QUERY TIME : 1.00 ms.

0 RECORDS QUERIED OUT.

Nothing Returned from SQE

QUERY TIME :1.00 S.

EXECUTION BADI:UOM_CONVERSION

QUERY: ON

WRITE: OFF

INFO: No data found for UOM Conversion.

BADI EXECUTION TIME IN TOTAL :0.00 ms.

SCRIPT RUNNING TIME IN TOTAL:1.00 s.

[former_member186338]

Sorry, but do you understand my questions?

I need your FULL default.lgf code! Full!!!

And if you have some includes in default.lgf - also the code of mentioned includes!

Also:

"Member "E9476" not exist" - what is the dimension of this member?

[leonel_mario]

Default.lgf was provided earlier in my comments with the code of the mentioned include.
*INCLUDE CALC_UOM_CONVERSION.LGF

And the include code ---

==============================================================
*SELECT(%CONV_GRP_ACCTS%,[ID],ACCOUNT,[UOM_CONV_GRP]<>'')

*SELECT(%AUDITS_TO_BE_CONVERTED%,[ID],AUDIT_MARGIN,[UOM_CONV_SRC] = 'Y')

*FOR %CATEG% = %CATEGORY_SET%

*XDIM_MEMBERSET CATEGORY = %CATEG%

*XDIM_MEMBERSET PROFITCENTER = %PROFITCENTER_SET%

*XDIM_MEMBERSET ACCOUNT = %CONV_GRP_ACCTS%

*XDIM_MEMBERSET AUDIT_MARGIN = %AUDITS_TO_BE_CONVERTED%

*XDIM_MEMBERSET FUNCTIONALAREA = BAS(ABC)

*XDIM_FILTER RPTCURRENCY = [RPTCURRENCY].Properties("ID") = LC

*START_BADI UOM_CONVERSION

QUERY = ON

WRITE = OFF //BADI will save results by package

DONT_RUN_ON_CAT_TYPES = ACTUAL//Don't run on Category type = ACTUAL

SKIP_FCST_ACTUAL_PERS = Y//Skip Actual Periods for FORECAST Categories

SKIP_BLINE_ACTUAL_PERS = Y//Skip Actual Periods for BASELINE Categories

*END_BADI

*NEXT

===================================================================

The Dimensions to which that source value E9476 are loaded to are Profit Center and PLANT

Thank you.

[former_member186338]

Sorry, but in you previous post was:

"This is the include in the Default file
*INCLUDE CALC_UOM_CONVERSION.LGF"

Please confirm that your default.lgf consists of the single line with the mentioned include!

"The Dimensions to which that source value E9476 are loaded to are Profit Center and PLANT" - what do you mean by this statement?

E9476 is not a value, it's a dimension member! May be it's not in BPC, but it's present in BW data load. What is the dimension of this member?

[former_member697410]

Hi Leonel,

I am facing a familiar issue, any resolution to yours? I have a logic included in the default logic, if it is commented out of default logic then the package runs successfully, else fails.

Thanks

BSV

[former_member186338]

bharath.sub

Sorry, but there are no "same" cases! Please ask a new question and provide full details!

Read: https://blogs.sap.com/2014/01/31/how-to-ask-questions-about-script-logic-issues/

[former_member186338]

I will create a new answer - the list of comments for the previous one is too long 🙂

1. Running default.lgf as an option of data load package.

It was always the rule that the initial scope of default.lgf launched after data load will receive the scope as a combination of members of all records successfully saved to the model. SAVED Record, not including rejected!!! Please provide details on your BPC/BW version/SP. Looks like there is some bug!

2. Error in the DM package log:

Error while running default logic

If I look on default.lgf log I see the reason:

Keyfigure (Signeddata) 16,072,860,052,782.0000000- is invalid due to overflow
Keyfigure (Signeddata) 12,556,921,916,235.9375000- is invalid due to overflow
Keyfigure (Signeddata) 14,130,082,247,948.1000000- is invalid due to overflow
Keyfigure (Signeddata) 11,039,126,756,209.4531250- is invalid due to overflow
Keyfigure (Signeddata) 15,856,153,455,534.0000000 is invalid due to overflow
Keyfigure (Signeddata) 12,387,619,887,135.9375000 is invalid due to overflow
Keyfigure (Signeddata) 14,074,689,171,774.9600000 is invalid due to overflow
Keyfigure (Signeddata) 10,995,850,915,449.1875000 is invalid due to overflow
Keyfigure (Signeddata) 15,894,097,331,040.0000000- is invalid due to overflow
Keyfigure (Signeddata) 12,417,263,539,875.0000000- is invalid due to overflow
Keyfigure (Signeddata) 16,351,092,486,378.0000000- is invalid due to overflow
Keyfigure (Signeddata) 12,774,291,004,982.8125000- is invalid due to overflow
Keyfigure (Signeddata) 16,351,092,486,378.0000000 is invalid due to overflow
Keyfigure (Signeddata) 12,774,291,004,982.8125000 is invalid due to overflow
Keyfigure (Signeddata) 16,443,617,988,000.0000000 is invalid due to overflow
Keyfigure (Signeddata) 12,846,576,553,125.0000000 is invalid due to overflow

INFO: Rule: SQL15_FX_AVG, Total Runtime:14.000  Records: 87384 .
BADI EXECUTION TIME IN TOTAL :19.00 ms.
MESSAGE FROM CUSTOM LOGIC:
Keyfigure (Signeddata) 16,072,860,052,782.0000000- is invalid due to overflow
Keyfigure (Signeddata) 16,443,617,988,000.0000000 is invalid due to overflow
Keyfigure (Signeddata) 12,846,576,553,125.0000000 is invalid due to overflow
Keyfigure (Signeddata) 14,047,680,555,689.6400000 is invalid due to overflow
Keyfigure (Signeddata) 10,974,750,434,132.5312500 is invalid due to overflow
Keyfigure (Signeddata) 16,441,590,597,246.0000000 is invalid due to overflow

Looks like badi generated error.

[leonel_mario]

Hello Vadim,

Please find the requested details -

SAP_BW7500010SAPK-75010INSAPBWSAP Business Warehouse

SAP BUSINESS PLANNING AND CONS10.513 (11/2017)sap.comSAP PC 10.1 FOR SAP NW

SAP EPM Version 10.0 SP35 Patch 1 .Net 4.7.2 x86.

Thank you.

[former_member186338]

leonel.mario

In general - BW750 SP10 is old and bad! You definitely need to upgrade to something more resent!

BW750 SP16+

[leonel_mario]

Hello Vadim,

The above results were from the modified logic in the script. I returned it to the original as below-

*********************************
Default.lgx
*********************************
// FA Derivation
*INCLUDE FA_DERIVATION.LGF
//UOM Conversion
*INCLUDE CALC_UOM_CONVERSION.LGF
// Revenue Accounts, COGS/COGM Accounts, Freight Cost Account Calculations
*INCLUDE CALC_DEFAULT_ACCTS.LGF
// Custom FX Restatement - Writes only Delta
*INCLUDE FXTRANS_AVG_COPYLC.LGF
//Transfer to Financial Model
*INCLUDE TRNF_TO_FIN_DEFAULT.LGF
*********************************
FA Derivation
*********************************
*FOR %CATEG% = %CATEGORY_SET%
*XDIM_MEMBERSET CATEGORY = %CATEG%
*START_BADI RUN_SQL_STATEMENT
QUERY = OFF
WRITE = OFF
DEBUG = OFF
LOG_SQL_STATEMENTS = OFF
RUN_SQL_STATEMENTS = ON
SQL_ID = SQL20_FA_DERIVATION
DEST_CATEGORY_ID = %CATEG%
*END_BADI
*NEXT
*COMMIT
*********************************
FXTRANS_AVG_COPYLC
*********************************
*FOR %CATEG% = %CATEGORY_SET%
*XDIM_MEMBERSET TIME=%TIME_SET%
//Run SQL Statement for FX AVG & COPYLC
*START_BADI RUN_SQL_STATEMENT
QUERY = OFF
WRITE = OFF
LOG_SQL_STATEMENTS = OFF
RUN_SQL_STATEMENTS = ON
SQL_ID = SQL14_FX_COPYLC,SQL15_FX_AVG
DEST_CATEGORY_ID = %CATEG%
RATE_ENTITY=Global
*END_BADI
*NEXT
*********************************
CALC_DEFAULT_ACCTS
*********************************
*FOR %CATEG% = %CATEGORY_SET%
*XDIM_MEMBERSET CATEGORY = %CATEG%
*XDIM_MEMBERSET AUDIT_MARGIN = BAS(TOT_BEFORE_ADJ)
//Run SQL Statements
*START_BADI RUN_SQL_STATEMENT
QUERY = OFF
WRITE = OFF
LOG_SQL_STATEMENTS = OFF
RUN_SQL_STATEMENTS = ON
SQL_ID = SQL10_CALC_USDINP,SQL03_CALC_REV,SQL04_CALC_DISCLM,SQL07_CALC_COGS,SQL09_CALC_FRTCST,SQL17_CALC_ACCTRN,SQL18_CALC_AUTOADJ,SQL19_CALC_AUTOADJ2
DONT_RUN_ON_CAT_TYPES = ACTUAL
DEST_CATEGORY_ID = %CATEG%
SKIP_FCST_ACTUAL_PERS = Y//Skip Actual Periods for FORECAST Categories
SKIP_BLINE_ACTUAL_PERS = Y//Skip Actual Periods for BASELINE Categories
*END_BADI
*NEXT
*********************************
CALC_UOM_CONVERSION
*********************************
*SELECT(%CONV_GRP_ACCTS%,[ID],ACCOUNT,[UOM_CONV_GRP]<>'')
*SELECT(%AUDITS_TO_BE_CONVERTED%,[ID],AUDIT_MARGIN,[UOM_CONV_SRC] = 'Y')
*FOR %CATEG% = %CATEGORY_SET%
*XDIM_MEMBERSET CATEGORY = %CATEG%
*XDIM_MEMBERSET PROFITCENTER = %PROFITCENTER_SET%
*XDIM_MEMBERSET ACCOUNT = %CONV_GRP_ACCTS%
*XDIM_MEMBERSET AUDIT_MARGIN = %AUDITS_TO_BE_CONVERTED%
*XDIM_MEMBERSET FUNCTIONALAREA = BAS(CASC)
*XDIM_FILTER RPTCURRENCY = [RPTCURRENCY].Properties("ID") = LC
*START_BADI UOM_CONVERSION
QUERY = ON
WRITE = OFF //BADI will save results by package
DONT_RUN_ON_CAT_TYPES = ACTUAL//Don't run on Category type = ACTUAL
SKIP_FCST_ACTUAL_PERS = Y//Skip Actual Periods for FORECAST Categories
SKIP_BLINE_ACTUAL_PERS = Y//Skip Actual Periods for BASELINE Categories
*END_BADI
*NEXT
*********************************
TRFN_TO_FIN_DEFAULT
*********************************
*SELECT(%DEST_AUDIT_LIST%,[DEST_FIN],AUDIT_MARGIN,[DEST_FIN]<>' ') //Dest AUDIT_FINANCIAL IDs
*FOR %CATEG% = %CATEGORY_SET%
*XDIM_MEMBERSET RPTCURRENCY = %RPTCURRENCY_SET%
*XDIM_MEMBERSET TIME=%TIME_SET% //Run SQL Statement to calculate the Assumptions and Std Cost Baseline Calculations
*START_BADI
RUN_SQL_STATEMENT
QUERY = OFF
WRITE = OFF
LOG_SQL_STATEMENTS = OFF
RUN_SQL_STATEMENTS = ON
SQL_ID = SQL23_TRNF_FIN_DEF
DEST_MODEL=FINANCIAL
DEST_MODEL_WB_USER=X0000BPCBGJB //Destination Model WriteBack User
DEST_CATEGORY_ID = %CATEG%
REPLACE_TRNF_DEF_PER_RANGES=Y
DEST_AUDIT_LIST=%DEST_AUDIT_LIST%
*END_BADI
*NEXT

Now, I have observed a couple of things here -

Prerequisite - The load from BW is from an ADSO and it is a Delta load to BPC. /CPMB/LOAD_DELTA_IP.

1 - When the load is the Delta /CPM_LOAD_DELTA_IP - I get the failed message -

/CPMB/MODIFY completed in 0 seconds
/CPMB/SOURCE_DELTA_IP completed in 1 seconds
/CPMB/INFOPROV_DELTA_CONVERT completed in 23 seconds
/CPMB/APPEND_LOAD_DELTA_IP completed in 5 seconds
ZBPC_SEND_EMAIL completed in 0 seconds
/CPMB/CLEAR completed in 0 seconds
[Selection]
--------------------------------------------------------------
INFOPROV_INIT_NAME = DELTA_AFI_01_NETP_ACT
RUNLOGIC = Yes
CHECKLCK = No
KEEPREJDATA = Yes
EMAIL_IF_SUCCESS = No
ADD_PACK_LOG_TO_EMAIL = Yes
[Message]
--------------------------------------------------------------
Task name SOURCE DELTA INFOPROVIDER:
User SLEO00364A run delta load from InfoProvider AFI_01 with selection
<?xml version="1.0" encoding="utf-16"?><Selections><Selection Type="Selection"><Attribute><ID>ZFI_CATEG</ID><Operator>1</Operator><LowValue>ACTUAL</LowValue><HighValue/></Attribute><Attribute><ID>ZFI_MODEL</ID><Operator>1</Operator><LowValue>NETPROFIT</LowValue><HighValue/></Attribute><Attribute><ID>ZFI_MODEL</ID><Operator>1</Operator><LowValue>NETPROFITIC</LowValue><HighValue/></Attribute><Attribute><ID>ZFI_MODEL</ID><Operator>1</Operator><LowValue>NETPROFITLOAD</LowValue><HighValue/></Attribute><Attribute><ID>ZFI_MODEL</ID><Operator>1</Operator><LowValue>NETPROFITPCTR</LowValue><HighValue/></Attribute><Attribute><ID>ZFI_MODEL</ID><Operator>1</Operator><LowValue>NETPROFITADJ</LowValue><HighValue/></Attribute><Attribute><ID>ZFI_MODEL</ID><Operator>1</Operator><LowValue>NETPLVIC</LowValue><HighValue/></Attribute><Attribute><ID>ZFI_YEAR</ID><Operator>1</Operator><LowValue>2020</LowValue><HighValue/></Attribute></Selection><Selection Type="FieldList"><FieldID>0CURRENCY</FieldID><FieldID>0REQTSN</FieldID><FieldID>ZFI_ACCNT</FieldID><FieldID>ZFI_CATEG</FieldID><FieldID>ZFI_ENTIT</FieldID><FieldID>ZFI_FCTAR</FieldID><FieldID>ZFI_MODEL</FieldID><FieldID>ZFI_PTPCT</FieldID><FieldID>ZFI_YEAR</FieldID></Selection></Selections>
Record count:                                              3753
Task name CONVERT:
No 1 Round:
Reject count: 0
Record count: 3753
Skip count: 24
Accept count: 45012
Task name APPEND LOAD DELTA INFOPROVIDER:
Suppressed zero-value records: 40,337
Error running default logic ()
Member "9777" not exist
Submit count: 43708
Reject count: 1304
model: MARGIN. Package status: ERROR

Continued...

[leonel_mario]

2 - When I run the Load using /CPMB/Load_INFOPROV_UI with Handling of Records 'Overwrite' - I get a warning rather than an error -

/CPMB/MODIFY completed in 0 seconds
/CPMB/INFOPROVIDER_CONVERT completed in 52 seconds
/CPMB/LOAD_IP completed in 14 seconds
ZBPC_SEND_EMAIL completed in 0 seconds
/CPMB/CLEAR completed in 0 seconds
[Selection]
--------------------------------------------------------------
InforProvide = AFI_01
SELECTION = <?xml version="1.0" encoding="utf-16"?><Selections xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xsd="http://www.w3.org/2001/XMLSchema"><Selection Type="Selection"><Attribute><ID>ZFI_CATEG</ID><Operator>1</Operator><LowValue>ACTUAL</LowValue><HighValue /></Attribute><Attribute><ID>ZFI_YEAR</ID><Operator>1</Operator><LowValue>2020</LowValue><HighValue /></Attribute></Selection><Selection Type="FieldList"><FieldID>0CO_AREA</FieldID><FieldID>0CURRENCY</FieldID><FieldID>0PROFIT_CTR</FieldID><FieldID>0REQTSN</FieldID><FieldID>ZFI_ACCNT</FieldID><FieldID>ZFI_CATEG</FieldID><FieldID>ZFI_ENTIT</FieldID><FieldID>ZFI_FCTAR</FieldID><FieldID>ZFI_MODEL</FieldID><FieldID>ZFI_PTPCT</FieldID><FieldID>ZFI_YEAR</FieldID></Selection></Selections>
TRANSFORMATION = \ROOT\WEBFOLDERS\CASCADESGOLD\MARGIN\DATAMANAGER\TRANSFORMATIONFILES\TD\TD_AFI_01_NETPROFIT_MARGIN.XLS
TARGETMODE = Yes
RUNLOGIC = Yes
CHECKLCK = No
EMAIL_IF_SUCCESS = No
ADD_PACK_LOG_TO_EMAIL = Yes
[Message]
--------------------------------------------------------------
Task name CONVERT:
No 1 Round:
Reject count: 0
Record count: 6641
Skip count: 34632
Accept count: 45060
Task name LOAD INFOPROVIDER:
Aggregate count: 7212
Submit count: 31032
Reject count: 6816
model: MARGIN. Package status: WARNING

3 - Similarly, when I run the /CPM/LOAD_INFOPROV_UI with Handling of Records 'APPEND' - I get an error again.

/CPMB/MODIFY completed in 0 seconds
/CPMB/INFOPROVIDER_CONVERT completed in 51 seconds
/CPMB/LOAD_IP completed in 3 seconds
ZBPC_SEND_EMAIL completed in 0 seconds
/CPMB/CLEAR completed in 0 seconds
[Selection]
--------------------------------------------------------------
InforProvide = AFI_01
SELECTION = <?xml version="1.0" encoding="utf-16"?><Selections xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xsd="http://www.w3.org/2001/XMLSchema"><Selection Type="Selection"><Attribute><ID>ZFI_CATEG</ID><Operator>1</Operator><LowValue>ACTUAL</LowValue><HighValue /></Attribute><Attribute><ID>ZFI_YEAR</ID><Operator>1</Operator><LowValue>2020</LowValue><HighValue /></Attribute></Selection><Selection Type="FieldList"><FieldID>0CO_AREA</FieldID><FieldID>0CURRENCY</FieldID><FieldID>0PROFIT_CTR</FieldID><FieldID>0REQTSN</FieldID><FieldID>ZFI_ACCNT</FieldID><FieldID>ZFI_CATEG</FieldID><FieldID>ZFI_ENTIT</FieldID><FieldID>ZFI_FCTAR</FieldID><FieldID>ZFI_MODEL</FieldID><FieldID>ZFI_PTPCT</FieldID><FieldID>ZFI_YEAR</FieldID></Selection></Selections>
TRANSFORMATION = \ROOT\WEBFOLDERS\CASCADESGOLD\MARGIN\DATAMANAGER\TRANSFORMATIONFILES\TD\TD_AFI_01_NETPROFIT_MARGIN.XLS
TARGETMODE = No
RUNLOGIC = Yes
CHECKLCK = No
EMAIL_IF_SUCCESS = No
ADD_PACK_LOG_TO_EMAIL = Yes
[Message]
--------------------------------------------------------------
Task name CONVERT:
No 1 Round:
Reject count: 0
Record count: 6641
Skip count: 34632
Accept count: 45060
Task name LOAD INFOPROVIDER:
Suppressed zero-value records: 40,381
Error running default logic ()
Member "9777" not exist
Submit count: 43756
Reject count: 1304
model: MARGIN. Package status: ERROR

4 - The log for Default Logic is only generated when the Load gives a warning but no log for failures.

So if I run this multiple times, one at 8.25 am, 8.30 am and 8.40 am; there is only one log generated, which is for the Warning. Another thing is that I have performed these loads after dropping the data from the cube.

LOG BEGIN TIME:2020-05-08 09:22:58
FILE:\ROOT\WEBFOLDERS\CASCADESGOLD\ADMINAPP\MARGIN\DEFAULT.LGF
USER:SLEO00364A
APPSET:CASCADESGOLD
APPLICATION:MARGIN
Data Region:
[WARNING!] MEASURES IS NOT SPECIFIED!
PARTNER_PCTR:NO_PARTNER_PCTR,P_1051,P_1052,P_1053,P_1101...61 in total.
PLANT:NO_PLANT,PL_1685,PL_2001,PL_2221,PL_2371...17 in total.
PRODUCT:NO_PRODUCT,1 in total.
RPTCURRENCY:LC,1 in total.
SHIP_TO:NO_SHIP_TO,1 in total.
SOLD_TO:NO_SOLD_TO,1 in total.
TIME:2020.01,2020.02,2020.03,2020.04,2020.05...12 in total.
CATEGORY:ACTUAL,1 in total.
PROFITCENTER:1051,1052,1053,1551,1553...79 in total.
ACCOUNT:422000,502000,QTY_PROD_BUOM,QTY_PROD_CS,QTY_PROD_CSC...54 in total.
AUDIT_MARGIN:VOLUME_DIST_CALC,VOLUME_INP,2 in total.
FUNCTIONALAREA:FA_NA,NO_FUNCTIONALAREA,Z001,Z003,Z004...82 in total.
QUERY TIME : 0.00 ms. 0  RECORDS QUERIED OUT.
Nothing Returned from SQE
QUERY TIME :0.00 S.
EXECUTION BADI:UOM_CONVERSION
QUERY: ON
WRITE: OFF
INFO: No data found for UOM Conversion.
BADI EXECUTION TIME IN TOTAL :0.00 ms.
EXECUTION BADI:RUN_SQL_STATEMENT
QUERY: OFF
WRITE: OFF
WriteBack Status Rule: SQL20_FA_DERIVATION; NR Submitted:752 , NR Success: 752 , NR Failed:0 .
INFO: Rule: SQL20_FA_DERIVATION, Package: 1,SQL Runtime:0.000  Write-Back Runtime: 1.000 .
INFO: Rule: SQL20_FA_DERIVATION, Total Runtime:1.000  Records: 752 .
BADI EXECUTION TIME IN TOTAL :1.00 ms.
EXECUTION BADI:RUN_SQL_STATEMENT
QUERY: OFF
WRITE: OFF
INFO: Category:ACTUAL records have been skipped.
BADI EXECUTION TIME IN TOTAL :0.00 ms.
EXECUTION BADI:RUN_SQL_STATEMENT
QUERY: OFF
WRITE: OFF
WriteBack Status Rule: SQL14_FX_COPYLC; NR Submitted:8 , NR Success: 8 , NR Failed:0 .
INFO: Rule: SQL14_FX_COPYLC, Package: 1,SQL Runtime:0.000  Write-Back Runtime: 0.000 .
INFO: Rule: SQL14_FX_COPYLC, Total Runtime:0.000  Records: 8 .
WriteBack Status Rule: SQL15_FX_AVG; NR Submitted:5098 , NR Success: 5098 , NR Failed:0 .
INFO: Rule: SQL15_FX_AVG, Package: 1,SQL Runtime:1.000  Write-Back Runtime: 1.000 .
INFO: Rule: SQL15_FX_AVG, Total Runtime:3.000  Records: 5098 .
BADI EXECUTION TIME IN TOTAL :3.00 ms.
EXECUTION BADI:RUN_SQL_STATEMENT
QUERY: OFF
WRITE: OFF
WARNING: CATEGORY Property:FIN_TRNF of Member:ACTUAL is blank. The Category will be skipped.
BADI EXECUTION TIME IN TOTAL :0.00 ms.
SCRIPT RUNNING TIME IN TOTAL:4.00 s.
LOG END TIME:2020-05-08 09:23:03

Please advise.

Thank you.

[former_member186338]

Let's assume that E9476 is the member of Profit Center dimension.

Then try instead of line:

*XDIM_MEMBERSET PROFITCENTER = %PROFITCENTER_SET%

The following code:

*SELECT(%CONV_GRP_ACCTS%,[ID],ACCOUNT,[UOM_CONV_GRP]<>'')
*SELECT(%AUDITS_TO_BE_CONVERTED%,[ID],AUDIT_MARGIN,[UOM_CONV_SRC] = 'Y')

//insert
*SELECT(%PCSET%,[ID],PROFITCENTER,[ID] = %PROFITCENTER_SET%) //only valid ID's
//end insert

*FOR %CATEG% = %CATEGORY_SET%
*XDIM_MEMBERSET CATEGORY = %CATEG%
*XDIM_MEMBERSET PROFITCENTER = %PCSET% //from inserted select
...

[leonel_mario]

Hello Vadim,

Can you please explain the function of the below statement, if you don't mind?

//insert
*SELECT(%PCSET%,[ID],PROFITCENTER,[ID] = %PROFITCENTER_SET%) //only valid ID's//endinser

Thank you.

[former_member186338]

leonel.mario

Sorry, but I am waiting for clear answer to my questions first!

Sorry, but in you previous post was:
"This is the include in the Default file
*INCLUDE CALC_UOM_CONVERSION.LGF"
Please confirm that your default.lgf consists of the single line with the mentioned include!
"The Dimensions to which that source value E9476 are loaded to are Profit 
Center and PLANT" - what do you mean by this statement?
E9476 is not a value, it's a dimension member! May be it's not in BPC, but it's present in BW data load. What is the dimension of this member?

[leonel_mario]

"This is the include in the Default file
*INCLUDE CALC_UOM_CONVERSION.LGF"
Please confirm that your default.lgf consists of the singlelinewith the mentioned include! - YES, that is correct. 


"The Dimensions to which that source value E9476 are loaded to are Profit 
Center and PLANT" - what do you mean by this statement? - Source is ENTITY in BW and ENTITY is loaded to ProfitCenter and Plant in BPC.

E9476 is coming from BW and being loaded as a member to Profitcenter and PLANT through the Transaction data.
Point to be noted here is that there is another entity E1721 which is also coming but that gets rejected with warning for the Data manager.
E1721 exists as a member in the Profit Center but not in PLANT dimension. But, we don't get a failure for the data manager for the record with E1721 unlike E9476.


Thank you

[former_member186338]

leonel.mario

First of all - it's absolutely bad idea to have the same member ID in different dimensions! Unfortunately it's very hard to fix it now.

Second: explanation of script changes

I suspect that error can be generated by the line:

*XDIM_MEMBERSET PROFITCENTER =%PROFITCENTER_SET%

when E9476 is in %PROFITCENTER_SET% but missing in the dimension.

My proposal is to select only existing members of PROFITCENTER dimension using

*SELECT(%PCSET%,[ID],PROFITCENTER,[ID] = %PROFITCENTER_SET%)

%PCSET% will not contain missing E9476

Not sure it will help.

Also please find the log of default.lgf execution. You can do it using UJFS

[leonel_mario]

Hello Vadim,

When I used the code lines that you mentioned and tested it in UJKT, I get the following error.

UJK_VALIDATION_EXCEPTION:Dimension set:"PROFITCENTER" not assigned in Data Manager

On validation of the code and execution,

LGX:

*XDIM_MEMBERSET CATEGORY = %CATEGORY_SET%

*XDIM_MEMBERSET PROFITCENTER = %PCSET%

*XDIM_MEMBERSET ACCOUNT = %CONV_GRP_ACCTS%

*XDIM_MEMBERSET AUDIT_MARGIN = %AUDITS_TO_BE_CONVERTED%

*XDIM_MEMBERSET FUNCTIONALAREA = BAS(ABC)

*XDIM_FILTER RPTCURRENCY = [RPTCURRENCY].Properties("ID") = LC

*START_BADI UOM_CONVERSION

QUERY = ON

WRITE = OFF

DONT_RUN_ON_CAT_TYPES = ACTUAL

SKIP_FCST_ACTUAL_PERS = Y

SKIP_BLINE_ACTUAL_PERS = Y *

END_BADI

-------------------------------------------------------------------------------------------------------------------------------------

LOG: UJK_VALIDATION_EXCEPTION:Dimension set:"PROFITCENTER" not assigned in Data Manager

Kindly advise.

Thank you.

Regards,

Leonel

[former_member186338]

leonel.mario

"When I used the code lines that you mentioned and tested it in UJKT, I get the following error."

Sorry, but what do you specify in UJKT Data Region for Profit Center? Nothing? Then no surprise, you will have an error!

[leonel_mario]

Thank you Vadim; I realized that later and since we don't have a pre-selection in the DMP for a Profit Center and in the Dimension, since the Profit Center sits under a Hierarchy (TOT_PC), I have updated the logic as -

*XDIM_MEMBERSET PROFITCENTER = BAS(TOT_PC)

That actually helped in running the DMP with the missing MD related records going under rejected records.

NOTE - The DMP that I use is /CPMB/LOAD_DELTA_IP.

Now, after adding the MD for the Profit Center and PLANT, I run the DMP again but it still shows me those records under rejected. The number of records don't change. Please let me know if there is something that I am missing.

Like mentioned earlier, both Profit Center and Plant get the values from ENTITY - (This is the project implementation). If, for example, the Entity value is E9445, the Profit Center is loaded as 9445 and Plant as PL_9445. The conversion file is maintained for both Plant and Profit Center.

On checking the rejected records, it shows in the rejected records the correct converted Profit Center but the Plant value shows the original Entity value (E9445) and the error states, invalid Plant member. Kindly note that the MD has been maintained here, as well.

I have validated the Transformation file by pulling data from BW using selection for that Entity E9445 and validation was successful.

Then, I performed the normal /CPMB/LOAD_INFOPROV_UI and this loaded the data for that Entity completely.

Kindly advise.

Thank you.

[former_member186338]

leonel.mario

*XDIM_MEMBERSET PROFITCENTER = BAS(TOT_PC) - incorrect approach. default.lgf will get the scope based on new records in loaded data...

"Like mentioned earlier, both Profit Center and Plant get the values from ENTITY - (This is the project implementation). If, for example, the Entity value is E9445, the Profit Center is loaded as 9445 and Plant as PL_9445. The conversion file is maintained for both Plant and Profit Center.

On checking the rejected records, it shows in the rejected records the correct converted Profit Center but the Plant value shows the original Entity value (E9445) and the error states, invalid Plant member. Kindly note that the MD has been maintained here, as well."

Sorry, but to find the issue you need to post your transformation file and conversion file for Plant (and optionally for Profit Center).

[leonel_mario]

trfn2.jpg

Hello Vadim,

Please find the attached.

trfn1.jpg

Thank you.

[leonel_mario]

Since, I am unable to share the files together, I have shared them separately.

Please find the attached conversion file -

profitcenter.jpg

plant.jpg

Regards,

Leonel S Mario

[former_member186338]

leonel.mario

Sorry, but I NEVER respond to the posts with "Insert File" instead of correct "Insert Image"!

[leonel_mario]

Hello Vadim,

Please find the attached Logic Files, as well.

default.txt

calc-uom-conversion.txt

[leonel_mario]

log-file.txtreject-records.txt

[leonel_mario]

calc-default-accts.txttrfn-to-fin-default.txt

[leonel_mario]

fa-derivation.txtfxtrans-avg-copylc.txt

[former_member186338]

Once again, I have no time to open individual attachments. Prepare your posts in the readable form.

[leonel_mario]

Hello Vadim,

Please find the below logic script information

*********************************

Default.lgx

*********************************

// FA Derivation

*INCLUDE FA_DERIVATION.LGF

//UOM Conversion

*INCLUDE CALC_UOM_CONVERSION.LGF

// Revenue Accounts, COGS/COGM Accounts, Freight Cost Account Calculations

*INCLUDE CALC_DEFAULT_ACCTS.LGF

// Custom FX Restatement - Writes only Delta

*INCLUDE FXTRANS_AVG_COPYLC.LGF

//Transfer to Financial Model

*INCLUDE TRNF_TO_FIN_DEFAULT.LGF

*********************************

FA Derivation

*********************************

*FOR %CATEG% = %CATEGORY_SET%

*XDIM_MEMBERSET CATEGORY = %CATEG%

*START_BADI RUN_SQL_STATEMENT

QUERY = OFF

WRITE = OFF

DEBUG = OFF

LOG_SQL_STATEMENTS = OFF

RUN_SQL_STATEMENTS = ON

SQL_ID = SQL20_FA_DERIVATION

DEST_CATEGORY_ID = %CATEG%

*END_BADI

*NEXT

*COMMIT

*********************************

FXTRANS_AVG_COPYLC

*********************************

*FOR %CATEG% = %CATEGORY_SET%

*XDIM_MEMBERSET TIME=%TIME_SET%

//Run SQL Statement for FX AVG & COPYLC

*START_BADI RUN_SQL_STATEMENT

QUERY = OFF

WRITE = OFF

LOG_SQL_STATEMENTS = OFF

RUN_SQL_STATEMENTS = ON

SQL_ID = SQL14_FX_COPYLC,SQL15_FX_AVG

DEST_CATEGORY_ID = %CATEG%

RATE_ENTITY=Global

*END_BADI

*NEXT

*********************************

CALC_DEFAULT_ACCTS

*********************************

*FOR %CATEG% = %CATEGORY_SET%

*XDIM_MEMBERSET CATEGORY = %CATEG%

*XDIM_MEMBERSET AUDIT_MARGIN = BAS(TOT_BEFORE_ADJ)

//Run SQL Statements

*START_BADI RUN_SQL_STATEMENT

QUERY = OFF

WRITE = OFF

LOG_SQL_STATEMENTS = OFF

RUN_SQL_STATEMENTS = ON

SQL_ID = SQL10_CALC_USDINP,SQL03_CALC_REV,SQL04_CALC_DISCLM,SQL07_CALC_COGS,SQL09_CALC_FRTCST,SQL17_CALC_ACCTRN,SQL18_CALC_AUTOADJ,SQL19_CALC_AUTOADJ2

DONT_RUN_ON_CAT_TYPES = ACTUAL

DEST_CATEGORY_ID = %CATEG%

SKIP_FCST_ACTUAL_PERS = Y//Skip Actual Periods for FORECAST Categories

SKIP_BLINE_ACTUAL_PERS = Y//Skip Actual Periods for BASELINE Categories

*END_BADI

*NEXT

*********************************

CALC_UOM_CONVERSION

*********************************

*SELECT(%CONV_GRP_ACCTS%,[ID],ACCOUNT,[UOM_CONV_GRP]<>'')

*SELECT(%AUDITS_TO_BE_CONVERTED%,[ID],AUDIT_MARGIN,[UOM_CONV_SRC] = 'Y')

*FOR %CATEG% = %CATEGORY_SET%

*XDIM_MEMBERSET CATEGORY = %CATEG%

*XDIM_MEMBERSET PROFITCENTER = %PROFITCENTER_SET%

*XDIM_MEMBERSET ACCOUNT = %CONV_GRP_ACCTS%

*XDIM_MEMBERSET AUDIT_MARGIN = %AUDITS_TO_BE_CONVERTED%

*XDIM_MEMBERSET FUNCTIONALAREA = BAS(CASC)

*XDIM_FILTER RPTCURRENCY = [RPTCURRENCY].Properties("ID") = LC

*START_BADI UOM_CONVERSION

QUERY = ON

WRITE = OFF //BADI will save results by package

DONT_RUN_ON_CAT_TYPES = ACTUAL//Don't run on Category type = ACTUAL

SKIP_FCST_ACTUAL_PERS = Y//Skip Actual Periods for FORECAST Categories

SKIP_BLINE_ACTUAL_PERS = Y//Skip Actual Periods for BASELINE Categories

*END_BADI

*NEXT

*********************************

TRFN_TO_FIN_DEFAULT

*********************************

*SELECT(%DEST_AUDIT_LIST%,[DEST_FIN],AUDIT_MARGIN,[DEST_FIN]<>' ') //Dest AUDIT_FINANCIAL IDs

*FOR %CATEG% = %CATEGORY_SET%

*XDIM_MEMBERSET RPTCURRENCY = %RPTCURRENCY_SET%

*XDIM_MEMBERSET TIME=%TIME_SET% //Run SQL Statement to calculate the Assumptions and Std Cost Baseline Calculations

*START_BADI

RUN_SQL_STATEMENT

QUERY = OFF

WRITE = OFF

LOG_SQL_STATEMENTS = OFF

RUN_SQL_STATEMENTS = ON

SQL_ID = SQL23_TRNF_FIN_DEF

DEST_MODEL=FINANCIAL

DEST_MODEL_WB_USER=X0000BPCBGJB //Destination Model WriteBack User

DEST_CATEGORY_ID = %CATEG%

REPLACE_TRNF_DEF_PER_RANGES=Y

DEST_AUDIT_LIST=%DEST_AUDIT_LIST%

*END_BADI

*NEXT

[leonel_mario]

Hello Vadim,

As requested, please find the Transformation file as well -

*OPTIONS

FORMAT = DELIMITED

HEADER = YES

DELIMITER = TAB

AMOUNTDECIMALPOINT = .

CONVERTAMOUNTWDIM=ACCOUNT

SKIP = 0

SKIPIF =

VALIDATERECORDS=NO

CREDITPOSITIVE=NO

MAXREJECTCOUNT=-1

ROUNDAMOUNT=

*MAPPING

ACCOUNT=ZFI_ACCNT

AUDIT_MARGIN=ZFI_MODEL

CATEGORY=ZFI_CATEG

FUNCTIONALAREA=ZFI_FCTAR

PARTNER_PCTR=ZFI_PTPCT

PLANT=ZFI_ENTIT

PRODUCT=*STR(NO_PRODUCT)

PROFITCENTER=ZFI_ENTIT

RPTCURRENCY=*STR(LC)

SHIP_TO=*NEWCOL(NO_SHIP_TO)

SOLD_TO=*NEWCOL(NO_SOLD_TO)

TIME =*MVAL (ZFI_MJAN| ZFI_YEAR + *STR(.01) || ZFI_MFEB| ZFI_YEAR + *STR(.02) || ZFI_MMAR| ZFI_YEAR + *STR(.03) || ZFI_MAPR| ZFI_YEAR + *STR(.04) || ZFI_MMAY| ZFI_YEAR + *STR(.05) || ZFI_MJUN| ZFI_YEAR + *STR(.06) || ZFI_MJUL| ZFI_YEAR + *STR(.07) || ZFI_MAUG| ZFI_YEAR + *STR(.08) || ZFI_MSEP| ZFI_YEAR + *STR(.09) || ZFI_MOCT| ZFI_YEAR + *STR(.10) || ZFI_MNOV| ZFI_YEAR + *STR(.11) || ZFI_MDEC| ZFI_YEAR + *STR(.12))

*CONVERSION

ACCOUNT=TD\LONGVIEW_TRANS_LOAD.XLS!ACCOUNT

AMOUNT=TD\LONGVIEW_TRANS_LOAD.XLS!ACCOUNT

PARTNER_PCTR=TD\LONGVIEW_TRANS_LOAD.XLS!PARTNER_PCTR

PROFITCENTER=TD\LONGVIEW_TRANS_LOAD.XLS!PROFITCENTER

FUNCTIONALAREA=TD\LONGVIEW_TRANS_LOAD.XLS!FUNCTIONALAREA

PLANT=TD\LONGVIEW_TRANS_LOAD.XLS!PLANT1 AUDIT_MARGIN=TD\LONGVIEW_TRANS_LOAD.XLS!AUDIT

==============================================================================================

Conversion File for Profit Center

External Internal

E* *

Conversion File for Plant

E9452 PL_9452

Thank you.

Regards,

Leonel S Mario

[former_member186338]

OK, the current logic of conversion file is incorrect! It will not support conversion of new EXXX to the Plant member. Each time new line have to be added to the conversion file manually.

You have to make some assumption: new EXXX have to go to PL_XXXX or new EXXX have to go to NO_PLANT

Conversion file lines are processed in the sequence from the first line to the last line. If match is found the processing is stopped and result is delivered.

If you add E* PL_* at the end of conversion file then all new EXXX will be converted to PL_XXXX

Also, master data has to be loaded regularly and before transaction data load.

[leonel_mario]

Yes, you are right. But, what the client expects is the DMP to run with a warning and all records where Master data does not exist should stay in rejected records. Once, the Master Data is added and the necessary conversion files updated, the re-run of the data manager package should load those rejected records into the cube.

This was how it was running when suddenly it started failing.

Thank you.

Regards,

Leonel

[former_member186338]

leonel.mario

To my mind this logic is strange and you have to understand the real requirements! Not the strange: "I want ...", but the real business process. How often the master data is added? What is the expected Plant member for the new code? Is it possible to define some rule? And only after the mentioned analysis you can provide a good solution!

By the way - warning is a bad idea, if some data is not loaded then user has to be informed about error to rerun.

[leonel_mario]

In addition, an additional test that was requested of me was that to add the Profit center and plant as Master Data and add the conversion file information for the necessary Master Data. Then, perform the load once again in order to see if the records are pulled back in.

But this case it didn't pull the records through the delta IP, even though the MD was updated as well as the Conversion files. But when I ran the LOAD_INFOPROV_UI then the package ran successfully.

Can you kindly advise on this strange behavior?

[former_member186338]

leonel.mario

Sorry, but unfortunately I am unable to comment the mentioned behavior...

A lot of step by step details have to be provided. Full sequence of actions with screenshots!

[leonel_mario]

Thanks Vadim for assisting me on this. Let me gather some more inputs to share here.

[leonel_mario]

Hello Vadim,

Please find the steps as requested.

1 -

2 -

[leonel_mario]

3-

4-

....

[leonel_mario]

5 -

6 -

...

[leonel_mario]

7 -

8 -

...
Thank you.

[former_member186338]

leonel.mario

Sorry, but how this screenshots of successful run LOAD_INFOPROV_UI will help me??????????????

[leonel_mario]

This package actually failed with the below -

/CPMB/MODIFY completed in 0 seconds /CPMB/INFOPROVIDER_CONVERT completed in 2 seconds /CPMB/LOAD_IP completed in 0 seconds ZBPC_SEND_EMAIL completed in 0 seconds /CPMB/CLEAR completed in 0 seconds [Selection] -------------------------------------------------------------- InforProvide = AFI_01 SELECTION = <?xml version="1.0" encoding="utf-16"?><Selections xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xsd="http://www.w3.org/2001/XMLSchema"><Selection Type="Selection"><Attribute><ID>ZFI_ENTIT</ID><Operator>1</Operator><LowValue>E9222</LowValue><HighValue /></Attribute></Selection><Selection Type="FieldList"><FieldID>0CO_AREA</FieldID><FieldID>0CURRENCY</FieldID><FieldID>0PROFIT_CTR</FieldID><FieldID>0REQTSN</FieldID><FieldID>ZFI_ACCNT</FieldID><FieldID>ZFI_CATEG</FieldID><FieldID>ZFI_ENTIT</FieldID><FieldID>ZFI_FCTAR</FieldID><FieldID>ZFI_MODEL</FieldID><FieldID>ZFI_PTPCT</FieldID><FieldID>ZFI_YEAR</FieldID></Selection></Selections> TRANSFORMATION = \ROOT\WEBFOLDERS\CASCADESGOLD\MARGIN\DATAMANAGER\TRANSFORMATIONFILES\TD\TD_AFI_01_NETPROFIT_MARGIN.XLS TARGETMODE = No RUNLOGIC = Yes CHECKLCK = Yes EMAIL_IF_SUCCESS = No ADD_PACK_LOG_TO_EMAIL = Yes [Message] -------------------------------------------------------------- Task name CONVERT: No 1 Round: Reject count: 0 Record count: 176 Skip count: 0 Accept count: 2112 Task name LOAD INFOPROVIDER: Suppressed zero-value records: 1,790 Error running default logic () Member "PL_9222" not exist Submit count: 1790 Reject count: 322 model: MARGIN. Package status: ERROR

So, what I did was to add this statement to actually pull the valid members in BPC.

From this -

//*XDIM_MEMBERSET PROFITCENTER = %PROFITCENTER_SET%

To -

*XDIM_MEMBERSET PROFITCENTER = BAS(CASC_MGT)

And, this helped the package to run with a warning - Warning with records in Rejected List.

A few doubts here -

1- Is there some way that we can run the logic script with a Condition on the incoming data checked against the BPC dimension members.

2 - %DIM_SET% - Does this take only values from incoming data and the data that is populated from the prompts?

3 - Can I add prompts for a Import Transaction data from BW InfoProvider/Delta to take in values for BPC Dimensions?

I did this, but I got a dump with the statement // ITAB_DUPLICATE_KEY//

Alternatively, we can run the DMP (mport Txn data from BW InfoProv) without the Default Logic and then run the Default logic file separately - by giving prompts - I am not too sure about this approach as I would like to run the Default logic on the valid members of the Dimensions from the incoming data - hence Question 1.

[former_member186338]

leonel.mario

Sorry, but I will comment only when you post in a readable form!

Your last post looks like - I will paste the log in the comment and it's not my job to make it readable.

[leonel_mario]

Hello Vadim,

I am sorry about that.

Please find the below as requested.

/CPMB/MODIFY completed in 0 seconds
/CPMB/INFOPROVIDER_CONVERT completed in 2 seconds
/CPMB/LOAD_IP completed in 0 seconds
ZBPC_SEND_EMAIL completed in 0 seconds
/CPMB/CLEAR completed in 0 seconds
[Selection]
--------------------------------------------------------------
InforProvide = AFI_01
SELECTION = <?xml version="1.0" encoding="utf-16"?><Selections xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xsd="http://www.w3.org/2001/XMLSchema"><Selection Type="Selection"><Attribute><ID>ZFI_ENTIT</ID><Operator>1</Operator><LowValue>E9222</LowValue><HighValue /></Attribute></Selection><Selection Type="FieldList"><FieldID>0CO_AREA</FieldID><FieldID>0CURRENCY</FieldID><FieldID>0PROFIT_CTR</FieldID><FieldID>0REQTSN</FieldID><FieldID>ZFI_ACCNT</FieldID><FieldID>ZFI_CATEG</FieldID><FieldID>ZFI_ENTIT</FieldID><FieldID>ZFI_FCTAR</FieldID><FieldID>ZFI_MODEL</FieldID><FieldID>ZFI_PTPCT</FieldID><FieldID>ZFI_YEAR</FieldID></Selection></Selections>
TRANSFORMATION = \ROOT\WEBFOLDERS\CASCADESGOLD\MARGIN\DATAMANAGER\TRANSFORMATIONFILES\TD\TD_AFI_01_NETPROFIT_MARGIN.XLS
TARGETMODE = No
RUNLOGIC = Yes
CHECKLCK = Yes
EMAIL_IF_SUCCESS = No
ADD_PACK_LOG_TO_EMAIL = Yes
[Message]
--------------------------------------------------------------
Task name CONVERT:
No 1 Round:
Reject count: 0
Record count: 176
Skip count: 0
Accept count: 2112
Task name LOAD INFOPROVIDER:
Suppressed zero-value records: 1,790
Error running default logic ()
Member "PL_9222" not exist
Submit count: 1790
Reject count: 322
model: MARGIN. Package status: ERROR

Thank you.

[former_member186338]

leonel.mario

Sorry, but you are not providing full info - I am unable to comment.

You have posted the error log, but I have no idea why PL_9222 not exist! Is it new member or??? Do you have rejected records or??? What do you use now for transformation and conversion?

Do you understand that this is not the right way to solve the issue?

"1- Is there some way that we can run the logic script with a Condition on the incoming data checked against the BPC dimension members." - yes, we can

"2 - %DIM_SET% - Does this take only values from incoming data and the data that is populated from the prompts?" it's the initial script scope and it can be defined by incoming data for default.lgf or by user prompts for not default.lgf! But not both!

3 - "Can I add prompts for a Import Transaction data from BW InfoProvider/Delta to take in values for BPC Dimensions?" - you can add prompts, but you can't use prompts results in your default.lgf

[leonel_mario]

Hello Vadim,

In continuation of my previous reply;

Yes, PL_9222 is a new member and doesn't exist in BPC.

This is why I asked the first question '1- Is there some way that we can run the logic script with a Condition on the incoming data checked against the BPC dimension members?'.

Yes, I do have rejected records for Accounts that are not present in BPC and don't meet the criteria or selection in BPC Script Logic. I, also, have rejected records for Profit Center - 9222 and Plant - PL_9222(Coming from Entity - E9222).

Ok; this is based on a new load done in BPC - Unlike, the Delta Load, this was run using the /CPMB/LOAD_INFOPROV_UI. Because, when I run using the Delta Load, I am not getting the log for the Default.lgf. With /CPMB/LOAD_INFOPROV_UI, the log was generated.

Please find the Data Manager Log

<RESULT><PROMPT><![CDATA[%InforProvide%AFI_01
%SELECTION%<?xml version="1.0" encoding="utf-16"?><Selections xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:xsd="http://www.w3.org/2001/XMLSchema"><Selection Type="Selection"><Attribute><ID>ZFI_CATEG</ID><Operator>1</Operator><LowValue>ACTUAL</LowValue><HighValue /></Attribute></Selection><Selection Type="FieldList"><FieldID>0CO_AREA</FieldID><FieldID>0CURRENCY</FieldID><FieldID>0PROFIT_CTR</FieldID><FieldID>0REQTSN</FieldID><FieldID>ZFI_ACCNT</FieldID><FieldID>ZFI_CATEG</FieldID><FieldID>ZFI_ENTIT</FieldID><FieldID>ZFI_FCTAR</FieldID><FieldID>ZFI_MODEL</FieldID><FieldID>ZFI_PTPCT</FieldID><FieldID>ZFI_YEAR</FieldID></Selection></Selections>
%TRANSFORMATION%\ROOT\WEBFOLDERS\CASCADESGOLD\MARGIN\DATAMANAGER\TRANSFORMATIONFILES\TD\TD_AFI_01_NETPROFIT_MARGIN.XLS
%TARGETMODE%1
%RUNLOGIC%1
%CHECKLCK%0
%EMAIL_IF_SUCCESS%0
%ADD_PACK_LOG_TO_EMAIL%1]]></PROMPT><STATUS_STEP><![CDATA[/CPMB/MODIFY completed in 0 seconds
/CPMB/INFOPROVIDER_CONVERT completed in 149 seconds
/CPMB/LOAD_IP completed in 42 seconds
ZBPC_SEND_EMAIL completed in 1 seconds
/CPMB/CLEAR completed in 0 seconds]]></STATUS_STEP><REJECTRECORD><![CDATA[Load Transaction Data from BW InfoProvider UIreject_record20200507112812_5LTY88LM5PYBZ8NE68RDLW7WP.txt]]></REJECTRECORD><REJECTFILE><![CDATA[Load Transaction Data from BW InfoProvider UIreject_data20200507112812_5LTY88LM5PYBZ8NE68RDLW7WP.txt]]></REJECTFILE><MESSAGE><![CDATA[Task name CONVERT:
No 1 Round:
Reject count: 0
Record count: 18955
Skip count: 104868
Accept count: 122592
Task name LOAD INFOPROVIDER:
Error while running default logic
Aggregate count: 15708
Submit count: 99600
Reject count: 7284
model: MARGIN. Package status: ERROR]]></MESSAGE></RESULT>

As the Rejected List is huge, I am pasting only a few lines

2900 499887LONGVIEW_LOADACTUALZ021NO_PARTNER_PCTRPL_2391NO_PRODUCT2391LCNO_SHIP_TONO_SOLD_TO2020.050.0000000 
Line0 :Invalid Members [ACCOUNT]=499887
2900 499887LONGVIEW_LOADACTUALZ021NO_PARTNER_PCTRPL_2391NO_PRODUCT2391LCNO_SHIP_TONO_SOLD_TO2020.040.0000000 
Line0 :Invalid Members [ACCOUNT]=499887
2900 499887LONGVIEW_LOADACTUALZ021NO_PARTNER_PCTRPL_2391NO_PRODUCT2391LCNO_SHIP_TONO_SOLD_TO2020.03900.0000000 
Line0 :Invalid Members [ACCOUNT]=499887
2900 499887LONGVIEW_LOADACTUALZ021NO_PARTNER_PCTRPL_2391NO_PRODUCT2391LCNO_SHIP_TONO_SOLD_TO2020.02900.0000000 
Line0 :Invalid Members [ACCOUNT]=499887658 535250LONGVIEW_LOADACTUALZ100NO_PARTNER_PCTRPL_9777NO_PRODUCT9777LCNO_SHIP_TONO_SOLD_TO2020.024883.6800000 
Line0 :Invalid Members [PLANT]=PL_9777
658 535250LONGVIEW_LOADACTUALZ100NO_PARTNER_PCTRPL_9777NO_PRODUCT9777LCNO_SHIP_TONO_SOLD_TO2020.014896.0200000 
Line0 :Invalid Members [PLANT]=PL_9777
7267 535250LONGVIEW_LOADACTUALZ100NO_PARTNER_PCTRPL_9432NO_PRODUCT9432LCNO_SHIP_TONO_SOLD_TO2020.120.0000000 
Line0 :Invalid Members [PLANT]=PL_9432
7267 535250LONGVIEW_LOADACTUALZ100NO_PARTNER_PCTRPL_9432NO_PRODUCT9432LCNO_SHIP_TONO_SOLD_TO2020.110.0000000 
Line0 :Invalid Members [PLANT]=PL_9432
7267 535250LONGVIEW_LOADACTUALZ100NO_PARTNER_PCTRPL_9432NO_PRODUCT9432LCNO_SHIP_TONO_SOLD_TO2020.100.0000000 
Line0 :Invalid Members [PLANT]=PL_9432

Please see the log for the Default script.

LOG BEGIN TIME:2020-05-07 11:31:00
FILE:\ROOT\WEBFOLDERS\CASCADESGOLD\ADMINAPP\MARGIN\DEFAULT.LGF
USER:SLEO00364A
APPSET:CASCADESGOLD
APPLICATION:MARGIN
Data Region:
[WARNING!] MEASURES IS NOT SPECIFIED!
PARTNER_PCTR:NO_PARTNER_PCTR,P_1001,P_1051,P_1052,P_1053...92 in total.
PLANT:NO_PLANT,PL_1001,PL_1501,PL_1685,PL_1721...37 in total.
PRODUCT:NO_PRODUCT,1 in total.
PROFITCENTER:1001,1051,1052,1053,1501...133 in total.
RPTCURRENCY:LC,1 in total.
SHIP_TO:NO_SHIP_TO,1 in total.
SOLD_TO:NO_SOLD_TO,1 in total.
TIME:2019.01,2019.02,2019.03,2019.04,2019.05...24 in total.
CATEGORY:ACTUAL,1 in total.
ACCOUNT:422000,502000,QTY_PROD_BUOM,QTY_PROD_CS,QTY_PROD_CSC...54 in total.
AUDIT_MARGIN:VOLUME_DIST_CALC,VOLUME_INP,2 in total.
FUNCTIONALAREA:FA_NA,NO_FUNCTIONALAREA,Z001,Z003,Z004...82 in total.
QUERY TIME : 1.00 ms. 0  RECORDS QUERIED OUT.
Nothing Returned from SQE
QUERY TIME :1.00 S.
EXECUTION BADI:UOM_CONVERSION
QUERY: ON
WRITE: OFF
INFO: No data found for UOM Conversion.
BADI EXECUTION TIME IN TOTAL :0.00 ms.
EXECUTION BADI:RUN_SQL_STATEMENT
QUERY: OFF
WRITE: OFF
WriteBack Status Rule: SQL20_FA_DERIVATION; NR Submitted:16334 , NR Success: 16334 , NR Failed:0 .
INFO: Rule: SQL20_FA_DERIVATION, Package: 1,SQL Runtime:0.000  Write-Back Runtime: 1.000 .
INFO: Rule: SQL20_FA_DERIVATION, Total Runtime:2.000  Records: 16334 .
BADI EXECUTION TIME IN TOTAL :2.00 ms.
EXECUTION BADI:RUN_SQL_STATEMENT
QUERY: OFF
WRITE: OFF
INFO: Category:ACTUAL records have been skipped.
BADI EXECUTION TIME IN TOTAL :0.00 ms.
EXECUTION BADI:RUN_SQL_STATEMENT
QUERY: OFF
WRITE: OFF
WriteBack Status Rule: SQL14_FX_COPYLC; NR Submitted:102 , NR Success: 102 , NR Failed:0 .
INFO: Rule: SQL14_FX_COPYLC, Package: 1,SQL Runtime:2.000  Write-Back Runtime: 1.000 .
INFO: Rule: SQL14_FX_COPYLC, Total Runtime:5.000  Records: 102 .
WriteBack Status Rule: SQL15_FX_AVG; NR Submitted:87384 , NR Success: 87288 , NR Failed:96 .
Keyfigure (Signeddata) 16,072,860,052,782.0000000- is invalid due to overflow
Keyfigure (Signeddata) 12,556,921,916,235.9375000- is invalid due to overflow
Keyfigure (Signeddata) 14,130,082,247,948.1000000- is invalid due to overflow
Keyfigure (Signeddata) 11,039,126,756,209.4531250- is invalid due to overflow
Keyfigure (Signeddata) 15,856,153,455,534.0000000 is invalid due to overflow
Keyfigure (Signeddata) 12,387,619,887,135.9375000 is invalid due to overflow
Keyfigure (Signeddata) 14,074,689,171,774.9600000 is invalid due to overflow
Keyfigure (Signeddata) 10,995,850,915,449.1875000 is invalid due to overflow
Keyfigure (Signeddata) 15,894,097,331,040.0000000- is invalid due to overflow
Keyfigure (Signeddata) 12,417,263,539,875.0000000- is invalid due to overflow
Keyfigure (Signeddata) 16,351,092,486,378.0000000- is invalid due to overflow
Keyfigure (Signeddata) 12,774,291,004,982.8125000- is invalid due to overflow
Keyfigure (Signeddata) 16,351,092,486,378.0000000 is invalid due to overflow
Keyfigure (Signeddata) 12,774,291,004,982.8125000 is invalid due to overflow
Keyfigure (Signeddata) 16,443,617,988,000.0000000 is invalid due to overflow
Keyfigure (Signeddata) 12,846,576,553,125.0000000 is invalid due to overflow

INFO: Rule: SQL15_FX_AVG, Total Runtime:14.000  Records: 87384 .
BADI EXECUTION TIME IN TOTAL :19.00 ms.
MESSAGE FROM CUSTOM LOGIC:
Keyfigure (Signeddata) 16,072,860,052,782.0000000- is invalid due to overflow
Keyfigure (Signeddata) 16,443,617,988,000.0000000 is invalid due to overflow
Keyfigure (Signeddata) 12,846,576,553,125.0000000 is invalid due to overflow
Keyfigure (Signeddata) 14,047,680,555,689.6400000 is invalid due to overflow
Keyfigure (Signeddata) 10,974,750,434,132.5312500 is invalid due to overflow
Keyfigure (Signeddata) 16,441,590,597,246.0000000 is invalid due to overflow

EXECUTION BADI:RUN_SQL_STATEMENT
QUERY: OFF
WRITE: OFF
WARNING: CATEGORY Property:FIN_TRNF of Member:ACTUAL is blank. The Category will be skipped.
BADI EXECUTION TIME IN TOTAL :0.00 ms.
SCRIPT RUNNING TIME IN TOTAL:22.00 s.
LOG END TIME:2020-05-07 11:31:23

I have not changed the Transformation file or the Conversion file. It is the same as before as that is how they expect it to be.

What I mean is, they don't want to add the new set of Master Data right away in the Conversion files as well as in the Dimension. It should go into the set of Rejected Records.

Once, the Master data has been updated in BPC Dimension and Conversion files, then the delta will be run again and those rejected records should be pulled into BPC. This is the expected working.

- Can you please explain about the Condition to check the incoming data against BPC members. If the condition is met, then run the BADI, else skip.

- You had mentioned

"2 - %DIM_SET% - Does this take only values from incoming data and the data that is populated from the prompts?" it's the initial script scope and it can be defined by incoming data for default.lgf or by user prompts for not default.lgf! But not both!

But in the below, from the earlier posts

My proposal is to select only existing members of PROFITCENTER dimension using

*SELECT(%PCSET%,[ID],PROFITCENTER,[ID]=%PROFITCENTER_SET%)

*XDIM_MEMBERSET PROFITCENTER = %PCSET%

In this case, from where will the %PCSET% value be obtained from, if I was to incorporate this in the logic.

Thank you.

[former_member186338]

From your post:

"Conversion File for Plant

E9452 PL_9452"

Single line??? Or the same story as with default.lgf - you decided not to show all lines?

"On checking the rejected records, it shows in the rejected records the correct converted Profit Center but the Plant value shows the original Entity value (E9445) and the error states, invalid Plant member"

For this single line conversion file E9445 will not be converted!

Do you have the line for E9445?

Why not to use universal conversion like for Profit Center?

External Internal
E*       PL_*

[former_member186338]

P.S. Your default.lgf is absolutely crazy 🙂 So many badi calls... Something is wrong with the project implementation logic...

[leonel_mario]

This is how the conversion file looks like - there are more lines than the below, but this is just how it looks and the below shows why I cannot have (Universal Conversion)E* --> PL_* because it has been maintained like that by the project.

As for line E9445, no, it is not there but still it is expected that the Data manager package should run with a warning.

E9445 shows correct converted Profit Center because of the Universal Conversion maintained under Profit Center but Plant still shows the original value as the conversion has not been maintained.

EXTERNAL INTERNAL

E004 PL_2221

E036 NO_PLANT

E038 NO_PLANT

E042 NO_PLANT

E1001 PL_1001

E1051 NO_PLANT

E1052 NO_PLANT

FRESHBAILIWICK NO_PLANT

*ADJ* NO_PLANT

*EP* *SKIP

E1721 PL_1721

E9452 PL_9452

Thank you.

Regards,

Leonel S Mario