Using ABAP Report Program to Automate the monitoring activities in PI (ABAP Stack) and ECC

[Former Member]

Background:

The support activities in PI and ECC servers ensure that they have to be repeated in an hourly basis in Production Environments. For any kind of errors, the support team has to follow up with other teams for resolving them. The major activities can be grouped into 2 categories based on the server it is performed:

ECC Monitoring activities:

• Crucial Jobs Monitoring – Jobs which are critical in processing/ triggering inbound/outbound idocs or files.
• Idoc Monitoring – Stuck and Error Inbound and Outbound Idocs
• SMQ1 Monitoring  - Ourbound Queue monitoring
• SMQ2 Monitoring – Inbound Queue monitoring
• SM58 tRFC monitoring
• Integration Engine (SXMB_MONI) on ECC monitoring for failed/error messages

PI Monitoring Activities:

• Integration Engine (SXMB_MONI) monitoring for any failed/error/holding messages.
• Message Monitoring and communication channel monitoring in Runtime Workbench.
• Monitoring Business Process Engine using SXMB_MONI_BPE
• Monitoring Runtime Cache in PI.
• SMQ1 Monitoring  - Ourbound Queue monitoring
• SMQ2 Monitoring – Inbound Queue monitoring
• SM58 tRFC monitoring

These activities (that are in ABAP Stack) can be made automated and the result can be consolidated into a report format and mailed to each support team members in an hourly basis. This can be done by writing a custom ABAP Report Program that has to be scheduled as a background job every hour. It helps to point out any error in ECC and PI by checking on the status reflected in the Output Report of the program.

  This custom report is developed to automate the monitoring activities performed in ECC and PI. This program runs in background as a scheduled job and the Job is scheduled to run for every hour. The output of this program is a report (document) which is stored in a spool (A spool request is a document for which a print function has been selected. The spool system uses a spool request to store the print data temporarily and to access it). This program also sends an email to the users who ids are set up in the variant of the program. The job also has the ability to run manually, such that the report is displayed on the screen.

How it works?

The report is generated based on the crucial activities performed in monitoring. In the report, the results for these activities by default, is having 2 status: Success (for no errors) and Failure (For any errors). In case of failure, the error details are also mentioned in subsequent lines in the report.

ECC

SMQ1 Monitoring 

Outbound Queue Destination           _____ to _____

SMQ2 Monitoring

Inbound Queue Destination             _____ to _____

SM58

RFC Destination                            _____ to _____

Job Monitoring

Jobs                                             _____ to _____          

IDOC Monitoring

Status                                          _____ to _____

SXMB_MONI

Status Group                                _____ to _____

PI

SMQ1 Monitoring 

Outbound Queue Destination           _____ to _____

SMQ2 Monitoring

Inbound Queue Destination             _____ to _____                                  

SXMB_MONI

Status Group                                 _____ to _____

SM58

RFC Destination                            _____ to _____

Basic Steps:

The ABAP program uses 2 Function Modules, one of them is written in ECC server and the other one in PI Server. The program calls the Function Module in PI by setting up an RFC.

• Function module within ECC performs all checks within in ECC as specified by the import parameters in the function module. At the end of execution, it returns the values back to the main program.

• Function module in PI performs all checks in ABAP stack of PI as specified by the import parameters in the function module. At the end of execution, it returns the values back to the main program.

The Report Program calls these 2 function modules and then writes them as a single report and mails the same report to intended recipients.

Point to note: RFC connection must exist between systems that require monitoring. A separate function module needs to be used, which can record the last running time of the program in each run, so that it can trigger itself in an hourly basis from that last run time.

Flow inside the program:

Execution of Function Module inside ECC:

The function module executes multiple activities that are called through forms. These are:

• smq1 monitoring which executes to check the qstate (Queue status) from the table trfcqout pointing to a logical destination
• smq2 monitoring which executes to check the qstate (Queue status) from the table trfcqin pointing to a logical destination
• sm58 monitoring executes same as queue monitoring but validates based on table ARFCSSTATE.
• Job monitoring: This will pull the Job name, start time and start date from a database view, validates the Job status and appends in the output report.
• Idoc monitoring executes to check if any inbound and outbound idocs are in failed state or which are struck. The data is pulled from EDIDC table based on the idoc status and are shown as a list format.
• SXMB_MONI which calls FM SXMB_GET_STATUS_LIST. This function module returns the message status (XI and WS) for the status type which is given in IM_STAT_TYPE or the mdt status which is given in IM_MDT_STATUS. If none is supplied, the whole list of status is returned. If both are supplied, nothing is returned. This status types are used in transaction SXI_MONITOR for selecting a status group.

For monitoring Integration Engine, the following status group are used for effective monitoring:

3    ->      Scheduled

1     ->     Processed Successfully

4     ->     Errors

6     ->     System Error

5     ->     Application Error

Based on the values maintained in the variant of the report program, the appropriate messages can be monitored in an hourly basis.

Execution of Function Module inside PI:

This Function Module resides in PI and before calling this module, the ABAP program sets the RFC system where the Function Module should execute. Based on the input parameters this Function Module first validates between and end date and end time of the program execution and then it performs or calls sub-routines to perform the execution of each and every transaction. Before this it will call a sub-routine which helps in getting the system details and appends to the output report.

The following Forms are executed to get the status of different transactions which are mentioned below. (Implementations same as discussed above)

•          smq1 monitoring

•          smq2 monitoring

•          Idoc monitoring

•          SXMB_MONI monitoring

Variant used:

The variant is the most crucial part for this program and it is the user's choice to define what sets of values he needs in the report. For example, a report may only gives the messages failed in SXMB_MONI which have errors, in that case, the value for status group 4 has to be maintained inside the variant. Similarly in ECC, the Idoc Monitoring can be defined based on the status maintained in the variant. An example for such instance is shown in below screenshot:

Output Report shown as as example:

ECC Job Monitoring Report:

The ECC Job Monitoring Report shows the status for various crucial jobs which are used in Idoc/File Processing, the associated program names as well as the variant details (whether they have run successfully or got cancelled) and also the tRFC connections, Inbound and Outbound Queues status in the single report.

Stuck Idoc Monitoring:

This part of the report contains the hourly counts of Stuck Idocs (with status 30 and 64) for various message types. The counts are denoted in the number column. A separate table (Z Table) is also used where the team and the sub team details for various message types and partners are maintained and the function module while giving the idoc counts based on message types and partner nos, also looks up that table simultaneously to give the Owner Functional Team (Tm) and the Sub team (STm) details in the report as well.

Error Idocs monitoring:

This part of the report contains the hourly counts of Error Idocs (with status 52, 29,17,26, 56, 51, 02 ) for various message types.Here instead of idoc counts, the idoc numbers itself are reflected in the report. Also the concept of Team and Sub Team details and the internal functionality is implemented in the same way like that used in Stuck Idocs.

PI Monitoring:

In PI part, the only difference is that, SXMB_MONI Transaction is internally called with the hourly messages having status maintained in status group. If the status group is chosen only as error, the error messages are listed with all the relevant details like message IDs, date, time, namespace, sender interface name, sender system, receiver system, etc.

Additional Function Modules used for printing and mailing the report:

Although, it is totally based on requirements, but the overall report can be used in the following ways using separate Function Modules created inside ECC.

• To Print the overall report using a spool request.
• To Mail the overall report (using SMTP ABAP email development structure) separately every hour to the intended recipients who can use it as a consolidated log to monitor overall status of the systems.
  

[Former Member]

Hi Sourav,

Great Job!

I am well versed with manually monitoring PI system. I know how troublesome it becomes at times to monitor daily after fixed intervals  and send the report too :razz: .

Thanks for sharing the blog.

Regards,

Arti.

[santosh_k3]

Hi Sourav,

I was looking for this. :smile:

Thanks for sharing...

Keep blogging.

Thanks

Sai

[Former Member]

Hi Sourav,

Thanks  for sharing this information.Really It is a nice blog.

Regards,

Abhi

[learnsap]

Hello Sourav,

Thanks for sharing this information and it is very helpful.

Regards,

Ramesh

[nitindeshpande]

HI Sourav,

It is a very good document. Thank you for Sharing ?

I have tried to implement it before but i could not achieve it. Please can u share with me the sample ABAP report, so that it will be helpful for implementing in my case?

[Former Member]

Hi Sourav,

Can you please share the report and I also need your help in coding part as I am in PI and I need your support in solving this required.

Regards,

Abhi

[Former Member]

Hi Nitin/Abhinav,

I will be updating this blog with a generic pseudocode/logic as well as the sample coding part soon for this report. Hope that will help you all

Regards,

Sourav

[Former Member]

Thanks Arti !! :smile:

[Former Member]

thanks sourav for talking ur time and pain in preparing this for us..

[Former Member]

thanks sourav for talking ur time and pain in preparing this for us..

[diego_a]

Have the code to do some tests in both ECC and PI?

greeting

[Former Member]

Can you share part of the report so that I can start writing my own report for a requirement :smile:

[Former Member]

Hi Sourav,

      can you share the code please.

Regards

Animesh Sundriyal

[Former Member]

Hi Sourav,

It will be very helpful if u can provide the code please .

Best Regards

Rudra

[Former Member]

A very nice blog...

A sample ABAP code would have been really helpful and will be appreciated...else we would have to re-invent the wheel...

Thank

Abhi

[former_member221486]

Hello Sourav,

Thanks for sharing this information and it is very helpful.

Regards,

Chaitanya

[Former Member]

Hi Sourav,

This is really a very nice blog. I have a similar requirement. If possible could you share ABAP code for the same?

Regards,

Minal

[former_member221486]

Very nice blog

[Former Member]

Thanks for nice information.

Yes, if anybody has already developed the report, please share the code, that would be very helpful.

Also, we can automate this error reporting for system using Solman with some config and get the mails/alerts. Does anybody have details information on it?

[former_member221486]

HI Sourav,

I have tried to implement it before but i could not achieve it. Please can u share with me the sample ABAP report, so that it will be helpful for implementing in my case?

[former_member221434]

HI Sourav ,

Can you send me this code  please .

Regards ,

pradeep

[former_member184155]

HI Sourav,

It is a very good document. Thank you for Sharing ?

I have tried to implement it before but i could not achieve it. Please can u share with me the sample ABAP report, so that it will be helpful for implementing in my case?

[Former Member]

Hello Sourav,

I’m very glad to see this document.

I believe  you would be helping me to wipe out my tears because of manual monitoring. ?

Could you please share the code for ECC system for below activities

Job monitoring

Idocs monitoring

Regards,

Vishnu

[Former Member]

Good post!

[pooja_tiwari3]

hi,

You can check if the below blog helps you with the code:

SAP XI/PI: Alerts for Queue Errors

thanks,

pooja

[pooja_tiwari3]

hi,

You can check if the below blog helps you with the code:

SAP XI/PI: Alerts for Queue Errors

thanks,

pooja

[former_member201264]

Hi Sourav,
This is really nice concept which you dug in SAP Ocean.
Could you please send me the same ABAP Code me at sreeni.pi7@gmail.com


Regards,
Sreeni.K

[tPF8Pzca2gc4VF1]

Hello Sourav,

Kindly please share ABAP Report program code to getbandaru@gmail.com this documents exactly suits my requirement. Please send  code.

 

Thanks,

Venkat

 

[john_duleba2]

Hi Sourav,

Excellent blog! If you would be so kind to send the ABAP code to me Thank you very much!

[former_member436188]

Hi Sourav,

Great post!! can you share the code please?

Many thanks!

[Former Member]

Excellent! Could you please send the ABAP code to me? Thank you for your support and help in advance.

[former_member376982]

Great Work! Can you please share the ABAP and PI code <private information removed by moderator>. Thank you for your support in advance.

[former_member654440]

Hi Team,

Could you please share the ABAP code me on aaghao@partner.jaguarlandrover.com

 

Regards,

Anil Aghao

[former_member685834]

Hi,

 

Nice Blog.

My requirement is also same.

Kindly share the coding document.

 

Thanks in Advance.

Regards,

Suguna

 

[nikhilsp]

Great Blog.
Even I am looking for similar functionality, if you can share the sample code  , it will be of great help.