topic Parallel Processing with SUBMIT program in Application Development and Automation Discussions

Parallel Processing with SUBMIT program

ChaitraSantosh — Wed, 04 Sep 2024 13:21:00 GMT

Hi All,

I have a Program which SUBMITs a standard program to extend contracts. The contracts that we are sending to this SUBMIT can run to hundred thousand records. I plan to divide this data to smaller chunks and call them in Background process using JOB_OPEN and JOB_CLOSE.

But how do I determine the number of records in each packet or chunk.

Re: Parallel Processing with SUBMIT program

Sandra_Rossi — Wed, 04 Sep 2024 19:48:21 GMT

If you have 100.000 contracts, run 10 jobs of 10.000 contracts each.

What is your exact question please?

Re: Parallel Processing with SUBMIT program

ChaitraSantosh — Thu, 05 Sep 2024 13:08:00 GMT

Hi Sandra,

Thanks for your response. I want to split the data into packets based on the number of records. Not everytime do we have huge records, there can be fewer records as well. How can i determine how many packets we can split them into?

Also inorder to improve the performance of a program which does a SUBMIT to a standard program, what is best approach. will above approach where we split into sizeable packets and execute them as parallel jobs help? Are there any better options? Business is suggesting parallel processing with dialog process instead of background process , is it possible in this case?

Re: Parallel Processing with SUBMIT program

Sandra_Rossi — Thu, 05 Sep 2024 14:53:45 GMT

You are asking yourself too many questions ;-). Just run a real case, see what the problems are, and fix them in a simple way. It's the same question as a SELECT performance issue, you can know only after running in a production-like system.