Application Development and Automation Discussions
Join the discussions or start your own on all things application development, including tools and APIs, programming models, and keeping your skills sharp.
cancel
Showing results for 
Search instead for 
Did you mean: 
Read only

Doubt in back-ground parallel processing

Former Member
0 Likes
461

Hi Experts,

I have basic doubt regarding background processing.

I have a requirement of processing 2 million records, if I go with just back ground job scheduling it is taking too much time, they wanted to finish the job with in 2 hrs.

The solution is <u><b>background job parallel- processing</b></u>. I get into so many threads, I find the solutions in 2 ways. Please clarify my doubts

<u><b>First way solution:</b></u> I observed that as per the suggestion in threads for back ground just call the remote FMs in a New task.

<b>Doubt 1:</b> Is this process works in background mode. ?

<b>Doubt 2:</b> Suppose if the FM is calling more than 6 time, is it lead to dump, I mean to say we are creating more than 6 sessions in back ground by calling FMs in a New task..

<b>Doubt 3:</b> can we write submit program in that FM.

<u><b>2nd way solution:</b></u> Opening a job, summiting job and closing job.

<b>Doubt 1:</b> Suppose I split the 2 million records into 4 files each having 5 lacks. I opened job for first file and submitted to program using submit and return and close the job.

Once the first job is finished I will open 2nd job and do the same process above.

I feel this solution looks like serial processing, Please clarify my doubts, I need to implement the logic based on your suggestions?

Thanks in advance,

Basha

1 ACCEPTED SOLUTION
Read only

Former Member
0 Likes
422

Hi,

The 2nd solution seems to be good. But execute the second solution instead of Serial processing make as parallel processing.

You split 20 laks records into 4 parts, Each part having 5 lakh records and submit the same job 4 times and specify these 4 different parts.

I hope this will helps you.

The first solution also working fine but it will more expensive since your consuming the network bandwidth.

Regards

Bhupal Reddy

2 REPLIES 2
Read only

Former Member
0 Likes
423

Hi,

The 2nd solution seems to be good. But execute the second solution instead of Serial processing make as parallel processing.

You split 20 laks records into 4 parts, Each part having 5 lakh records and submit the same job 4 times and specify these 4 different parts.

I hope this will helps you.

The first solution also working fine but it will more expensive since your consuming the network bandwidth.

Regards

Bhupal Reddy

Read only

0 Likes
422

Hi Bhupal Reddy,

Thanks for your kind response. I need some more clarification from you.

As you said, if i go with 2nd solution, once i open the job you mean to say i need to call the FM "JOB_SUBMIT" 4 times. I think this will also works as serial processing way, once the 1st FM JOB_SUBMIT is get processed, then only 2nd FM JOB_SUBMIT get called. i hope you got my doubt. Please revert back to me with your suggestion.

Thanks,

Basha