topic Re: Processing large internal table in parallel and background job in Application Development and Automation Discussions

Processing large internal table in parallel and background job

former_member5350 — Tue, 04 Dec 2007 13:43:19 GMT

Hi friends,

I would like to have a sample of how split a very large internal table for processing in parallel background jobs - is there a half-working sample for that already somewhere ?

thanks in advance, points immediately!

Clemens

Re: Processing large internal table in parallel and background job

Former Member — Tue, 04 Dec 2007 13:55:28 GMT

have a look this:<a href="http://help.sap.com/saphelp_470/helpdata/en/fa/096e92543b11d1898e0000e8322d00/content.htm">http://help.sap.com/saphelp_470/helpdata/en/fa/096e92543b11d1898e0000e8322d00/content.htm</a>

<a href="http://www.sciencedirect.com/science?_ob=ArticleURL&_udi=B6V12-43MJJR2-5&_user=10&_coverDate=10%2F31%2F2001&_rdoc=1&_fmt=&_orig=search&_sort=d&view=c&_acct=C000050221&_version=1&_urlVersion=0&_userid=10&md5=7c2c6a90fce5bce58f5d13e032f841b1">http://www.sciencedirect.com/science?_ob=ArticleURL&_udi=B6V12-43MJJR2-5&_user=10&_coverDate=10%2F31%2F2001&_rdoc=1&_fmt=&_orig=search&_sort=d&view=c&_acct=C000050221&_version=1&_urlVersion=0&_userid=10&md5=7c2c6a90fce5bce58f5d13e032f841b1</a>

Re: Processing large internal table in parallel and background job

Clemenss — Tue, 04 Dec 2007 14:05:21 GMT

Hi namesake,

just few days ago I posted in wiki code gallery.

<a href="https://wiki.sdn.sap.com/wiki/display/Snippets/Easilyimplementparallelprocessinginonlineandbatchprocessing">Easily implement parallel processing in online and batch processing</a>

I created a report for a 'real' application of one of my customers where the splitting is done differently but I hope this is not the main problem. We are very convinced with the results because we don't get memory allocation dumps any longer and the processing time with (only) 4 parallel tasks is impressive.

The rest works fine. Copy and paste to your development system and play around. I amk eager to get any kind of feedback.

Feel free to ask any questions.

Regards,

Clemens

Re: Processing large internal table in parallel and background job

Former Member — Tue, 04 Dec 2007 14:22:26 GMT

good

please check this

You could use Function Modules to process batch of data

Suppose a first database table can "pilot" the job

Main Program

(1) Declare cursor

(2) Fetch 1000, 10000 records

(3) Call FM STARTING NEW TASK (destination NONE if one application server, else loop on available servers) passing the records in a table parameter PERFORMING a routine at end which receives results in internal table parameters

(Count number of call and decrement in end-routine)

(4) process until end of data

(5) wait until all processes come to end

(6) terminate the job

thanks

mrutyun^