Application Development Discussions
Join the discussions or start your own on all things application development, including tools and APIs, programming models, and keeping your skills sharp.
cancel
Showing results for 
Search instead for 
Did you mean: 

Processing large internal table in parallel and background job

0 Kudos
632

Hi friends,

I would like to have a sample of how split a very large internal table for processing in parallel background jobs - is there a half-working sample for that already somewhere ?

thanks in advance, points immediately!

Clemens

1 ACCEPTED SOLUTION

Clemenss
Active Contributor
0 Kudos
147

Hi namesake,

just few days ago I posted in wiki code gallery.

<a href="https://wiki.sdn.sap.com/wiki/display/Snippets/Easilyimplementparallelprocessinginonlineandbatchprocessing">Easily implement parallel processing in online and batch processing</a>

I created a report for a 'real' application of one of my customers where the splitting is done differently but I hope this is not the main problem. We are very convinced with the results because we don't get memory allocation dumps any longer and the processing time with (only) 4 parallel tasks is impressive.

The rest works fine. Copy and paste to your development system and play around. I amk eager to get any kind of feedback.

Feel free to ask any questions.

Regards,

Clemens

3 REPLIES 3

Former Member
0 Kudos
147

have a look this:<a href="http://help.sap.com/saphelp_470/helpdata/en/fa/096e92543b11d1898e0000e8322d00/content.htm">http://help.sap.com/saphelp_470/helpdata/en/fa/096e92543b11d1898e0000e8322d00/content.htm</a>

<a href="http://www.sciencedirect.com/science?_ob=ArticleURL&_udi=B6V12-43MJJR2-5&_user=10&_coverDate=10%2F31%2F2001&_rdoc=1&_fmt=&_orig=search&_sort=d&view=c&_acct=C000050221&_version=1&_urlVersion=0&_userid=10&md5=7c2c6a90fce5bce58f5d13e032f841b1">http://www.sciencedirect.com/science?_ob=ArticleURL&_udi=B6V12-43MJJR2-5&_user=10&_coverDate=10%2F31%2F2001&_rdoc=1&_fmt=&_orig=search&_sort=d&view=c&_acct=C000050221&_version=1&_urlVersion=0&_userid=10&md5=7c2c6a90fce5bce58f5d13e032f841b1</a>

Clemenss
Active Contributor
0 Kudos
148

Hi namesake,

just few days ago I posted in wiki code gallery.

<a href="https://wiki.sdn.sap.com/wiki/display/Snippets/Easilyimplementparallelprocessinginonlineandbatchprocessing">Easily implement parallel processing in online and batch processing</a>

I created a report for a 'real' application of one of my customers where the splitting is done differently but I hope this is not the main problem. We are very convinced with the results because we don't get memory allocation dumps any longer and the processing time with (only) 4 parallel tasks is impressive.

The rest works fine. Copy and paste to your development system and play around. I amk eager to get any kind of feedback.

Feel free to ask any questions.

Regards,

Clemens

Former Member
0 Kudos
147

hi

good

please check this

You could use Function Modules to process batch of data

Suppose a first database table can "pilot" the job

Main Program

(1) Declare cursor

(2) Fetch 1000, 10000 records

(3) Call FM STARTING NEW TASK (destination NONE if one application server, else loop on available servers) passing the records in a table parameter PERFORMING a routine at end which receives results in internal table parameters

(Count number of call and decrement in end-routine)

(4) process until end of data

(5) wait until all processes come to end

(6) terminate the job

thanks

mrutyun^