2007 Dec 04 1:43 PM
Hi friends,
I would like to have a sample of how split a very large internal table for processing in parallel background jobs - is there a half-working sample for that already somewhere ?
thanks in advance, points immediately!
Clemens
2007 Dec 04 2:05 PM
Hi namesake,
just few days ago I posted in wiki code gallery.
<a href="https://wiki.sdn.sap.com/wiki/display/Snippets/Easilyimplementparallelprocessinginonlineandbatchprocessing">Easily implement parallel processing in online and batch processing</a>
I created a report for a 'real' application of one of my customers where the splitting is done differently but I hope this is not the main problem. We are very convinced with the results because we don't get memory allocation dumps any longer and the processing time with (only) 4 parallel tasks is impressive.
The rest works fine. Copy and paste to your development system and play around. I amk eager to get any kind of feedback.
Feel free to ask any questions.
Regards,
Clemens
Hi namesake,
just few days ago I posted in wiki code gallery.
<a href="https://wiki.sdn.sap.com/wiki/display/Snippets/Easilyimplementparallelprocessinginonlineandbatchprocessing">Easily implement parallel processing in online and batch processing</a>
I created a report for a 'real' application of one of my customers where the splitting is done differently but I hope this is not the main problem. We are very convinced with the results because we don't get memory allocation dumps any longer and the processing time with (only) 4 parallel tasks is impressive.
The rest works fine. Copy and paste to your development system and play around. I amk eager to get any kind of feedback.
Feel free to ask any questions.
Regards,
Clemens
2007 Dec 04 1:55 PM
have a look this:<a href="http://help.sap.com/saphelp_470/helpdata/en/fa/096e92543b11d1898e0000e8322d00/content.htm">http://help.sap.com/saphelp_470/helpdata/en/fa/096e92543b11d1898e0000e8322d00/content.htm</a>
<a href="http://www.sciencedirect.com/science?_ob=ArticleURL&_udi=B6V12-43MJJR2-5&_user=10&_coverDate=10%2F31%2F2001&_rdoc=1&_fmt=&_orig=search&_sort=d&view=c&_acct=C000050221&_version=1&_urlVersion=0&_userid=10&md5=7c2c6a90fce5bce58f5d13e032f841b1">http://www.sciencedirect.com/science?_ob=ArticleURL&_udi=B6V12-43MJJR2-5&_user=10&_coverDate=10%2F31%2F2001&_rdoc=1&_fmt=&_orig=search&_sort=d&view=c&_acct=C000050221&_version=1&_urlVersion=0&_userid=10&md5=7c2c6a90fce5bce58f5d13e032f841b1</a>
2007 Dec 04 2:05 PM
Hi namesake,
just few days ago I posted in wiki code gallery.
<a href="https://wiki.sdn.sap.com/wiki/display/Snippets/Easilyimplementparallelprocessinginonlineandbatchprocessing">Easily implement parallel processing in online and batch processing</a>
I created a report for a 'real' application of one of my customers where the splitting is done differently but I hope this is not the main problem. We are very convinced with the results because we don't get memory allocation dumps any longer and the processing time with (only) 4 parallel tasks is impressive.
The rest works fine. Copy and paste to your development system and play around. I amk eager to get any kind of feedback.
Feel free to ask any questions.
Regards,
Clemens
2007 Dec 04 2:22 PM
hi
good
please check this
You could use Function Modules to process batch of data
Suppose a first database table can "pilot" the job
Main Program
(1) Declare cursor
(2) Fetch 1000, 10000 records
(3) Call FM STARTING NEW TASK (destination NONE if one application server, else loop on available servers) passing the records in a table parameter PERFORMING a routine at end which receives results in internal table parameters
(Count number of call and decrement in end-routine)
(4) process until end of data
(5) wait until all processes come to end
(6) terminate the job
thanks
mrutyun^
| User | Count |
|---|---|
| 3 | |
| 1 | |
| 1 | |
| 1 | |
| 1 | |
| 1 | |
| 1 | |
| 1 | |
| 1 | |
| 1 |