topic Re: Processing multiple entries without parallel processing framework in Application Development and Automation Discussions

Processing multiple entries without parallel processing framework

Former Member — Wed, 27 Oct 2010 05:17:43 GMT

Apart from parallel processing framework, is there any other workaround to process multiple entries?

Scenario is as follows:

Retrieve all data from a master table for a certain criteria (close to 2 million entries selected).

Retrieved further data for each of these 2 million entries from another table(around 8 million entries now)

Summarise (basiacally collect) data for all these 8 million entries.

I have tried using SELECT ENDSELECT using package size to reduce the load to avoid memory issues.... but this is still a sequential approach rather than Parallel processing.

Any suggestions?

Thanks.

Re: Processing multiple entries without parallel processing framework

franois_henrotte — Wed, 04 May 2011 13:41:54 GMT

I suggest using OPEN CURSOR FOR SELECT with a join between your 2 tables

if you are able to use some ranges in order to separate entries into several blocks you can do it for each block in parallel

Re: Processing multiple entries without parallel processing framework

yuri_ziryukin — Wed, 04 May 2011 13:45:48 GMT

Please keep in mind that OPEN CURSOR is not compatible with an aRFC parallelization approach.