Example Parallelization based on table partitions

[jan_zwickel]

This example is referenced in my other post about parallelization. Please have a look at the other post to get a better understanding of the context for this example.

 

How to control parallelization in your model

This example assumes that you have implemented the model described here. You can also download the model here.

 

Define start node for parallelization

To start parallelization in the Projection node "startParallelization" (1.), go to the Mapping dialog (2.), select the data source (3.) and open the properties (4.). In the properties, select "Partition Local Execution"

 



start parallelization in node "startParallelization"

 

Define stop node for parallelization

To stop parallelization in node "stopParallelization" open the details of the Union node "stopParallelization", navigate again to the properties of the data source and set the flag for "Partition Local Execution":



stop parallelization in node "stopParallelization"

 

With this setting every node between nodes "startParallelization" and "stopParallelization" will be executed in parallel for each partition of the data source table of node "startParallelization". For simplicity only one node was inserted between the start and stop nodes of the parallelization block but you could have multiple nodes between the start and stop nodes.

 Setting the parallelization flag based on table partitions will block unfolding (for background information on unfolding see SAP Note 2291812 and SAP Note 2223597) as blocked unfolding is a pre-requisite to use this functionality.

Click here to navigate back to the context in which this model is used. You will also find examples there.