cancel
Showing results for 
Search instead for 
Did you mean: 

PI 7.1 JDBC sender adapter huge load from DB select

AndyK
Explorer
0 Kudos
629

Hi,

We have the problem that the JDBC sender adapter is selecting a huge amount of data from a Oracle DB. The Adapter seems to be able to cope the load but when sending to the integration server it causes problems. We found values to adjust but I dont think increasing them is a good solution.

My question is:

Is there any way to send the data in blocks with using the PI standard JDBC adapter ?

Thank you and regards,

Andreas

View Entire Topic
naveen_chichili
Active Contributor
0 Kudos

Hi Andreas,

you can do into smaller chunks by select query.....

Example: You have to select 1000 records from the table using sender jdbc. What I would do ten times as follows.

--> In Select statement... select * from table where rownum < 100 and read_record="N" ;

--> in Update Statement update a field in the table like boolean from false to true or yes to No.

Example: Before you configure this scenario, create a column like read_record of type varchar2 or char of size(1) and default value is N. in the update statement , update the column for those 100 records read in the A) step as "Y".

This way you can reread the same table for every 100 records sequentially and make your message size same all the times.

Regards,

Naveen