cancel
Showing results for 
Search instead for 
Did you mean: 
Read only

Creating performant pushdown SQL in Oracle

Former Member
0 Likes
317

I am using DS 3.1 and the ECCD methodology and have the following issue in Oracle. The situation is as follows -

I have two datastores, each pointing to diffferent schemas.

SourceDS - SchemaA

Tables - SourceTab

ExtractDS - SchemaB

Tables - ExtractTab

My extract DF is extremly simple,

SourceTAB -> Query -> ExtractTab.

This DF produces a simple SELECT ... from SourceTAB piece of SQL and not an INSERT /+ APPEND/ INTO ... piece of SQL which will perform much better.

I assume that DI thinks that SchemaB cannot see SchemaA's tables and therefore brings the data into the engine from SourceTab and then pushes it into ExtractTab.

To overcome this SchemaA has granted select privilege on SourceTab to SchemaB.

Then I import SourceTab into ExtractDS. Having both tables in the same DS allows DI to produce the required INSERT /+ APPEND/ INTO ... piece of SQL.

How can I achieve the performant SQL without the tables being in the same DS, but remaining in their orignal datastores ?

Any ideas please ?

View Entire Topic
Former Member
0 Likes

you can use database links to acheive full push down between tables in different datastore.

But you may run into issues depending on sql statement with dblinks if you have parallel option set for table, and both of your schemas are on same oracle database. You have to choose between PARALLEL and Complete push down

I have seen this issue with using MERGE to do Auto Correct load