topic Re: Huge data uploads in Application Development and Automation Discussions

Huge data uploads

Former Member — Wed, 30 Aug 2006 14:33:43 GMT

I have the requirement to upload customers ,Materials .Each of them have around half a million records. Is there any method or procedure which will considerably reduce the time of run( I am using BAPI ).

Re: Huge data uploads

Former Member — Wed, 30 Aug 2006 14:40:57 GMT

i think no. The best way propably is to use LSMW project with idocs. YOu will easy mainain eventual errors.

BR, JAcek

Re: Huge data uploads

christian_wohlfahrt — Wed, 30 Aug 2006 15:07:59 GMT

Hi!

BAPI or IDOC - in general they need the same time (no discussion about +/- 10%).

With IDOC you will get an easy way to create the data in SAP parallel -> best way to get use all resource and reduce total runtime.

Deactivate change documents and application log. If change documents can't be deactivated by an import parameter, then make an extension in the xxx_document_write function module. This might give you about 20% better performance (depending on the total size of change docs / appl log tables).

Make a fresh runstat before starting -> all necessary check tables should have a good index access. Also a new version after half the run can help.

Regards,

Christian

Re: Huge data uploads

Former Member — Wed, 30 Aug 2006 15:19:02 GMT

You may want to consider turning off change documents.

Rob

Re: Huge data uploads

Former Member — Wed, 30 Aug 2006 15:31:30 GMT

Hi Sashi,

Rite now me too working with the same stuff and im using LSMW/direct input methods with AIP so im feeling very much comfortable and easy to upload tons of data...

for customers its RFBIDE00/0050

and Materials its RMDATIND/0020

any more questions plz ask...

Sony

Re: Huge data uploads

Former Member — Wed, 30 Aug 2006 15:49:28 GMT

I am looking at 2 million records and direct input doesn't have the simulate functionality. how does we know the capacity of data internal table can hold during execution ??

Thanks

sasi

Re: Huge data uploads

Former Member — Wed, 30 Aug 2006 15:52:56 GMT

I don't think you can do all of this at one time. Create a number of sessions and you can process some of them in parallel. You will probably have locking errors, but re-processing the sessions should fix them.

Rob

Re: Huge data uploads

Former Member — Wed, 30 Aug 2006 15:59:15 GMT

Using LSMW direct input is generally preferred option for master data upload. I am not really sure why do you need to simulate the upload for every record.

You can split the no of records in different sets & upload these sets one by one . After getting the log for first upload you will get some log for the records which are not uploaded . You can rectify the other sets accordingly which will reduce the furher processing time .

Hope this will help.

Re: Huge data uploads

Former Member — Wed, 30 Aug 2006 17:28:02 GMT

hi..as yogesh said u got to split the file and load...as im doin so n its working fine with the 2 prgms i mentioned earlier

sony