Our production server imports data at a rate of 1 record/second. In development with much smaller dataset in repository, the import is 50x faster. The time is spent during the step GetMatchedNumberForRecordValues
Our table being imported has 5 key values; it has 6m rows. I know its quite large, but in DB world we have seen tables more than 6m rows....
Has anyone seen this problem? what solution did you find?
for mass or bulk import of data( MDIS OR IMPORT MANAGER ) Which one is the best ? can any tell explain clearly why ?
Thank you in advance.
Import Server(MDIS) is best for importing Mass or Bulk Data. Please verify this on Page 246/403 of MDM Console Reference Guide. Table 63. Conceptual Differences Between Import Manager and MDIS
Maximum import file size Limited (50,000 records) for IM Unlimited for MDIS
I think you need to make use of Import sleep time and Import Slice Size parameters for MDM Optimized Performance.
How to configure these Parameters for this Please refer below thread:
Also please refer, Table 59. Optional MDM Server Parameters of MDM Console Reference Guide:
parameters like: Bulk Import Silo Page 226-227/403
Hope it helps..
Bulk Data should be imported using Import Manager rather than Import Server. What guide is saying that is not always correct.
In real time scenarios, bulk data is always loaded using Excel format and using manual import.
Rest for performance the issue while using Import Server is resolved in MDM 7.1 SP04. Please refer SAP release note from service market place.