Hot folder import is too slow. is it a better option to import the bulk data?.

[bhaskar_boddireddy]

We implemented the hot folder configuration to import the inventory data in our project.

Tried all the ImpexImport config options. Including the below thread configuration.

acceleratorservices.batch.impex.max-threads=8

impex.import.workers=12

legacyMode=true

synchronous=true

System has 8 cores where this import is running.

The import is happening dead slow, 30 records per mins. We are expecting 2 to 3 million records in each import.

Please suggest me any other options to try out to make the import faster through hot folder configuration.

Note: Tried synchronous false as well but with this option, Import is failing by throwing the below error.

00005WAT::de.hybris.platform.impex.jalo.cronjob.ImpExImportJob] (00005WAT) [ImpExImportJob] Couldn't allocate required threads to perform an import.

00005WAQ::de.hybris.platform.impex.jalo.cronjob.ImpExImportJob] (00005WAQ) [MultiThreadedImpExImportReader] 10 retries failed.