on 2021 Feb 08 12:03 PM
Hi Experts,
Whenever I upload a multiple files in Azure. Only one file is processed at a time . There is no parallel processing. Other files wait till the first gets completed.
Is there any way to make this process/import multiple files parallely.
Request clarification before answering.
See Section 8 here:
Also more documentation is here:
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.
It seems it was removed, probably due to the implications, the original values were these:
The thread pool size controls the number of files imported at the same time. By default the thread pool size is 1, which means that files are imported one at a time, and the import order is guaranteed. Increasing the pool size enables files to be imported in parallel, but the import order is then undefined and may result in files being imported in the wrong order. Only adjust these values if you understand the implications. Typically the two properties should be set to the same value. Setting a large value will have an impact on performance, particularly with large files. If you wish to import files in parallel, start with a pool size of 10 and test the performance of your imports.
PropertyDescriptionDefault Valueazure.hotfolder.storage.polling.core-pool-size=1Controls the core number of threads in the thread poolazure.hotfolder.storage.polling.max-pool-size=1Controls the maximum number of threads in the thread poolYou must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.
| User | Count |
|---|---|
| 4 | |
| 2 | |
| 1 | |
| 1 |
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.