Insertion times for new records using modelService.save takes a long time when the table is large

[Former Member]

We are experiencing issues in Hybris 6.5 where modelService.save(...) is taking a long time to insert in new records when our table sizes grow large (>200k records). I've seen that modelService.save(...) executes a query before saving to determine if a record exists or not. We've taken steps to index the field that modelService.save(...) uses but we are still not seeing any performance improvements.

Any suggestions on how to improve the performance of modelService.save(...)?:

[Former Member]

1. How exactly do you measure the performance of modelService.save()?

2. were you able to detect SQLs executed within a context of single modelService.save()?

3. I've seen that modelService.save(...) executes a query before saving to determine if a record exists or not. . - that query is part of an interceptor which controls uniqueness of attributes defined in a corresponding *items.xml. Have you seen how long the executed SQL takes?

[Former Member]

modelservice.save / saveall does execute a query to validate if the record exists or not.. The search is on the pk of the prescribed table. I tried to execute this in a multi threaded executor , but noticed some spring injection issues.

I eventually ended up changing the logic to import the necessary data via impex using the importservice API with a thread count set to 8. Noticed stable execution times and the batch import completed pretty quickly

[Former Member]

Were you able to may any headway on this

[Former Member]

It was ultimately because of the indexes. There is still some considerable performance hit due to the way that modelService.save(...) works but if you optimize your indexes, it should minimize the impact.