In hot folder, files are moving to archive folder before importing the impex

[kraghukapa1]

Hello Experts,

intermittently Impex import job is throwing file not found exception during the media model creation from the hot folder, I'm suspecting media files are moving to archive folder before importing the impex. please provide your valuable suggestions to fix the issue.

{"mdc":{"CronJob":"(0000LBTO) "},"exception":{"exception_class":"de.hybris.platform.impex.jalo.ImpExException","exception_message":"Can not find file: /opt/hybris/data/osb/media/csv/processing/WTR-169360-extra2.png","stacktrace":"de.hybris.platform.impex.jalo.ImpExException: Can not find file: /opt/hybris/data/osb/media/csv/processing/WTR-169360-extra2.png[HY-0]\n\tat de.hybris.platform.impex.jalo.media.DefaultMediaDataHandler.setDataFromAbsolutePath(DefaultMediaDataHandler.java:154)\n\tat de.hybris.platform.impex.jalo.media.DefaultMediaDataHandler.importData(DefaultMediaDataHandler.java:80)\n\tat de.hybris.platform.impex.jalo.cronjob.DefaultCronJobMediaDataHandler.importData(DefaultCronJobMediaDataHandler.java:134)\n\tat de.hybris.platform.impex.jalo.media.MediaDataTranslator.performImport(MediaDataTranslator.java:151)\n\tat com.test.interfaces.dataimport.translator.impl.SourceFileDeletingMediaDataTranslator.performImport(SourceFileDeletingMediaDataTranslator.java:20)\n\tat de.hybris.platform.impex.jalo.header.SpecialColumnDescriptor.performImport(SpecialColumnDescriptor.java:129)\n\tat de.hybris.platform.impex.jalo.imp.DefaultImportProcessor.processInsertLine(DefaultImportProcessor.java:584)\n\tat de.hybris.platform.impex.jalo.imp.DefaultImportProcessor.processInsertUpdateLineInternal(DefaultImportProcessor.java:491)\n\tat de.hybris.platform.impex.jalo.imp.DefaultImportProcessor$4.execute(DefaultImportProcessor.java:465)\n\tat de.hybris.platform.impex.jalo.imp.DefaultImportProcessor$4.execute(DefaultImportProcessor.java:1)\n\tat de.hybris.platform.tx.Transaction.execute(Transaction.java:1264)\n\tat de.hybris.platform.tx.Transaction.execute(Transaction.java:1182)\n\tat de.hybris.platform.impex.jalo.imp.DefaultImportProcessor.processInsertUpdateLine(DefaultImportProcessor.java:460)\n\tat de.hybris.platform.impex.jalo.imp.DefaultImportProcessor.processItemData_Impl(DefaultImportProcessor.java:253)\n\tat de.hybris.platform.impex.jalo.imp.DefaultImportProcessor.processItemData(DefaultImportProcessor.java:152)\n\tat de.hybris.platform.impex.jalo.imp.ImpExImportReader.processLine(ImpExImportReader.java:716)\n\tat de.hybris.platform.impex.jalo.imp.ImpExImportReader.readLine(ImpExImportReader.java:515)\n\tat de.hybris.platform.impex.jalo.Importer.doImport(Importer.java:282)\n\tat de.hybris.platform.impex.jalo.Importer.importNextInternal(Importer.java:786)\n\tat de.hybris.platform.impex.jalo.Importer.importNext(Importer.java:767)\n\tat de.hybris.platform.impex.jalo.cronjob.ImpExImportJob.doImport(ImpExImportJob.java:281)\n\tat de.hybris.platform.impex.jalo.cronjob.ImpExImportJob.performJob(ImpExImportJob.java:242)\n\tat de.hybris.platform.impex.jalo.cronjob.ImpExImportJob.performCronJob(ImpExImportJob.java:112)\n\tat de.hybris.platform.cronjob.jalo.Job.performCronJobWithReadOnlySetting(Job.java:1452)\n\tat de.hybris.platform.cronjob.jalo.Job.execute(Job.java:1386)\n\tat de.hybris.platform.cronjob.jalo.Job.performImpl(Job.java:795)\n\tat de.hybris.platform.cronjob.jalo.Job.performImpl(Job.java:710)\n\tat de.hybris.platform.cronjob.jalo.Job.perform(Job.java:622)\n\tat de.hybris.platform.servicelayer.cronjob.impl.DefaultCronJobService.performCronJob(DefaultCronJobService.java:81)\n\tat de.hybris.platform.servicelayer.impex.impl.DefaultImportService.importData(DefaultImportService.java:484)\n\tat de.hybris.platform.servicelayer.impex.impl.DefaultImportService.importDataUsingStandardImpex(DefaultImportService.java:414)\n\tat de.hybris.platform.servicelayer.impex.impl.DefaultImportService.importData(DefaultImportService.java:102)\n\tat de.hybris.platform.servicelayer.impex.impl.DefaultImportService$$FastClassBySpringCGLIB$$f919a821.invoke(<generated>)\n\tat org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218)\n\tat org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:783)\n\tat org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)\n\tat org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:753)\n\tat org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:89)\n\tat de.hybris.platform.cloud.hotfolder.aop.ImpexImportAspect.aroundImportData(ImpexImportAspect.java:110)\n\tat jdk.internal.reflect.GeneratedMethodAccessor3506.invoke(Unknown Source)\n\tat java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\n\tat java.base/java.lang.reflect.Method.invoke(Method.java:566)\n\tat org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:634)\n\tat org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:624)\n\tat org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:72)\n\tat org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175)\n\tat org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:753)\n\tat org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97)\n\tat org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)\n\tat org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:753)\n\tat org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:698)\n\tat de.hybris.platform.servicelayer.impex.impl.DefaultImportService$$EnhancerBySpringCGLIB$$dee9fcee.importData(<generated>)\n\tat com.test.interfaces.dataimport.task.AbstractElabImpexRunnerTask.processFile(AbstractElabImpexRunnerTask.java:62)\n\tat com.test.interfaces.dataimport.task.AbstractElabImpexRunnerTask.lambda$0(AbstractElabImpexRunnerTask.java:43)\n\tat java.base/java.lang.Iterable.forEach(Iterable.java:75)\n\tat com.test.interfaces.dataimport.task.AbstractElabImpexRunnerTask.execute(AbstractElabImpexRunnerTask.java:43)\n\tat com.test.interfaces.dataimport.task.AbstractElabImpexRunnerTask$$FastClassBySpringCGLIB$$92c0b293.invoke(<generated>)\n\tat org.springframework.cglib.proxy.MethodProxy.invoke(MethodProxy.java:218)\n\tat org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.invokeJoinpoint(CglibAopProxy.java:783)\n\tat org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)\n\tat org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:753)\n\tat org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:89)\n\tat de.hybris.platform.cloud.hotfolder.aop.BatchHeaderAspect.internalMonitor(BatchHeaderAspect.java:244)\n\tat de.hybris.platform.cloud.hotfolder.aop.BatchHeaderAspect.aroundExecute(BatchHeaderAspect.java:215)\n\tat jdk.internal.reflect.GeneratedMethodAccessor3496.invoke(Unknown Source)\n\tat java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\n\tat java.base/java.lang.reflect.Method.invoke(Method.java:566)\n\tat org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:634)\n\tat org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:624)\n\tat org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:72)\n\tat org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:175)\n\tat org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:753)\n\tat org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:89)\n\tat de.hybris.platform.acceleratorservices.dataimport.batch.aop.ExceptionHandlerAspect.execute(ExceptionHandlerAspect.java:29)\n\tat jdk.internal.reflect.GeneratedMethodAccessor3446.invoke(Unknown Source)\n\tat java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\n\tat java.base/java.lang.reflect.Method.invoke(Method.java:566)\n\tat org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:634)\n\tat org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:624)\n\tat org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:72)\n\tat org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)\n\tat org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:753)\n\tat org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:89)\n\tat de.hybris.platform.acceleratorservices.dataimport.batch.aop.TenantActivationAspect.execute(TenantActivationAspect.java:45)\n\tat jdk.internal.reflect.GeneratedMethodAccessor3133.invoke(Unknown Source)\n\tat java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\n\tat java.base/java.lang.reflect.Method.invoke(Method.java:566)\n\tat org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:634)\n\tat org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:624)\n\tat org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:72)\n\tat org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)\n\tat org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:753)\n\tat org.springframework.aop.aspectj.MethodInvocationProceedingJoinPoint.proceed(MethodInvocationProceedingJoinPoint.java:89)\n\tat de.hybris.platform.acceleratorservices.dataimport.batch.aop.TimeMeasurementAspect.measure(TimeMeasurementAspect.java:31)\n\tat jdk.internal.reflect.GeneratedMethodAccessor3445.invoke(Unknown Source)\n\tat java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\n\tat java.base/java.lang.reflect.Method.invoke(Method.java:566)\n\tat org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethodWithGivenArgs(AbstractAspectJAdvice.java:634)\n\tat org.springframework.aop.aspectj.AbstractAspectJAdvice.invokeAdviceMethod(AbstractAspectJAdvice.java:624)\n\tat org.springframework.aop.aspectj.AspectJAroundAdvice.invoke(AspectJAroundAdvice.java:72)\n\tat org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)\n\tat org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:753)\n\tat org.springframework.aop.interceptor.ExposeInvocationInterceptor.invoke(ExposeInvocationInterceptor.java:97)\n\tat org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)\n\tat org.springframework.aop.framework.CglibAopProxy$CglibMethodInvocation.proceed(CglibAopProxy.java:753)\n\tat org.springframework.aop.framework.CglibAopProxy$DynamicAdvisedInterceptor.intercept(CglibAopProxy.java:698)\n\tat com.test.interfaces.dataimport.task.AbstractElabImpexRunnerTask$$EnhancerBySpringCGLIB$$248b777e.execute(<generated>)\n\tat jdk.internal.reflect.GeneratedMethodAccessor3495.invoke(Unknown Source)\n\tat java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\n\tat java.base/java.lang.reflect.Method.invoke(Method.java:566)\n\tat org.springframework.messaging.handler.invocation.InvocableHandlerMethod.doInvoke(InvocableHandlerMethod.java:169)\n\tat org.springframework.messaging.handler.invocation.InvocableHandlerMethod.invoke(InvocableHandlerMethod.java:119)\n\tat org.springframework.integration.handler.support.MessagingMethodInvokerHelper$HandlerMethod.invoke(MessagingMethodInvokerHelper.java:1105)\n\tat org.springframework.integration.handler.support.MessagingMethodInvokerHelper.invokeHandlerMethod(MessagingMethodInvokerHelper.java:583)\n\tat org.springframework.integration.handler.support.MessagingMethodInvokerHelper.processInternal(MessagingMethodInvokerHelper.java:478)\n\tat org.springframework.integration.handler.support.MessagingMethodInvokerHelper.process(MessagingMethodInvokerHelper.java:356)\n\tat org.springframework.integration.handler.MethodInvokingMessageProcessor.processMessage(MethodInvokingMessageProcessor.java:108)\n\tat org.springframework.integration.handler.ServiceActivatingHandler.handleRequestMessage(ServiceActivatingHandler.java:105)\n\tat org.springframework.integration.handler.AbstractReplyProducingMessageHandler$AdvisedRequestHandler.handleRequestMessage(AbstractReplyProducingMessageHandler.java:206)\n\tat jdk.internal.reflect.GeneratedMethodAccessor3494.invoke(Unknown Source)\n\tat java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)\n\tat java.base/java.lang.reflect.Method.invoke(Method.java:566)\n\tat org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:344)\n\tat org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:198)\n\tat org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:163)\n\tat org.springframework.integration.handler.advice.AbstractRequestHandlerAdvice$CallbackImpl.execute(AbstractRequestHandlerAdvice.java:151)\n\tat com.test.interfaces.dataimport.status.AbstractLogAdvice.invokeHandler(AbstractLogAdvice.java:35)\n\tat com.test.interfaces.dataimport.status.ExpressionFileLogAdvice.invokeHandlerWithLogging(ExpressionFileLogAdvice.java:42)\n\tat com.test.interfaces.dataimport.status.AbstractLogAdvice.doInvoke(AbstractLogAdvice.java:24)\n\tat org.springframework.integration.handler.advice.AbstractRequestHandlerAdvice.invoke(AbstractRequestHandlerAdvice.java:67)\n\tat org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)\n\tat org.springframework.integration.handler.advice.AbstractRequestHandlerAdvice$CallbackImpl.execute(AbstractRequestHandlerAdvice.java:151)\n\tat com.test.interfaces.dataimport.status.AbstractLogAdvice.invokeHandler(AbstractLogAdvice.java:35)\n\tat com.test.interfaces.dataimport.status.ImportLogAdvice.invokeHandlerWithLogging(ImportLogAdvice.java:29)\n\tat com.test.interfaces.dataimport.status.AbstractLogAdvice.doInvoke(AbstractLogAdvice.java:24)\n\tat org.springframework.integration.handler.advice.AbstractRequestHandlerAdvice.invoke(AbstractRequestHandlerAdvice.java:67)\n\tat org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:186)\n\tat org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:215)\n\tat com.sun.proxy.$Proxy261.handleRequestMessage(Unknown Source)\n\tat org.springframework.integration.handler.AbstractReplyProducingMessageHandler.doInvokeAdvisedRequestHandler(AbstractReplyProducingMessageHandler.java:153)\n\tat org.springframework.integration.handler.AbstractReplyProducingMessageHandler.handleMessageInternal(AbstractReplyProducingMessageHandler.java:137)\n\tat org.springframework.integration.handler.AbstractMessageHandler.handleMessage(AbstractMessageHandler.java:56)\n\tat org.springframework.integration.endpoint.PollingConsumer.handleMessage(PollingConsumer.java:158)\n\tat org.springframework.integration.endpoint.AbstractPollingEndpoint.messageReceived(AbstractPollingEndpoint.java:449)\n\tat org.springframework.integration.endpoint.AbstractPollingEndpoint.doPoll(AbstractPollingEndpoint.java:435)\n\tat org.springframework.integration.endpoint.AbstractPollingEndpoint.pollForMessage(AbstractPollingEndpoint.java:387)\n\tat org.springframework.integration.endpoint.AbstractPollingEndpoint.lambda$null$4(AbstractPollingEndpoint.java:331)\n\tat org.springframework.integration.util.ErrorHandlingTaskExecutor.lambda$execute$0(ErrorHandlingTaskExecutor.java:57)\n\tat org.springframework.core.task.SyncTaskExecutor.execute(SyncTaskExecutor.java:50)\n\tat org.springframework.integration.util.ErrorHandlingTaskExecutor.execute(ErrorHandlingTaskExecutor.java:55)\n\tat org.springframework.integration.endpoint.AbstractPollingEndpoint.lambda$createPoller$5(AbstractPollingEndpoint.java:328)\n\tat org.springframework.scheduling.support.DelegatingErrorHandlingRunnable.run(DelegatingErrorHandlingRunnable.java:54)\n\tat org.springframework.scheduling.concurrent.ReschedulingRunnable.run(ReschedulingRunnable.java:95)\n\tat java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515)\n\tat java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)\n\tat java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628)\n\tat java.base/java.lang.Thread.run(Thread.java:829)\nCaused by: java.io.FileNotFoundException: /opt/hybris/data/osb/is23/wtctr/csv/processing/WTR-169360-extra2.png (No such file or directory)\n\tat java.base/java.io.FileInputStream.open0(Native Method)\n\tat java.base/java.io.FileInputStream.open(FileInputStream.java:219)\n\tat java.base/java.io.FileInputStream.<init>(FileInputStream.java:157)\n\tat de.hybris.platform.impex.jalo.media.DefaultMediaDataHandler.getAsInputStream(DefaultMediaDataHandler.java:164)\n\tat de.hybris.platform.impex.jalo.media.DefaultMediaDataHandler.setDataFromAbsolutePath(DefaultMediaDataHandler.java:144)\n\t... 158 more\n"},"@version":1,"source_host":"backgroundprocessing-555fb6dbff-ppxkj","message":"Exception ocurred, will ignore: de.hybris.platform.impex.jalo.ImpExException: Can not find file: /opt/hybris/data/osb/is23/wtctr/csv/processing/WTR-169360-extra2.png[HY-0]","thread_name":"task-scheduler-2","@timestamp":"2023-02-24T13:51:42.950+03:00","level":"ERROR","logger_name":"de.hybris.platform.impex.jalo.cronjob.CronJobErrorHandler"}

[Harish_Vatsa]

Hi,

Can you please check the permissions on the hot folder and archive folder? Please make sure that the user account running the import cron job has sufficient permissions to access both folders.

Kind Regards,

HV