Installing Python packages such as JSON, Itertools into custom docker file

[Former Member]

Hi,

We are trying to install some of the important python packages such as json and itertools and we are getting an error: build failed for image: 438089681528.dkr.ecr.eu-west-1.amazonaws.com/vora/vflow-node-599c7770d1fe9d07864561b70e8dea72a77026c4:2.6.12-com.xxxxxxx.python3.testpythondocker. The strange thing is other popular packages such as numpy, pandas, matplotlib, seaborn are downloading into the same docker file without any issues. Could somebody help us to understand what's going on here? Thanks in advance.

[Vitaliy-R]

Hi Rohith. It would be helpful if you paste the full Dockerfile content and Data Hub version, otherwise it is difficult for others to answer what might be happening.

As well, have you looked into more detailed information in `Trace` tab with `INFO | Enabled` when building the Docker image?

[Former Member]

Yes, I have looked into Trace for more detailed information it basically gives a bunch of error messages related to failure of building the docker files only for libraries such as itertools, json. The Data Hub version is 2.6. The docker file consists of nothing but other libraries such as numpy, pandas, matplotlib which are getting downloaded without any issues. Hope this information helps.

[architectSAP]

Hello Rohith,

If you do not need the latest version of the itertools, installing version 3.6 works for me:

FROM $com.sap.sles.base
RUN pip3.6 install itertools==3.6

Best regards

[Former Member]

Hi Frank,

Thanks for the suggestion. I am not specific about the version, hence I tried the one you mentioned but still it gives me the error with the docker file. Tried with a slightly modified version of the above command :

RUN python3 -m pip install tornado==5.0.2 itertools==3.6

But the error persists

[architectSAP]

Your Docker RUN command works for me.

To Witalij's point, what version of SAP Data Hub are you using and on what Docker file are you basing your custom one?

Best regards

[Former Member]

SAP Data Hub version 2.6 and the base operator being used is Python3.

[architectSAP]

I see. Thank you Rohith. Please also post the code of your custom Docker file please.

Best regards