Question Re: Installing Python packages such as JSON, Itertools into custom docker file in Technology Q&A

Installing Python packages such as JSON, Itertools into custom docker file

Former Member — Thu, 05 Mar 2020 10:59:49 GMT

Hi,

We are trying to install some of the important python packages such as json and itertools and we are getting an error: build failed for image: 438089681528.dkr.ecr.eu-west-1.amazonaws.com/vora/vflow-node-599c7770d1fe9d07864561b70e8dea72a77026c4:2.6.12-com.xxxxxxx.python3.testpythondocker. The strange thing is other popular packages such as numpy, pandas, matplotlib, seaborn are downloading into the same docker file without any issues. Could somebody help us to understand what's going on here? Thanks in advance.

Re: Installing Python packages such as JSON, Itertools into custom docker file

architectSAP — Thu, 05 Mar 2020 12:32:04 GMT

Hello Rohith,

If you do not need the latest version of the itertools, installing version 3.6 works for me:

FROM $com.sap.sles.base
RUN pip3.6 install itertools==3.6

Best regards

Re: Installing Python packages such as JSON, Itertools into custom docker file

Vitaliy-R — Thu, 05 Mar 2020 16:02:52 GMT

Hi Rohith. It would be helpful if you paste the full Dockerfile content and Data Hub version, otherwise it is difficult for others to answer what might be happening.

As well, have you looked into more detailed information in `Trace` tab with `INFO | Enabled` when building the Docker image?

Re: Installing Python packages such as JSON, Itertools into custom docker file

Former Member — Fri, 06 Mar 2020 06:13:08 GMT

Yes, I have looked into Trace for more detailed information it basically gives a bunch of error messages related to failure of building the docker files only for libraries such as itertools, json. The Data Hub version is 2.6. The docker file consists of nothing but other libraries such as numpy, pandas, matplotlib which are getting downloaded without any issues. Hope this information helps.

Re: Installing Python packages such as JSON, Itertools into custom docker file

Former Member — Fri, 06 Mar 2020 06:20:13 GMT

Hi Frank,

Thanks for the suggestion. I am not specific about the version, hence I tried the one you mentioned but still it gives me the error with the docker file. Tried with a slightly modified version of the above command :

RUN python3 -m pip install tornado==5.0.2 itertools==3.6

But the error persists

Re: Installing Python packages such as JSON, Itertools into custom docker file

architectSAP — Sat, 07 Mar 2020 14:36:45 GMT

Your Docker RUN command works for me.

To Witalij's point, what version of SAP Data Hub are you using and on what Docker file are you basing your custom one?

Best regards

Re: Installing Python packages such as JSON, Itertools into custom docker file

Former Member — Mon, 09 Mar 2020 05:48:44 GMT

SAP Data Hub version 2.6 and the base operator being used is Python3.

Re: Installing Python packages such as JSON, Itertools into custom docker file

architectSAP — Tue, 10 Mar 2020 10:15:56 GMT

I see. Thank you Rohith. Please also post the code of your custom Docker file please.

Best regards