Connecting to HTTPS webpage

[Former Member]

Hi,

I have a requirement to connect to a HTTPS webpage and get XML file data using Data Service 3.2

The external website does not offer webservice or FTP.So my only option is to use HTTP Adapter.

From the forum,I understood that the Axis2.XML need to be modified to connect to HTTPS link using HTTP Adapter.

But could some one help me with the below.

Can we use HTTP Adapter and GET Request to read a XML file from HTTPS website

How to pass username and password to the HTTPS URL

I have changed the Axis2.XML.Where to place the certificates of the URL.Do I need to use keystore?

Any alternate approach to be followed other than HTTP Adapter?

Thanks,

Rajeswari

[Former Member · Accepted solution]

Rajeswari,

I have never done this. But my understanding on this matter is you can use 'wget' to download files from the web.

You may have to insert wget inside the exec() and run to retrieve the files.

Arun

[Former Member · Accepted solution]

@ Arun...Thanks for the reply.We are paralelly looking at the optiions of using UNIX commands to download file from website.

But if possible we would like to explore and make use of HTTP Adapters for our requirement.

Could any of you share the high level procedure to follow in order to connect to a simple HTTP website using HTTP Adapter.

I searched the SAP portal and forums but could not find any documents for HTTP Adapter usage with a webpage.Most of the documentation explains HTTP Adapter to connect to webservice.

[Former Member · Accepted solution]

@ Arun...Thanks for the reply.We are paralelly looking at the optiions of using UNIX commands to download file from website.

But if possible we would like to explore and make use of HTTP Adapters for our requirement.

Could any of you share the high level procedure to follow in order to connect to a simple HTTP website using HTTP Adapter.

I searched the SAP portal and forums but could not find any documents for HTTP Adapter usage with a webpage.Most of the documentation explains HTTP Adapter to connect to webservice.

[Former Member · Accepted solution]

Rajeshwari,

Have you had a look at the SAP DS Management Console Admin guide? You can follow the link and download the pdf file.

http://help.sap.com/businessobject/product_guides/boexir32SP1/en/xi321_ds_admin_en.pdf

Arun

[Former Member · Accepted solution]

Also check this posts/blog, you may get some information and potentially solve your problem -

Arun

[Former Member · Accepted solution]

Hi,

I have been referring to the Adapter guides,and wanted to try the sample HTTP Jobs available in the DS job server.

I configured the Adapter in Admin Console.Created a Request/Reply operation and imported the function into the designer successfully.

But when I try to execute the job I get the below error message.

Error calling function <HTTP_Function>:Unexpected end of file from server.

Also i have attached my error log.Is this issue related to the target URL

3/6/12 3:36:49 PM Thread[Thread-13,5,main] Entering handleRequest method..

3/6/12 3:36:49 PM Thread[Thread-13,5,main] Operation: HTTP_ReqReply_Function

3/6/12 3:36:49 PM Thread[Thread-13,5,main] Connecting to servletURL: http://<host:port>/DataServices/admin/servlet/http?ServiceName=Test

3/6/12 3:36:49 PM Thread[Thread-13,5,main] Handle request data: <?xml version="1.0" encoding="UTF-8"?>

<!-- BusinessObjects Data Services generated XML -->

<!-- 2012-03-06.15:36:47(213,584)[1] -->

<test>

<Input_string>Hello World</Input_string>

</test>

3/6/12 3:36:49 PM Thread[Thread-13,5,main] Protocol is: http

3/6/12 3:36:49 PM Thread[Thread-13,5,main] In HTTP Protocol handling..

3/6/12 3:36:49 PM Thread[Thread-13,5,main] sendToServlet in ...

3/6/12 3:36:49 PM Thread[Thread-13,5,main] Before SendToServlet...

3/6/12 3:36:49 PM Thread[Thread-13,5,main] sendToServlet out ...

3/6/12 3:36:49 PM Thread[Thread-13,5,main] Unexpected end of file from server

3/6/12 3:36:49 PM Thread[Thread-13,5,main] Leaving handleRequest method...

3/6/12 3:36:49 PM Thread[Thread-13,5,main] Unexpected end of file from server

3/6/12 3:36:49 PM Thread[Thread-13,5,main] Unexpected end of file from server.

Could you please help me in identifying the issue.

Thanks!!!

Rajeswari

[Former Member · Accepted solution]

Have you configured the adapter to the job server in the console?

Arun

[Former Member · Accepted solution]

Hi,

Job Server(UNIX) had Adapter configured on port 4001.

Also we already have MSExcelAdapter in place and succesfully running.

Do we have to check for anything other than this.

Rajeswari

[Former Member · Accepted solution]

The Adapter and its operation is configured and successfully started in Admin Console

[Former Member · Accepted solution]

Is there any Character limit set before the operation or during the configuration? If there is a default value, increase the limit and see.

Arun

[Former Member · Accepted solution]

No Arun..I cannot find any limits being set..

Could this issue be related to the Target URL that I have used when configuring the Adapter operations.

My DS Web Console link is https://hostname:portnumber/DataServices/admin.jsp

And I used the below as my target URL

http://hostname:portnumber/DataServices/admin/servlet/http?ServiceName=Test.

but if i use

https://hostname:portnumber/DataServices/admin/servlet/http?ServiceName=Test, I get below error message

Error calling function <HTTP_ReqReply_Function>: <Adapter Request_Reply: java.security.cert.CertificateException: Untrusted Server Certificate Chain

Could you please guide me on how this Target URL needs to be defined when configuring Adapter operation.

Thanks,

Rajeswari

[Former Member · Accepted solution]

Hi,

For HTTP and HTTPS operation the target URL is different. Following should be your

target URL for HTTP and HTTPS.

For HTTP operation, use:

http://ds_host_name:access_server_port/admin/servlet/com.ac

ta.adapter.http.server.HTTPActaServlet?ServiceName=Test

For HTTPS operation, use:

https://ds_host_name:tomcat_https_port/admin/servlet/com.ac

ta.adapter.http.server.HTTPActaServlet?ServiceName=Test

Note:

By default, the HTTPS port of the Tomcat server is 8443. This can be changed

in the Tomcat configuration file (acta-server.xml on Windows, and actaserver1.

xml on UNIX)

[Former Member · Accepted solution]

Also check your Firewall and Port settings.

Arun

[Former Member · Accepted solution]

Hi Arun,

Sorry for the constant trouble and thanks for your continuous support.

I tried the HTTPS operation URL and received Connection refused error.:(

Could you please let me know where to find the actaserver1.xml.Do we have to make any changes to server-di1.xml.

I have enabled the HTTP port from my client machine.Any other ports needs to be enabled specific to HTTP Adapter usage.

Is there any way to just test the HTTP Adapter usage by trying to connect to general websites like google or microsoft.This will help me to understand working with HTTP Adapter in general and then to try my specific requirement.

Thanks,

Rajeswari

[Former Member · Accepted solution]

Hi,

No problem.

What the adapter guide says is - By default, the HTTPS port of the Tomcat server is 8443. This can be changed in the Tomcat configuration file (acta-server.xml on Windows, and actaserver1.xml on UNIX).You have to check in the config folder in Tomcat.

This link details on connecting to Non-SAP systems and configuring plain adapter.

http://help.sap.com/saphelp_nwpi71/helpdata/en/44/79973cc73af456e10000000a114084/frameset.htm

To connect to outside webpages, you have to configure HTTP client. If you go to page no 195 of the below link, you will get details for connecting to external sites.

http://help.sap.com/businessobject/product_guides/boexir32SP1/en/xi321_ds_admin_en.pdf

Hope this helps.

Arun

[Former Member · Accepted solution]

Thanks Arun

[Former Member · Accepted solution]

Your problem sorted out or still pending? Apologize if i am not of much help, since i have not come across this issue before, i have to do a bit of research.

Arun

[Former Member · Accepted solution]

Arun...you have been very helpful ..i got so much information from your thread.

We had raised a ticket with SAP to check if we could use HTTP Adapter to download a file from a website.

We found,HTTP Adapter only supports XML format to exchanging data, you can send an XML message or send and receive an XML message from HTTP Adapter

So now we are trying to resolve our requirement by developing a Java or Shell command and executing it using Exec command.