a week ago
Hi Experts,
We are setting up the Databricks connectivity in SAP HANA - Smart Data Integration (SDI). As per SAP Help - Set up the Camel JDBC Adapter | SAP Help Portal, the CamelJdbcAdapter is setup.
The adapter is successfully registered and the remote source is created using both the UI and Code, and it gets created successfully.
CREATE REMOTE SOURCE "RS_DEV_DATABRICKS" ADAPTER "CamelJdbcAdapter" AT LOCATION AGENT "dpagent_MyAgent" CONFIGURATION '<?xml version="1.0" encoding="UTF-8" standalone="yes"?> <ConnectionProperties name="configuration"> <PropertyEntry name="dbtype" displayName="Database Type" isRequired="true">Other</PropertyEntry> <PropertyEntry name="driverClass" displayName="JDBC Driver Class" isRequired="false">com.databricks.client.jdbc.Driver</PropertyEntry> <PropertyEntry name="url" displayName="JDBC URL" isRequired="false">jdbc:databricks://adb-xxxxxxxxxx.3.azuredatabricks.net:443/default;transportMode=http;ssl=1;httpPath=/sql/1.0/warehouses/xxxxxxxxxxx;AuthMech=3;ConnCatalog=test_catalog1;ConnSchema=test_schema1;UID=token;IgnoreTransactions=1;</PropertyEntry> </ConnectionProperties> ' WITH CREDENTIAL TYPE 'PASSWORD' USING ' <CredentialEntry name="db_credential"> <user>token</user> <password>yyyyyyyyyyyyyyyyyy</password> </CredentialEntry>';However, while expanding the Remote Source (or refresh) fails with the below message.
The DPA Logs are enabled, and as per the trace files the below error message is found:
2025-12-02 09:31:53,072 [ERROR] [7770fd98-b350-4636-afbb-1c919296bb0577185] JdbcMetadataBrowser | ExceptionUtil.newAdapterException [] - Failed to query schemas. org.apache.commons.dbcp.SQLNestedException: Cannot load JDBC driver class 'com.databricks.client.jdbc.Driver' at org.apache.commons.dbcp.BasicDataSource.createConnectionFactory(BasicDataSource.java:1429) at com.sap.hana.dp.camel.CamelDataSource.createConnectionFactory(CamelDataSource.java:65) at org.apache.commons.dbcp.BasicDataSource.createDataSource(BasicDataSource.java:1371) at org.apache.commons.dbcp.BasicDataSource.getConnection(BasicDataSource.java:1044) at com.sap.hana.dp.camel.JdbcMetadataBrowser.browseSchemas(JdbcMetadataBrowser.java:71) at com.sap.hana.dp.camel.JdbcMetadataBrowser.browseMetadata(JdbcMetadataBrowser.java:59) at com.sap.hana.dp.camel.MetadataProducer.process(MetadataProducer.java:54) at org.apache.camel.support.AsyncProcessorConverterHelper$ProcessorToAsyncProcessorBridge.process(AsyncProcessorConverterHelper.java:66) at org.apache.camel.processor.SendProcessor.process(SendProcessor.java:172) at org.apache.camel.processor.errorhandler.RedeliveryErrorHandler$SimpleTask.run(RedeliveryErrorHandler.java:477) at org.apache.camel.impl.engine.DefaultReactiveExecutor$Worker.schedule(DefaultReactiveExecutor.java:193) at org.apache.camel.impl.engine.DefaultReactiveExecutor.scheduleMain(DefaultReactiveExecutor.java:64) at org.apache.camel.processor.Pipeline.process(Pipeline.java:185) at org.apache.camel.impl.engine.CamelInternalProcessor.process(CamelInternalProcessor.java:398)The Databricks JDBC files are placed in both the locations as below, since few SAP notes suggested.
Our DPA Agent version details below:
#Data Provisioning component versions
dpagent.version=2.7.1.1
lcmsdk.version=2.8.6
repagent.syb.version=15.7.1SP210
repagent.sybfilter.version=15.7.1SP214
ms.vcredist.2015.version=14.36.32532.0
ocs.version=16.0.03.10
dataservices.engine.version=14.3.2.419
dpagent.build.version=2.7.1.1
build.time=2023-07-13T14:59:20-0700Any pointers or suggestions to diagnose this error would be really helpful. Thank you!
Kind regards
Chathia
Request clarification before answering.
| User | Count |
|---|---|
| 8 | |
| 6 | |
| 6 | |
| 3 | |
| 3 | |
| 3 | |
| 2 | |
| 2 | |
| 2 | |
| 2 |
You must be a registered user to add a comment. If you've already registered, sign in. Otherwise, register and sign in.