Tutorial Issue: Use a message broker in SAP Data Hub, trial edition 2.3 - Error Message

[rtamkin]

Hi Experts,

I keep getting the following error when attempting to use a Kafka producer and consumer:

default.Kafka Consumer2: kafka: client has run out of available brokers to talk to (Is your cluster reachable?) Can anyone advise on how to resolve this issue?Kind RegardsRoger

[titto_antony]

Hi All,

I'm also getting the same error default.Kafka Consumer2: kafka: client has run out of available brokers to talk to (Is your cluster reachable?)

I tried the work around suggested by Douglas Maltby but still it throwing the same error. Does anyone know how to fix this issue?

[douglasmaltby]

Hi Roger,

I had the same issue when deploying the CAL SDH 2.3 trial and Kafka on GCP recently.

Previously in September 2018 when I deployed Kafka for the CAL SDH 1..4 trial, Kafka was truly just "click to deploy". Then in October when I deployed Kafka with the SDH 2.3 trial, there were some post-deployment configurations necessary to make Kafka work with the SDH 2.3 trial.

I had to do 2 things in my GCP project, llustrated below. I hope that resolves your issue!

Doug

1. Add firewall rules for kafka on tcp ports 2181 and 9092 on sap-cal-default-network AND

2. Add a network tag to the Kafka instance so it can be referenced on the network, as kafka-2 in my case. This was the "magic" in my case.

[rtamkin]

Hi Thorsten,

Kafka server is running on same zone as cal install. For the net/subnet these are both sap-cal-default-network (hopefully this is correct). I then used the primary IP address specified in the VM to update the config for the consumer/producer.

Kind Regards

Roger

[rtamkin]

Sorry yes created on Google cloud

[schneidertho]

Hi Roger,

where does your Kafka server run? Did you spin it up on Google? And did you spin it up in the same net/subnet as the trial edition.

The message you mentioned typically indicates that Data Hub cannot connect to Kafka (and that could be because of the setup of your Kafka server).

Cheers

Thorsten