Technology Blogs by Members
Explore a vibrant mix of technical expertise, industry insights, and tech buzz in member blogs covering SAP products, technology, and events. Get in the mix!
Showing results for 
Search instead for 
Did you mean: 
Active Contributor
Nearly a year ago, I had been sending my Raspberry Pi sensor data to SAP Vora via Apache Kafka managed by the SAP Data ....

While this has been working flawlessly since then, with MQTT (Message Queuing Telemetry Transport) an extremely lightweight machine-to-machine connectivity protocol that seems optimally suited for my Raspberry Pi sensor data has evolved.

Also, having just upgraded to the new SAP Data Hub 2.3.3, I wanted to see the new SAP Vora Avro Ingestor operator in action.

For this, I setup the lightweight Eclipse Mosquitto MQTT message broker on a plain vanilla Ubuntu server:
sudo apt-get update
sudo apt-get install mosquitto

And install the mosquitto-clients to test subscribe to the messages I will be generating:
sudo apt-get install mosquitto-clients
mosquitto_sub -t "raspi"

Then I adjust my sending Raspberry Pi Java application leveraging Eclipse Paho:
import org.eclipse.paho.client.mqttv3.MqttClient;
import org.eclipse.paho.client.mqttv3.MqttConnectOptions;
import org.eclipse.paho.client.mqttv3.MqttException;
import org.eclipse.paho.client.mqttv3.MqttMessage;
import org.eclipse.paho.client.mqttv3.persist.MemoryPersistence;
import java.sql.Timestamp;
public class MQTT {
public static void main(String[] args) {
String topic = "raspi";
int qos = 2;
String broker = "tcp://";
String clientId = "Raspberry PI";
MemoryPersistence persistence = new MemoryPersistence();
try {
I2CBus i2cBus = I2CFactory.getInstance(I2CBus.BUS_1);
I2CDevice mcp9801 = i2cBus.getDevice(0x4f);
byte[] buffer = new byte[2];
MqttClient sampleClient = new MqttClient(broker, clientId, persistence);
MqttConnectOptions connOpts = new MqttConnectOptions();
int bytes =, buffer, 0, 2);
Timestamp timestamp = new Timestamp(System.currentTimeMillis());
String content = timestamp + "," + Double.toString((double) buffer[0] - (double) buffer[1] / 256);
MqttMessage message = new MqttMessage(content.getBytes());
sampleClient.publish(topic, message);
} catch (Exception me) {
System.out.println("msg " + me.getMessage());
System.out.println("cause " + me.getCause());
System.out.println("excep " + me);

With this I model my Data Pipeline similar to before:

One important change though is the need for a defaultAvroSchema, which is easy enough in my case:
"name": "mqtt",
"type": "record",
"fields": [
"name": "millis",
"type": "timestamp-millis"
"name": "temperature",
"type": "double"

This automatically creates table default\vora.MQTT and starts inserting my temperature information:

How cool is that.

1 Comment
Labels in this area