Changes for page ThingsBoard

Last modified by Dilisi S on 2025/04/23 19:23

From version 182.1
edited by Dilisi S
on 2025/03/27 02:50
Change comment: Mar 26 - heavy edits
To version 169.1
edited by Dilisi S
on 2025/03/19 04:17
Change comment: There is no comment for this version

Summary

Details

Page properties
Content
... ... @@ -164,138 +164,240 @@
164 164  [[image:ins1.png||height="310" width="500"]]
165 165  
166 166  
167 -= 3. Creating Devices =
167 += 3. Data Converters =
168 168  
169 169  
170 -First, you need to create devices in ThingsBoard to represent your physical devices. For example, you can name it **Device A**, and the second device could be **Device B** or any name you prefer. The device name should be unique within the **Devices** space.
170 +In **ThingsBoard**, **Data Converters** are components used to transform incoming or outgoing data between different formats, typically to convert raw telemetry data from devices into a structured format that ThingsBoard can understand, or vice versa.
171 171  
172 172  
173 -In the left navigation, click Entities -> Devices.
173 +== 3.1 Uplink ==
174 174  
175 -Click the **Add Device** button (the button with the **+** sign), and from the dropdown menu, click **Add new device**.
176 176  
177 -In the **Add new device** dialog box, enter the device name in the **Name** text box. For example, we will us**Device A**.
176 +In the left navigation, click **Integrations center**, and then click **Data converters**.
178 178  
179 -Click the **Add** button.
180 180  
181 -Skip the **connectivity testing** by clicking the **Close** button.
179 +[[image:data-converters-list-empty.png]]
182 182  
183 -The device is created and listed on the **Devices** page. Note that its initial state is **Inactive** because it has not received any data yet.
184 184  
182 +On the **Data converters** page, click on the ‘**+**’ button, and then click on the **Create new converter** from the dropdown menu.
185 185  
186 -= 4. Data Converters =
187 187  
188 188  
189 -In **ThingsBoard**, **Data Converters** are components used to transform incoming or outgoing data between different formats, typically to convert raw telemetry data from devices into a structured format that ThingsBoard can understand, or vice versa.
186 +[[image:create-new-converter-menu.png||height="259" width="500"]]
190 190  
191 191  
192 -== 4.1 Uplink ==
189 +The **Add data converter** window will appear. Name it ‘**MQTT Uplink Converter NB/CB**’ and select the Type as **Uplink**.
193 193  
191 +Click on the **JavaScript** button.
194 194  
195 -In the left navigation, click **Integrations center**, and then click **Data converters**.
193 +Delete the default decoder function in the code editor. Now copy and paste the following decoder function written in **JavaScript** in to the **code editor**. This decoder function is compatible for both NB and CB series devices.
196 196  
197 197  
198 -[[image:data-converters-list-empty.png]]
196 +{{code language="JavaScript"}}
197 +//Version: 0.1
198 +// decode payload to string
199 +var payloadStr = decodeToString(payload);
199 199  
201 +// decode payload to JSON
202 +var objdata = {};
203 +var obj1 = {};
204 +var data = decodeToJson(payload);
205 +var deviceName = data.IMEI;
206 +delete data.IMEI;
207 +var modelname = "Dragino " + data.Model;
208 +//var mod = data.mod
209 +delete data.Model;
210 +//delete data.mod
211 +var timestamp = new Date().getTime();
200 200  
201 -On the **Data converters** page, click on the ‘**+**’ button, and then click on the **Create new converter** from the dropdown menu.
213 +for (var key in data) {
214 +
215 + if (Number(key)) {
216 + obj1[key] = data[key];
217 + obj1[key][obj1[key].length - 1] = Number(new Date(
218 + obj1[key][obj1[key].length - 1]));
202 202  
220 + }
221 +//Alec submitted25/02/25
222 +//turn old key into new
223 + else if (key === "Reading") {
224 + objdata["reading"] = data[key];
225 + } else if (key === "work mode") {
226 + objdata["work_mode"] = data[key];
227 + } else if (key === "hum") {
228 + objdata["humidity"] = data[key];
229 + }else if (key === "hum2") {
230 + objdata["humidity2"] = data[key];
231 + } else if (key === "hum3") {
232 + objdata["humidity3"] = data[key];
233 + } else if (key === "tem") {
234 + objdata["temperature"] = data[key];
235 + } else if (key === "tem2") {
236 + objdata["temperature2"] = data[key];
237 + } else if (key === "tem3") {
238 + objdata["temperature3"] = data[key];
239 + } else if (key === "DS18B20_Temp") {
240 + objdata["temperature_pro"] = data[key];
241 + } else if (key === "ds18b20_temperature") {
242 + objdata["temperature_pro"] = data[key];
243 + } else if (key === "DS18B20_temperature_pro") {
244 + objdata["temperature_pro"] = data[key];
245 + } else if (key === "tdc send flag") {
246 + objdata["tdc_send_flag"] = data[key];
247 + } else if (key === "trigger mode") {
248 + objdata["trigger_mode"] = data[key];
249 + } else if (key === "soil dielectric constant") {
250 + objdata["soil_dielectric_constant"] = data[key];
251 + } else if (key === "door open num") {
252 + objdata["door_open_num"] = data[key];
253 + } else if (key === "door duration") {
254 + objdata["door_duration"] = data[key];
255 + } else if (key === "count time") {
256 + objdata["count_time"] = data[key];
257 + } else if (key === "last open time2") {
258 + objdata["last_open_time2"] = data[key];
259 + } else if (key === "last open time3") {
260 + objdata["last_open_time3"] = data[key];
261 + }
262 +//Alec submitted25/02/25
263 + else {
264 + objdata[key] = data[key]
265 + }
266 +}
267 +var listdata = [{
268 + "ts": timestamp,
269 + "values": objdata
270 +}]
271 +for (var key1 in obj1) {
272 + if (modelname == "Dragino RS485-NB") {
273 + listdata.push({
274 + "ts": obj1[key1][obj1[key1].length - 1],
275 + "values": {
276 + "Payload": obj1[key1][0],
277 + }
278 + })
279 + } else {
280 + listdata.push({
281 + "ts": obj1[key1][obj1[key1].length - 1],
282 + "values": {
283 + "values": obj1[key1]
284 + },
285 + })
286 + }
287 +}
288 +var result = {
203 203  
290 + deviceName: deviceName,
291 + deviceType: modelname,
292 + attributes: {
293 + model: modelname,
294 + //customerName: "NB-CB",
295 + //groupName: "NB-CB",
296 + //integrationName: metadata['integrationName']
204 204  
205 -[[image:create-new-converter-menu.png||height="259" width="500"]]
298 + },
299 + telemetry: listdata
300 +}
206 206  
302 +function decodeToString(payload) {
303 + return String.fromCharCode.apply(String, payload);
304 +}
207 207  
208 -The **Add data converter** window will appear. Name it ‘**MQTT Uplink Converter NB/CB**’ and select the Type as **Uplink**.
306 +function decodeToJson(payload) {
307 + // covert payload to string.
308 + var str = decodeToString(payload);
209 209  
210 -Click on the **TBEL** button if it has not been selected by default.
310 + // parse string to JSON
311 + var data = JSON.parse(str);
312 + return data;
313 +}
211 211  
212 -Modify the default TBEL function to match with your device as described below:
315 +return result;
316 +{{/code}}
213 213  
214 214  
215 -* Uncomment** line 11**:
319 +Click on the **Add** button.
216 216  
217 -//var data = decodeToJson(payload)//
218 218  
322 +[[image:mqtt-uplink.png||width="500"]]
219 219  
220 -* **Line 13**: Assign your device name to the **deviceName** field. - We used **Device A** as it is to match with our device, **Device A **in the Devices section.
221 -* From **line 38**: Modify the telemetry section to allow parsed data to be assigned to the fields.
222 222  
223 -//telemetry: {
224 - temperature: data.temperature,
225 - humidity: data.humidity,
226 - rawData: payloadStr
227 - }//
228 228  
326 +You should see that the newly added **MQTT Uplink converter **NB/CB is listed on the **Data Converters** page.
229 229  
230 -The modified uplink decoder function to match with **Device A** is shown below.
231 231  
329 +[[image:data-converter-list-showing-uplink-dc.png]]
330 +
331 +
332 +== 3.2 Downlink ==
333 +
334 +
335 +On the **Data converters** page, click on the ‘**+**’ button, and then click on the **Create new converter** from the dropdown menu.
336 +
337 +
338 +[[image:create-new-converter-menu.png||width="500"]]
339 +
340 +
341 +
342 +The **Add data converter** window will appear. Name it ‘**MQTT Downlink Converter NB/CB**’ and select the Type as **Downlink**.
343 +
344 +Click on the **TBEL** button if not selected it by default. Now copy and paste the following encoder function written in **TBEL (ThingsBoard Expression Language)** in to the **code editor**. This encoder function is compatible for both NB and CB series devices.
345 +
346 +
232 232  {{code language="JavaScript"}}
233 -// Decode an uplink message from a buffer
234 -// payload - array of bytes
235 -// metadata - key/value object
348 +// Encode downlink data from incoming Rule Engine message
236 236  
237 -/** Decoder **/
350 +// msg - JSON message payload downlink message json
351 +// msgType - type of message, for ex. 'ATTRIBUTES_UPDATED', 'POST_TELEMETRY_REQUEST', etc.
352 +// metadata - list of key-value pairs with additional data about the message
353 +// integrationMetadata - list of key-value pairs with additional data defined in Integration executing this converter
238 238  
239 -// decode payload to string
240 -var payloadStr = decodeToString(payload);
355 +/** Encoder **/
241 241  
242 -// decode payload to JSON
243 -var data = decodeToJson(payload);
357 +var data = {};
244 244  
245 -var deviceName = 'Device A';
246 -var deviceType = 'thermostat';
247 -var customerName = 'Customer C';
248 -var groupName = 'thermostat devices';
249 -var manufacturer = 'Example corporation';
250 -// use assetName and assetType instead of deviceName and deviceType
251 -// to automatically create assets instead of devices.
252 -// var assetName = 'Asset A';
253 -// var assetType = 'building';
359 +// Process data from incoming message and metadata
254 254  
255 -// Result object with device/asset attributes/telemetry data
361 +data.tempFreq = msg.temperatureUploadFrequency;
362 +data.humFreq = msg.humidityUploadFrequency;
363 +
364 +data.devSerialNumber = metadata['ss_serialNumber'];
365 +
366 +// Result object with encoded downlink payload
256 256  var result = {
257 -// Use deviceName and deviceType or assetName and assetType, but not both.
258 - deviceName: deviceName,
259 - deviceType: deviceType,
260 -// assetName: assetName,
261 -// assetType: assetType,
262 -// customerName: customerName,
263 - groupName: groupName,
264 - attributes: {
265 - model: 'Model A',
266 - serialNumber: 'SN111',
267 - integrationName: metadata['integrationName'],
268 - manufacturer: manufacturer
269 - },
270 - telemetry: {
271 - temperature: data.temperature,
272 - humidity: data.humidity,
273 - rawData: payloadStr
274 - }
275 -};
276 276  
277 -/** Helper functions 'decodeToString' and 'decodeToJson' are already built-in **/
369 + // downlink data content type: JSON, TEXT or BINARY (base64 format)
370 + contentType: "JSON",
278 278  
372 + // downlink data
373 + data: JSON.stringify(data),
374 +
375 + // Optional metadata object presented in key/value format
376 + metadata: {
377 + topic: metadata['deviceType']+'/'+metadata['deviceName']+'/upload'
378 + }
379 +
380 +};
381 +
279 279  return result;
280 280  {{/code}}
281 281  
282 282  
283 -Once you modify the decoder function, click on the **Add** button.
386 +Click on the **Add** button.
284 284  
285 285  
286 -[[image:mqtt-uplink.png||width="500"]]
389 +[[image:add-downlink-data-converter.png||height="529" width="500"]]
287 287  
288 288  
392 +You should see that the newly added **MQTT Downlink** Converter NB/CB is listed on the **Data Converters** page.
289 289  
290 -You should see that the newly added **MQTT Uplink converter **NB/CB is listed on the **Data Converters** page.
291 291  
395 +[[image:data-converters-list.png]]
292 292  
293 -[[image:data-converter-list-showing-uplink-dc.png]]
294 294  
398 += 4. Add Integration =
295 295  
296 -= 5. Add Integration =
297 297  
298 -
299 299  In the left navigation, click **Integrations center**, and then click **Integrations**.
300 300  
301 301  
... ... @@ -336,26 +336,24 @@
336 336  
337 337  **Downlink data converter:**
338 338  
339 -Dragino NB/CB devices don't require a downlink data converter to decode their payloads, so you can skip this step.
441 +* Click on the **Select existing** button.
442 +* **Downlink data converter**: Select **MQTT Downlink Converter NB/CB **from the dropdown list.
340 340  
341 -* Click on the **Skip **button in the Downlink data converter section.
444 +Click **Next** button.
342 342  
343 -Click **Skip** button.
344 344  
447 +[[image:add-integration-downlink-data-converter.png||height="511" width="500"]]
345 345  
346 -[[image:integration-dl-skip.png||height="511" width="500"]]
347 347  
348 -
349 -
350 350  **Connection:**
351 351  
352 -* **Host**: Host URL (Eg. **//011731f7xxxxxxxxxxxfbbedfc63f4.s1.eu.hivemq.cloud//**)
452 +* **Host**: Cluster URL (Eg. 011731f7xxxxxxxxxxxfbbedfc63f4.s1.eu.hivemq.cloud)
353 353  * **Port**: 8883
354 -* **Credentials type**: Basic
454 +* **Credentials**: Basic
455 +* **Enable SSL**: YES
355 355  * **Username**: Username (from your HiveMQ Cloud Cluster with your credentials)
356 356  * **Password:** Password (from your HiveMQ Cloud Cluster with your credentials)
357 -* **Enable SSL**: YES
358 -* **Topic: device/a** (The topic can be anything; you can even use just the device name.)
458 +* **Topic: v1/devices/+/telemetry** (the + replaces any 'device name' will create a device in the Entities -> Devices)
359 359  * **QoS:** 0-At most once
360 360  
361 361  [[image:add-integration-connection.png||height="511" width="500"]]
... ... @@ -388,26 +388,27 @@
388 388  Since we haven't received data from a device yet, the integration **Status** is shown as **Pending.**
389 389  
390 390  
491 +
391 391  [[image:new-integration-pending.png]]
392 392  
393 393  
394 -= 6. Verifying the receipt of data from virtual devices =
495 += 5. Verifying the receipt of data from virtual devices =
395 395  
396 396  
397 -== 6.1 How does it work? ==
498 +== 5.1 How does it work? ==
398 398  
399 399  
400 400  We use the Mosquitto MQTT client to simulate MQTT messages, acting as a virtual device. First, install the Mosquitto client on your computer from [[this link>>url:https://mosquitto.org/download/]]. The Mosquitto client publishes messages to the MQTT broker (HiveMQ) on a specified MQTT topic. ThingsBoard subscribes to these messages using the same topic.
401 401  
402 -The Mosquitto client publishes messages (payloads) on the topic **/device/a**. Of course, you can use any topic for testing.
503 +The Mosquitto client publishes messages (payloads) on the topic **v1/devices/me/telemetry**. Of course, you can use any topic for testing.
403 403  
404 -(% id="cke_bm_37386S" style="display:none" %) (%%)The MQTT payload format is as follows:
505 +(% id="cke_bm_37386S" style="display:none" %) (%%)The MQTT payload format is as follows, which is common for all **~-~-NB** and **~-~-CB** series devices. The **IMEI** field is mandatory and is used to provision a new device with the name assigned to it in ThingsBoard.
405 405  
406 406  {{code language="none"}}
407 -{"IMEI": "350693903995577", "temperature":25, "humidity":80, "pressure":1005}
508 +{"IMEI": "S31B-NB", "temperature": 27, ......}
408 408  {{/code}}
409 409  
410 -Once ThingsBoard receives this message, it forwards this payload to the matching device through the integration.
511 +Once ThingsBoard receives this message, it automatically creates (provisions) the device mentioned in the **IMEI**, for example, S31B-NB.
411 411  
412 412  
413 413  == 5.2 Sending messages ==
... ... @@ -416,7 +416,7 @@
416 416  On the terminal, issue the following MQTT command which simulates the device S31B-NB. The message payload contains the fields temperature and humidity, which hold the values S31B-NB and 27, respectively. This payload is also (technically) known as telemetry.
417 417  
418 418  {{code language="none"}}
419 -mosquitto_pub -d -q 1 -h 011731f7928xxxxx.s1.eu.hivemq.cloud -p 8883 -u "xxxxx" -P "xxxxx" -t "device/a" -m '{"IMEI":"350693903995577", "temperature":30, "humidity":80, "pressure":1005}'
520 +mosquitto_pub -d -q 1 -h 011731f7928xxxxx.s1.eu.hivemq.cloud -p 8883 -t "v1/devices/me/telemetry" -u "xxxxx" -P "xxxxx" -m '{"IMEI": "S31B-NB", "temperature": 27}'
420 420  {{/code}}
421 421  
422 422  If the integration was performed without errors, the status of the integration changes to 'Active' after the first telemetry transmission.
... ... @@ -425,11 +425,15 @@
425 425  [[image:integration-active.png]]
426 426  
427 427  
529 +Also, a new device named **S31B-NB** will appear under **//Entities -> Devices -> All//**. This means the first MQTT message triggers ThingsBoard to provision a device named **S31B-NB**.
428 428  
429 429  
430 -== 6.3 Viewing messages ==
532 +[[image:new-device.png]]
431 431  
432 432  
535 +== 5.3 Viewing messages ==
536 +
537 +
433 433  Go back to the **Integrations** page.
434 434  
435 435  Click on the **MQTT integration NB/CB** in the **Integrations** page to see its details.
... ... @@ -452,26 +452,22 @@
452 452  
453 453  Select the Event type as **Debug** from the dropdown list.
454 454  
455 -Now you can see all the Uplink messages you are simulating through the MQTT broker. The status should be **OK **if there is no errors in your integration.
560 +Now you can see all the Uplink messages you are simulating through the MQTT broker. The status should be OK if there is no errors in your integration.
456 456  
457 457  
458 -[[image:Screenshot 2025-03-26 at 19.49.31.png]]
563 +[[image:Screenshot 2025-03-16 at 18.38.59.png]]
459 459  
460 460  
461 -
462 -
463 463  Then click on the **three dots (...)** in the **Message** column. You can see the uplink message's **payload** in the **Message** window.
464 464  
465 465  
466 -[[image:Screenshot 2025-03-26 at 19.47.52.png]]
569 +[[image:Screenshot 2025-03-16 at 18.39.12.png]]
467 467  
468 468  
469 -
470 -
471 471  Now, you have successfully tested your integration with a simulated uplink payload and verified that it is received by ThingsBoard, and the device is provisioned.
472 472  
473 473  
474 -= 7. Creating a Dashboard =
575 += 6. Creating a Dashboard =
475 475  
476 476  ThingsBoard **Dashboards** provide a powerful way to visualize and monitor real-time and historical data from connected devices. They allow users to create interactive, customizable panels displaying telemetry data, device status, and other key metrics. With a variety of widgets, including charts, maps, and tables, dashboards help users gain insights, track trends, and manage IoT deployments efficiently.
477 477  
... ... @@ -481,7 +481,8 @@
481 481  
482 482  First simulate a few messages using MQTT. This time, we have added the 'humidity' field to the payload. Eg:
483 483  
484 -{{code language="none"}}mosquitto_pub -d -q 1 -h 011731f7928xxxxx.s1.eu.hivemq.cloud -p 8883 -t "v1/devices/me/telemetry" -u "xxxxx" -P "xxxxx" -m '{"IMEI": "S31B-NB", "temperature": 22, "humidity":80}'{{/code}}
585 +{{code language="none"}}mosquitto_pub -d -q 1 -h 011731f7928xxxxx.s1.eu.hivemq.cloud -p 8883 -t "v1/devices/me/telemetry" -u "xxxxx" -P "xxxxx" -m '{"IMEI": "S31B-NB", "temperature": 22, "humidity":80}'
586 +{{/code}}
485 485  
486 486  
487 487  In **ThingsBoard**, from the left navigation menu, click **Dashboards**. Then, click the **+** button and select **Create new dashboard** from the dropdown menu.
... ... @@ -554,10 +554,10 @@
554 554  [[image:timeseries-4.png||height="316" width="700"]]
555 555  
556 556  
557 -= 8. Configure NB-IoT Sensor =
659 += 7. Configure NB-IoT Sensor =
558 558  
559 559  
560 -Now, let's experiment with sending data to ThingsBoard using a real NB-IoT device. For example, we will use the **TS01-NB**.
662 +Now, let's experiment with sending data to ThingsBoard using a real NB-IoT device. For example, we will use the **S31B-NB**.
561 561  
562 562  First, configure the NB-IoT device with the necessary MQTT settings using AT commands. Below is a list of AT commands you can use.
563 563  
... ... @@ -565,7 +565,7 @@
565 565  **AT Commands**
566 566  
567 567  * **AT+PRO=3,3    **~/~/ Use MQTT to connect to ThingsBoard. Payload Type set to 3.
568 -* **AT+SUBTOPIC=<MQTT subscribe topic> Eg: TS01-NB**
670 +* **AT+SUBTOPIC=<MQTT subscribe topic> **
569 569  * **AT+PUBTOPIC=<MQTT publish topic> Eg: TS01-NB**
570 570  * **AT+CLIENT=null**
571 571  * **AT+UNAME=<MQTT Username>**
... ... @@ -573,15 +573,10 @@
573 573  * **AT+SERVADDR=<Broker address, Port>**
574 574  
575 575  Test your uplink by pressing the ACT button for 1 second.
576 -
577 577  
578 578  
579 579  The following image shows the uplink payload of a real Dragino device. The publish topic is **TS01-NB**, and the device name is **861275077962896**, which is represented by the **IMEI**.
580 580  
581 -{{info}}
582 -The ThingsBoard uses the device's IMEI number included in the payload to create a device in the Devices section.
583 -{{/info}}
584 -
585 585  [[image:image-4.png]]
586 586  
587 587  
Screenshot 2025-03-16 at 18.39.12.png
Size
... ... @@ -1,1 +1,1 @@
1 -211.9 KB
1 +277.0 KB
Content
Screenshot 2025-03-26 at 18.15.08.png
Author
... ... @@ -1,1 +1,0 @@
1 -XWiki.pradeeka
Size
... ... @@ -1,1 +1,0 @@
1 -92.2 KB
Content
Screenshot 2025-03-26 at 19.47.52.png
Author
... ... @@ -1,1 +1,0 @@
1 -XWiki.pradeeka
Size
... ... @@ -1,1 +1,0 @@
1 -168.4 KB
Content
Screenshot 2025-03-26 at 19.49.31.png
Author
... ... @@ -1,1 +1,0 @@
1 -XWiki.pradeeka
Size
... ... @@ -1,1 +1,0 @@
1 -133.0 KB
Content
add-integration-connection.png
Size
... ... @@ -1,1 +1,1 @@
1 -158.1 KB
1 +153.2 KB
Content
integration-dl-skip.png
Author
... ... @@ -1,1 +1,0 @@
1 -XWiki.pradeeka
Size
... ... @@ -1,1 +1,0 @@
1 -105.5 KB
Content