[Reactor] Variables not updating correctly in latest-25201-2aa18550

[CatmanV2]

Hmm, yes tough. I share your suspicion that it's Hive. No interest in firing up Mosquito on your Linux box? Takes about 10 minutes. OK there's an increase in your vulnerability but.....

C

[toggledbits]

The docs for MQTTController describe how to enable topic capture, so you can see if you are getting anything at all from Hive (this is probably preferable to turning up the log level in the log file for MQTTController). I'd suggest that as a start. See what, if anything, it's sending at all.

Ref: https://reactor.toggledbits.com/docs/MQTTController/#troubleshooting-and-debugging

[therealdb]

@catmanv2 I hope you’ll enjoy it as much as I am

[gwp1]

@toggledbits @CatmanV2 Unless I'm just not far enough thru coffee this morning, this is what I see in MSR's mqtt logs and it looks like it's data from my iPhone8 (which I fired up via wifi to use as a test phone.)

2022-12-12T14:02:02.896Z "owntracks/msrmqtt/iphone8" {"_type":"location","acc":35,"alt":10,"batt":100,"bs":1,"conn":"o","inregions":["Home"],"inrids":["adf34c"],"lat":32.94714,"lon":-80.013836,"m":1,"p":101.826,"t":"u","tid":"i8","tst":1670853720,"vac":15}
2022-12-12T14:02:02.998Z "owntracks/msrmqtt/iphone8" {"_type":"location","acc":10,"alt":10,"batt":100,"bs":1,"conn":"o","inregions":["Home"],"inrids":["adf34c"],"lat":32.946934,"lon":-80.013887,"m":1,"p":101.827,"tid":"i8","tst":1670853722,"vac":8,"vel":0}

So why isn't this showing here:

My entity config is:

        owntracks_iphone8: #entity ID - must be unique
          name: "iPhone8 location" # friendly name
          prefix: "iphone8"
          topic: "test_iphone"
          uses_template: owntracks_sensor
          homeRegionName: "Home"

I feel like I'm just "this close" and I just don't have something aligned properly.

[toggledbits]

Yes, your configuration of prefix and topic don't make a string that matches what is being received. Based on what it is coming in and how those fields template configuration are used, prefix should be msrmqtt and topic should be just iphone8.

Conspicuous give-away: your test_iphone value doesn't appear in the topic or payload of what you're receiving.

@therealdb this may need a bit more documentation, since the relevance of prefix and topic aren't immediately clear (at least, not to me) without looking at the template itself and seeing how they are used, and likely the phone configuration as well (i.e. describe how configuration fields on the phone may appear in the final event topic).

[CatmanV2]

I believe @toggledbits has it (unsurprisingly)

C

[gwp1]

@toggledbits I was just updating prefix when your response came in. Here's where I am now:

      entities:
        owntracks_iphone8: #entity ID - must be unique
          name: "iPhone8 location" # friendly name
          prefix: "msrmqtt"
          topic: "iphone8"
          uses_template: "owntracks_sensor"
          homeRegionName: "Home"

My template is in reactor/config/mqtt_templates which is where @therealdb directs. Do I need to modify the uses_template:?

[CatmanV2]

I think the template is in the correct place. Let's see what happens when you restart Reactor

C

[toggledbits]

@gwp1 Are you getting an error that the template owntracks_sensor doesn't exist?

[gwp1]

@toggledbits I am not receiving any errors.

Just not seeing anything populate the entity.

Is it something to do with the entity name by any random chance?

[toggledbits]

@gwp1 said in [MSR] reactor-mqtt-contrib package for additional MQTT templates:

@toggledbits I am not receiving any errors.

Then there's nothing wrong with uses_template.

I'll make the same comment/question to you that I made to @CatmanV2 earlier in this same thread: you're on the latest MQTTController, right?

[gwp1]

@toggledbits MQTTController-22326 (double-checked the CHANGELOG.md)

EDIT: ...which I now see is a version behind. You snuck one in on me. Updating to MQTTController-22340.

EDIT2: Nailed it.

[gwp1]

@toggledbits @therealdb @CatmanV2 Thank you all for your help here, this is a big step in my system. Really appreciate it!

[CatmanV2]

@therealdb what are your updates set to on the iPhone app? The data is going to be useful, but on 'Significant' I appear to be only getting updates on
string and region which makes sense.
I'm assuming that battery_power.level won't update more frequently unless the app is configured to 'Move'

Has anyone done that? Does it kill the iPhone battery?

Cheers

C

[CatmanV2]

@gwp1 how did you get the Driving Flag?

Cheers

C

[gwp1]

@catmanv2 move translates to any movement your phone is making - increases accuracy but kills battery life. significant is defined by OwnTracks as "traveling a distance of at least 500 meters in 5 minutes" which lets the app nap and is much easier on the battery.

Driving Flag is a virtual switch I created based on distance from Home. I believe I currently have it set to .1 mile so it trips as soon as I pull out of the neighborhood. I use it as a safety to the GPS reporting for when I'm not home. I have a second one called Driving Flag - Far Away that kicks in at two miles. This is for use when I'm obviously not just puttering about the neighborhood but going to be gone while. Can be used to trigger HVAC, etc.

[CatmanV2]

Cool, ta

C

[therealdb]

@toggledbits said in [MSR] reactor-mqtt-contrib package for additional MQTT templates:

@therealdb this may need a bit more documentation, since the relevance of prefix and topic aren't immediately clear (at least, not to me) without looking at the template itself and seeing how they are used, and likely the phone configuration as well (i.e. describe how configuration fields on the phone may appear in the final event topic).

It’s in the readme. Maybe, when you’ll build an UI, we could provide descriptive text for parameters.

[therealdb]

Version 22350 released.
What's new:

• shelly_button1: for Shelly Button 1 (battery powered button) - all the button modes (short, long, double, triple) are supported.
• fullykiosk: to handle messages coming from FullyKiosk. You'll have battery and charging status, screen brightness and current app.

What's fixed:

• query for all shelly template
• owntracks: trying to better handle null values/spurious messages.

How to update: just replace the files and restart Reactor.

[gwp1]

@therealdb I grabbed the latest owntracks_sensor and dropped it on top of the existing. (Yes, being late and I'm exhausted I failed to backup the original template.)

        owntracks_iphone14p: #entity ID - must be unique
          name: "iPhone14p J2A" # friendly name
          prefix: "msrmqtt"
          topic: "iphone14p-j2a"
          uses_template: "owntracks_sensor"
          homeRegionName: "Home"
#
        owntracks_iphone8: #entity ID - must be unique
          name: "iPhone8 location" # friendly name
          prefix: "msrmqtt"
          topic: "iphone8-j2a"
          uses_template: "owntracks_sensor"
          homeRegionName: "Home"
#
        owntracks_iphone14jay: #entity ID - must be unique
          name: "iPhone14max Jay" # friendly name
          prefix: "msrmqtt"
          topic: "iphone14max-jay"
          uses_template: "owntracks_sensor"
          homeRegionName: "CoralBerry"
#
        owntracks_iphone14jen: #entity ID - must be unique
          name: "iPhone14 Jen" # friendly name
          prefix: "msrmqtt"
          topic: "iphone14-jen"
          uses_template: "owntracks_sensor"
          homeRegionName: "CoralBerry"
#
        owntracks_iphone14addie: #entity ID - must be unique
          name: "iPhone14 Addie" # friendly name
          prefix: "msrmqtt"
          topic: "iphone14-addie"
          uses_template: "owntracks_sensor"
          homeRegionName: "CoralBerry"
#
        owntracks_iphone14bella: #entity ID - must be unique
          name: "iPhone14 Bella" # friendly name
          prefix: "msrmqtt"
          topic: "iphone14-bella"
          uses_template: "owntracks_sensor"
          homeRegionName: "CoralBerry"

That's my config... and this is my log since replacing/restarting:

     ... le" content="{"groups": [], "environmentKey" ... 
                                         ^ [-]
[latest-22349]2022-12-19T04:51:40.735Z <MQTTController:CRIT> YAMLException: end of the stream or a document separator is expected at line 21, column 66:
     ... le" content="{&quot;groups&quot;: [], &quot;environmentKey&quot; ... 
                                         ^ [-]
YAMLException: end of the stream or a document separator is expected at line 21, column 66:
     ... le" content="{&quot;groups&quot;: [], &quot;environmentKey&quot; ... 
                                         ^
    at generateError (/home/reactor/Documents/reactor/node_modules/js-yaml/lib/js-yaml/loader.js:167:10)
    at throwError (/home/reactor/Documents/reactor/node_modules/js-yaml/lib/js-yaml/loader.js:173:9)
    at readDocument (/home/reactor/Documents/reactor/node_modules/js-yaml/lib/js-yaml/loader.js:1545:5)
    at loadDocuments (/home/reactor/Documents/reactor/node_modules/js-yaml/lib/js-yaml/loader.js:1588:5)
    at load (/home/reactor/Documents/reactor/node_modules/js-yaml/lib/js-yaml/loader.js:1614:19)
    at Object.safeLoad (/home/reactor/Documents/reactor/node_modules/js-yaml/lib/js-yaml/loader.js:1637:10)
    at MQTTController._load_implementation (/home/reactor/Documents/reactor/ext/MQTTController/MQTTController.js:753:38)
    at async MQTTController.start (/home/reactor/Documents/reactor/ext/MQTTController/MQTTController.js:81:13)
[latest-22349]2022-12-19T04:51:40.744Z <MQTTController:ERR> MQTTController#mqtt2 can't read/load templates from /home/reactor/Documents/reactor/config/mqtt_templates/owntracks_sensor.yaml: [YAMLException] end of the stream or a document separator is expected at line 21, column 66:
     ... le" content="{&quot;groups&quot;: [], &quot;environmentKey&quot; ... 
                                         ^ [-]
[latest-22349]2022-12-19T04:51:40.754Z <MQTTController:CRIT> YAMLException: end of the stream or a document separator is expected at line 21, column 66:
     ... le" content="{&quot;groups&quot;: [], &quot;environmentKey&quot; ... 
                                         ^ [-]
YAMLException: end of the stream or a document separator is expected at line 21, column 66:
     ... le" content="{&quot;groups&quot;: [], &quot;environmentKey&quot; ... 
                                         ^
    at generateError (/home/reactor/Documents/reactor/node_modules/js-yaml/lib/js-yaml/loader.js:167:10)
    at throwError (/home/reactor/Documents/reactor/node_modules/js-yaml/lib/js-yaml/loader.js:173:9)
    at readDocument (/home/reactor/Documents/reactor/node_modules/js-yaml/lib/js-yaml/loader.js:1545:5)
    at loadDocuments (/home/reactor/Documents/reactor/node_modules/js-yaml/lib/js-yaml/loader.js:1588:5)
    at load (/home/reactor/Documents/reactor/node_modules/js-yaml/lib/js-yaml/loader.js:1614:19)
    at Object.safeLoad (/home/reactor/Documents/reactor/node_modules/js-yaml/lib/js-yaml/loader.js:1637:10)
    at MQTTController._load_implementation (/home/reactor/Documents/reactor/ext/MQTTController/MQTTController.js:753:38)
    at async MQTTController.start (/home/reactor/Documents/reactor/ext/MQTTController/MQTTController.js:81:13)
[latest-22349]2022-12-19T04:51:40.759Z <HassController:NOTICE> HassController#hass connecting to ws://192.168.1.198:8123/api/websocket
[latest-22349]2022-12-19T04:51:40.766Z <MQTTController:INFO> MQTTController#mqtt instance topic ident is mqtt
[latest-22349]2022-12-19T04:51:40.767Z <Controller:INFO> MQTTController#mqtt 0 dead entities older than 86400000s purged
[latest-22349]2022-12-19T04:51:40.769Z <MQTTController:NOTICE> MQTTController#mqtt connecting to broker at mqtt://192.168.1.198:1883/
[latest-22349]2022-12-19T04:51:40.843Z <MQTTController:INFO> MQTTController#mqtt2 instance topic ident is mqtt2
[latest-22349]2022-12-19T04:51:40.844Z <MQTTController:ERR> MQTTController#mqtt2 entity owntracks_iphone14p uses_template=owntracks_sensor, template not defined
[latest-22349]2022-12-19T04:51:40.853Z <MQTTController:ERR> MQTTController#mqtt2 entity owntracks_iphone8 uses_template=owntracks_sensor, template not defined
[latest-22349]2022-12-19T04:51:40.890Z <MQTTController:ERR> MQTTController#mqtt2 entity owntracks_iphone14jay uses_template=owntracks_sensor, template not defined
[latest-22349]2022-12-19T04:51:40.901Z <MQTTController:ERR> MQTTController#mqtt2 entity owntracks_iphone14jen uses_template=owntracks_sensor, template not defined
[latest-22349]2022-12-19T04:51:40.914Z <MQTTController:ERR> MQTTController#mqtt2 entity owntracks_iphone14addie uses_template=owntracks_sensor, template not defined
[latest-22349]2022-12-19T04:51:40.923Z <MQTTController:ERR> MQTTController#mqtt2 entity owntracks_iphone14bella uses_template=owntracks_sensor, template not defined
[latest-22349]2022-12-19T04:51:40.944Z <MQTTController:NOTICE> MQTTController#mqtt2 device owntracks_iphone14addie no longer available, marking BinarySensor#mqtt2>owntracks_iphone14addie for removal
[latest-22349]2022-12-19T04:51:40.952Z <MQTTController:NOTICE> MQTTController#mqtt2 device owntracks_iphone14bella no longer available, marking BinarySensor#mqtt2>owntracks_iphone14bella for removal
[latest-22349]2022-12-19T04:51:40.960Z <MQTTController:NOTICE> MQTTController#mqtt2 device owntracks_iphone14jay no longer available, marking BinarySensor#mqtt2>owntracks_iphone14jay for removal
[latest-22349]2022-12-19T04:51:40.967Z <MQTTController:NOTICE> MQTTController#mqtt2 device owntracks_iphone14jen no longer available, marking BinarySensor#mqtt2>owntracks_iphone14jen for removal
[latest-22349]2022-12-19T04:51:40.974Z <MQTTController:NOTICE> MQTTController#mqtt2 device owntracks_iphone14p no longer available, marking BinarySensor#mqtt2>owntracks_iphone14p for removal
[latest-22349]2022-12-19T04:51:40.980Z <MQTTController:NOTICE> MQTTController#mqtt2 device owntracks_iphone8 no longer available, marking BinarySensor#mqtt2>owntracks_iphone8 for removal
[latest-22349]2022-12-19T04:51:40.987Z <Controller:INFO> MQTTController#mqtt2 0 dead entities older than 86400000s purged
[latest-22349]2022-12-19T04:51:40.988Z <MQTTController:NOTICE> MQTTController#mqtt2 connecting to broker at mqtts://7ef71f0117fe40d28c2df12205c4a0d0.s2.eu.hivemq.cloud:8883