Lost internet cripples Indigo

We lost internet service for several hours today and Indigo stopped functioning and required a server restart. Is this a safe situation for users? I am running 2022.1 on OS 12.3 on an m1 Mac mini.

Do you have any errors in your logs indicating what was causing the problem? Indigo itself works perfectly fine with no internet, so I suspect it was more likely a plugin that required internet connectivity to work… the log should help identify what it was, then either discuss with the plugin dev about it or possibly use a plugin that can detect if your net connection is down to then trigger an action to disable whatever’s causing the lock up!


Sent from my iPhone using Tapatalk Pro

Here is the log:

2022-07-02 12:28:29.277 Error reflector connection not open
2022-07-02 12:28:29.278 Warning reflector reconnection scheduled in 5 seconds
2022-07-02 12:28:46.646 Alexa Warning Your reflector isn't available - you won't be able to use Alexa until the reflector is operating correctly.
2022-07-02 12:29:04.445 Error failed to create reflector connection: unable to connect to server
2022-07-02 12:29:04.446 Warning reflector reconnection scheduled in 15 minutes
2022-07-02 12:29:16.799 Alexa Warning Your reflector isn't available - you won't be able to use Alexa until the reflector is operating correctly.
2022-07-02 12:29:46.942 Alexa Warning Your reflector isn't available - you won't be able to use Alexa until the reflector is operating correctly.
2022-07-02 12:30:17.092 Alexa Warning Your reflector isn't available - you won't be able to use Alexa until the reflector is operating correctly.
2022-07-02 12:30:47.198 Alexa Warning Your reflector isn't available - you won't be able to use Alexa until the reflector is operating correctly.
2022-07-02 12:31:17.309 Alexa Warning Your reflector isn't available - you won't be able to use Alexa until the reflector is operating correctly.
2022-07-02 12:31:47.459 Alexa Warning Your reflector isn't available - you won't be able to use Alexa until the reflector is operating correctly.
2022-07-02 12:32:17.596 Alexa Warning Your reflector isn't available - you won't be able to use Alexa until the reflector is operating correctly.
2022-07-02 12:32:47.699 Alexa Warning Your reflector isn't available - you won't be able to use Alexa until the reflector is operating correctly.
2022-07-02 12:33:17.814 Alexa Warning Your reflector isn't available - you won't be able to use Alexa until the reflector is operating correctly.
2022-07-02 12:33:47.951 Alexa Warning Your reflector isn't available - you won't be able to use Alexa until the reflector is operating correctly.
2022-07-02 12:34:18.102 Alexa Warning Your reflector isn't available - you won't be able to use Alexa until the reflector is operating correctly.
2022-07-02 12:34:48.242 Alexa Warning Your reflector isn't available - you won't be able to use Alexa until the reflector is operating correctly.
2022-07-02 12:35:18.393 Alexa Warning Your reflector isn't available - you won't be able to use Alexa until the reflector is operating correctly.
2022-07-02 12:35:48.436 Alexa Warning Your reflector isn't available - you won't be able to use Alexa until the reflector is operating correctly.
2022-07-02 12:36:16.519 Z-Wave received "Master Bedroom Temperature" sensor update to 75.0 °F
2022-07-02 12:36:16.688 Z-Wave received "044 - Master Bedroom Sensor" status update battery level 93%
2022-07-02 12:36:18.583 Alexa Warning Your reflector isn't available - you won't be able to use Alexa until the reflector is operating correctly.
2022-07-02 12:36:48.704 Alexa Warning Your reflector isn't available - you won't be able to use Alexa until the reflector is operating correctly.
2022-07-02 12:37:18.843 Alexa Warning Your reflector isn't available - you won't be able to use Alexa until the reflector is operating correctly.
2022-07-02 12:37:48.934 Alexa Warning Your reflector isn't available - you won't be able to use Alexa until the reflector is operating correctly.
2022-07-02 12:38:19.006 Alexa Warning Your reflector isn't available - you won't be able to use Alexa until the reflector is operating correctly.
2022-07-02 12:38:39.293 Z-Wave received "043 - Guest Bedroom Sensor" status update battery level 100%
2022-07-02 12:38:49.143 Alexa Warning Your reflector isn't available - you won't be able to use Alexa until the reflector is operating correctly.
2022-07-02 12:39:19.264 Alexa Warning Your reflector isn't available - you won't be able to use Alexa until the reflector is operating correctly.
2022-07-02 12:39:49.393 Alexa Warning Your reflector isn't available - you won't be able to use Alexa until the reflector is operating correctly.
2022-07-02 12:40:19.501 Alexa Warning Your reflector isn't available - you won't be able to use Alexa until the reflector is operating correctly.
2022-07-02 12:40:49.606 Alexa Warning Your reflector isn't available - you won't be able to use Alexa until the reflector is operating correctly.
2022-07-02 12:41:19.758 Alexa Warning Your reflector isn't available - you won't be able to use Alexa until the reflector is operating correctly.
2022-07-02 12:41:48.801 Z-Wave received "Garage Door Tilt Sensor" status update is on
2022-07-02 12:41:48.803 Trigger Garage Lights ON from Large Garage Door
2022-07-02 12:41:48.957 Z-Wave sent "Garage Lights" on
2022-07-02 12:41:49.897 Alexa Warning Your reflector isn't available - you won't be able to use Alexa until the reflector is operating correctly.
2022-07-02 12:42:20.029 Alexa Warning Your reflector isn't available - you won't be able to use Alexa until the reflector is operating correctly.
2022-07-02 12:42:34.797 Z-Wave received "Garage Entry Door" status update is on
2022-07-02 12:42:34.799 Trigger Garage Lights ON from Inner Door
2022-07-02 12:42:34.956 Z-Wave sent "Garage Lights" on
2022-07-02 12:42:50.136 Alexa Warning Your reflector isn't available - you won't be able to use Alexa until the reflector is operating correctly.
2022-07-02 12:43:03.515 Z-Wave received "Garage Entry Door" status update is off
2022-07-02 12:43:10.314 Z-Wave received "Garage Door Tilt Sensor" status update is off
2022-07-02 12:43:20.285 Alexa Warning Your reflector isn't available - you won't be able to use Alexa until the reflector is operating correctly.
2022-07-02 12:43:50.384 Alexa Warning Your reflector isn't available - you won't be able to use Alexa until the reflector is operating correctly.
2022-07-02 12:44:20.499 Alexa Warning Your reflector isn't available - you won't be able to use Alexa until the reflector is operating correctly.
2022-07-02 12:44:34.685 Error failed to create reflector connection: unable to connect to server
2022-07-02 12:44:34.686 Warning reflector reconnection scheduled in 15 minutes
2022-07-02 12:44:50.650 Alexa Warning Your reflector isn't available - you won't be able to use Alexa until the reflector is operating correctly.
2022-07-02 12:45:20.798 Alexa Warning Your reflector isn't available - you won't be able to use Alexa until the reflector is operating correctly.
2022-07-02 12:45:50.870 Alexa Warning Your reflector isn't available - you won't be able to use Alexa until the reflector is operating correctly.
2022-07-02 12:46:20.925 Alexa Warning Your reflector isn't available - you won't be able to use Alexa until the reflector is operating correctly.
2022-07-02 12:46:50.982 Alexa Warning Your reflector isn't available - you won't be able to use Alexa until the reflector is operating correctly.
2022-07-02 12:47:21.011 Alexa Warning Your reflector isn't available - you won't be able to use Alexa until the reflector is operating correctly.
2022-07-02 12:47:51.041 Alexa Warning Your reflector isn't available - you won't be able to use Alexa until the reflector is operating correctly.
2022-07-02 12:48:21.117 Alexa Warning Your reflector isn't available - you won't be able to use Alexa until the reflector is operating correctly.
2022-07-02 12:48:51.194 Alexa Warning Your reflector isn't available - you won't be able to use Alexa until the reflector is operating correctly.
2022-07-02 12:49:21.261 Alexa Warning Your reflector isn't available - you won't be able to use Alexa until the reflector is operating correctly.
2022-07-02 12:49:34.754 Schedule trigger "Garage Lights ON from Inner Door" (delayed action)
2022-07-02 12:49:34.822 Z-Wave sent "Garage Lights" off
2022-07-02 12:49:51.317 Alexa Warning Your reflector isn't available - you won't be able to use Alexa until the reflector is operating correctly.
2022-07-02 12:49:57.220 Application Indigo Cocoa client connected
2022-07-02 12:50:17.753 Application Quitting Indigo Server - received slow quit signal
2022-07-02 12:50:17.757 Application Quitting Indigo Server - stopping plugins
2022-07-02 12:50:17.757 Application Stopping plugin "Email+ 2022.1.0" (pid 17485)
2022-07-02 12:50:17.757 Application Stopping plugin "Alexa 2022.1.0" (pid 43040)
2022-07-02 12:50:17.757 Application Indigo Cocoa client disconnected
2022-07-02 12:50:17.757 Application Stopping plugin "Web Server 2021.2.0" (pid 17483)
2022-07-02 12:50:17.758 Application Stopping plugin "Action Collection 2022.1.0" (pid 17484)
2022-07-02 12:50:17.758 Application Stopping interface "Virtual Devices 2022.1.0" (pid 17482)
2022-07-02 12:50:17.758 Application Stopping interface "Z-Wave 2022.2.0" (pid 17481)
2022-07-02 12:50:17.802 Web Server Stopping Indigo Web Server...
2022-07-02 12:50:17.833 Web Server disconnecting from Indigo server
2022-07-02 12:50:17.834 Application Web Server client disconnected
2022-07-02 12:50:19.800 Z-Wave closed connection to Z-Stick Gen5 (ZW090)
2022-07-02 12:50:19.805 Application Stopped plugin "Email+ 2022.1.0"
2022-07-02 12:50:19.806 Application Stopped plugin "Alexa 2022.1.0"
2022-07-02 12:50:19.806 Application Stopped plugin "Web Server 2021.2.0"
2022-07-02 12:50:19.806 Application Stopped plugin "Action Collection 2022.1.0"
2022-07-02 12:50:19.806 Application Stopped interface "Virtual Devices 2022.1.0"
2022-07-02 12:50:21.113 Application Stopped interface "Z-Wave 2022.2.0"
2022-07-02 12:50:21.119 Application Quitting Indigo Server - saving database
2022-07-02 12:50:21.176 Application Quitting Indigo Server - saving preferences
2022-07-02 12:50:21.178 Application Quitting Indigo Server - disconnecting clients
2022-07-02 12:50:21.566 Application Quitting Indigo Server - unloading launchd plist
2022-07-02 12:50:21.586 Application Quitting Indigo Server - complete
2022-07-02 14:07:47.196 Application Starting Indigo Server version 2022.1.0 on macOS Version 12.3.1 (Build 21E258)
2022-07-02 14:07:47.392 Application Loading database "/Users/ken/Ken's Indigo Scripts/My House 1-22-16.indiDb"
2022-07-02 14:07:47.406 Application Waiting for client to connect
2022-07-02 14:07:47.812 Application Indigo Cocoa client connected
2022-07-02 14:07:48.469 Application Waiting for client to sync
2022-07-02 14:07:50.623 Application Finding disabled plugins
2022-07-02 14:07:50.624 Application Found disabled plugin "DIRECTV DVR Control 1.1.1" using API v1.19
2022-07-02 14:07:50.624 Application Found disabled plugin "Growl 7.4.1" using API v2.0
2022-07-02 14:07:50.624 Application Found disabled plugin "Harmony Hub 7.2.3" using API v2.0
2022-07-02 14:07:50.624 Warning plugin "Harmony Hub 7.2.3" may not be compatible with next Indigo release without an update
2022-07-02 14:07:50.625 Application Found disabled plugin "Honeywell TC2 Security 1.0.3" using API v2.0
2022-07-02 14:07:50.625 Warning plugin "Honeywell TC2 Security 1.0.3" may not be compatible with next Indigo release without an update
2022-07-02 14:07:50.625 Application Found disabled plugin "ZEAL 0.3.2" using API v2.0
2022-07-02 14:07:50.625 Warning plugin "ZEAL 0.3.2" may not be compatible with next Indigo release without an update
2022-07-02 14:07:50.625 Application Found disabled plugin "Global Property Manager 2022.1.0" using API v3.0
2022-07-02 14:07:50.626 Application Found disabled plugin "Vera Bridge 1.0.10" using API v1.19
2022-07-02 14:07:50.626 Application Found disabled plugin "LIFX Bridge 7.1.1" using API v2.0
2022-07-02 14:07:50.626 Warning plugin "LIFX Bridge 7.1.1" may not be compatible with next Indigo release without an update
2022-07-02 14:07:50.626 Application Found disabled plugin "Timers and Pesters 2022.1.0" using API v3.0
2022-07-02 14:07:50.626 Application Found disabled plugin "Cynical Weather 0.9.3" using API v1.4.0
2022-07-02 14:07:50.627 Warning plugin "Cynical Weather 0.9.3" may not be compatible with next Indigo release without an update
2022-07-02 14:07:50.627 Application Found disabled plugin "Airfoil Pro 2022.1.0" using API v3.0
2022-07-02 14:07:50.627 Application Found disabled plugin "NOAA Weather 2022.1.0" using API v3.0
2022-07-02 14:07:50.627 Application Found disabled interface "INSTEON Commands 2022.1.0" using API v3.0
2022-07-02 14:07:50.628 Application Found disabled plugin "SQL Logger 2022.1.0" using API v2.5
2022-07-02 14:07:50.628 Application Found disabled plugin "EasyDAQ Relay Card 2021.2.1" using API v3.0
2022-07-02 14:07:50.628 Application Found disabled plugin "Alexa-Hue Bridge 3.0.35" using API v2.0
2022-07-02 14:07:50.628 Application Found disabled plugin "Airfoil 1.1.14" using API v1.19
2022-07-02 14:07:50.629 Application Found disabled plugin "WeatherSnoop 3.0.0" using API v2.0
2022-07-02 14:07:50.629 Warning plugin "WeatherSnoop 3.0.0" may not be compatible with next Indigo release without an update
2022-07-02 14:07:50.629 Application Found disabled plugin "iTunes 2021.1.0" using API v2.5
2022-07-02 14:07:50.629 Application Found disabled plugin "iCal Alarm Processor 7.4.1" using API v2.0
2022-07-02 14:07:50.629 Application Loading internal plugins
2022-07-02 14:07:50.631 Application Loading interface "Z-Wave 2022.2.0" using API v3.0
2022-07-02 14:07:50.635 Application Starting interface "Z-Wave 2022.2.0" (pid 95784)
2022-07-02 14:07:50.635 Application Loading interface "Virtual Devices 2022.1.0" using API v3.0
2022-07-02 14:07:50.636 Application Starting interface "Virtual Devices 2022.1.0" (pid 95785)
2022-07-02 14:07:50.637 Application Loading plugin "Web Server 2021.2.0" using API v2.5
2022-07-02 14:07:50.638 Application Starting plugin "Web Server 2021.2.0" (pid 95786)
2022-07-02 14:07:50.641 Application Loading plugin "Action Collection 2022.1.0" using API v3.0
2022-07-02 14:07:50.642 Application Starting plugin "Action Collection 2022.1.0" (pid 95787)
2022-07-02 14:07:50.645 Application Loading plugin "Email+ 2022.1.0" using API v3.0
2022-07-02 14:07:50.645 Application Starting plugin "Email+ 2022.1.0" (pid 95788)
2022-07-02 14:07:50.646 Application Loading plugin "Alexa 2022.1.0" using API v3.0
2022-07-02 14:07:50.648 Application Starting plugin "Alexa 2022.1.0" (pid 95789)
2022-07-02 14:07:50.850 Application Started interface "Virtual Devices 2022.1.0"
2022-07-02 14:07:50.851 Application Started plugin "Alexa 2022.1.0"
2022-07-02 14:07:50.851 Alexa Finding devices to publish to Alexa...
2022-07-02 14:07:50.854 Application Started plugin "Action Collection 2022.1.0"
2022-07-02 14:07:50.864 Application Started plugin "Email+ 2022.1.0"
2022-07-02 14:07:50.869 Alexa ... 'Deck Lights' published
2022-07-02 14:07:50.877 Alexa ... 'Inside Lights' published
2022-07-02 14:07:50.880 Alexa ... 'Outside Lights' published
2022-07-02 14:07:50.884 Alexa A total of 3 devices are currently published to Alexa
2022-07-02 14:07:50.885 Alexa Warning If you can't control a device, run discover from your Alexa device or from the Alexa app.
2022-07-02 14:07:50.981 Application Started interface "Z-Wave 2022.2.0"
2022-07-02 14:07:51.021 Z-Wave connected to Z-Stick Gen5 (ZW090) interface on /dev/cu.usbmodem22201 (firmware 1.01, minimum SDK 6.51.06)
2022-07-02 14:07:51.162 Z-Wave found module included in controller with no matching device (missing or disabled): 016 - Relay Power Switch
2022-07-02 14:07:51.165 Z-Wave found module included in controller with no matching device (missing or disabled): 017 - Relay Power Switch
2022-07-02 14:07:51.169 Z-Wave found module included in controller with no matching device (missing or disabled): 019 - Relay Power Switch
2022-07-02 14:07:51.228 Z-Wave found module included in controller with no matching device (missing or disabled): 046 - Relay Power Switch
2022-07-02 14:07:51.230 Z-Wave found module included in controller with no matching device (missing or disabled): 047 - Relay Power Switch
2022-07-02 14:07:51.233 Z-Wave found module included in controller with no matching device (missing or disabled): 048 - Relay Power Switch
2022-07-02 14:07:51.235 Z-Wave found module included in controller with no matching device (missing or disabled): 049 - Relay Power Switch
2022-07-02 14:07:51.237 Z-Wave found module included in controller with no matching device (missing or disabled): 050 - Relay Power Switch
2022-07-02 14:07:51.239 Z-Wave found module included in controller with no matching device (missing or disabled): 051 - Relay Power Switch
2022-07-02 14:07:51.241 Z-Wave found module included in controller with no matching device (missing or disabled): 052 - Relay Power Switch
2022-07-02 14:07:51.244 Z-Wave found module included in controller with no matching device (missing or disabled): 053 - Relay Power Switch
2022-07-02 14:07:51.378 Application Started plugin "Web Server 2021.2.0"
2022-07-02 14:07:51.391 Web Server Starting Indigo Web Server...
2022-07-02 14:07:51.480 Application Waiting for internal plugins to initialize
2022-07-02 14:07:51.550 Application Web Server client connected
2022-07-02 14:07:51.553 Web Server started on port 8000 -- authentication enabled: oauth, digest
2022-07-02 14:07:51.553 Application Bonjour registered "Indigo - My House 1-22-16"
2022-07-02 14:07:51.879 Reflector starting reflector connection to https://ken.indigodomo.net
2022-07-02 14:07:54.480 Application Loading external plugins
2022-07-02 14:07:54.505 Application Starting triggers and schedules
2022-07-02 14:07:54.519 Trigger Interface Down Warning
2022-07-02 14:07:54.529 Email+ sending email 'Interface restored' to 'ken-jacobs@cox.net' using Email+ SMTP Server
2022-07-02 14:08:27.733 Z-Wave received "Guest Bedroom Temperature" sensor update to 73.4 °F
2022-07-02 14:14:26.483 Application Indigo Cocoa client disconnected
2022-07-02 14:17:31.712 Z-Wave received "Garage Entry Door" status update is on
2022-07-02 14:17:31.714 Trigger Garage Lights ON from Inner Door
2022-07-02 14:17:31.867 Z-Wave sent "Garage Lights" on
2022-07-02 14:17:34.145 Z-Wave received "Garage Entry Door" status update is off
2022-07-02 14:24:31.547 Schedule trigger "Garage Lights ON from Inner Door" (delayed action)
2022-07-02 14:24:31.614 Z-Wave sent "Garage Lights" off
2022-07-02 14:27:41.362 Z-Wave received "028 - Garage Door Tilt Sensor" status update battery level 100%
2022-07-02 14:29:36.360 Z-Wave received "Refrigerator Temperature" sensor update to 80.6 °F
2022-07-02 14:34:39.728 Web Server Indigo Touch client connected from 192.168.1.149
2022-07-02 14:36:22.670 Z-Wave received "Master Bedroom Temperature" sensor update to 75.7 °F
2022-07-02 14:36:22.839 Z-Wave received "044 - Master Bedroom Sensor" status update battery level 93%
2022-07-02 14:36:23.396 Z-Wave received "044 - Master Bedroom Sensor" status update battery level 93%
2022-07-02 14:38:24.188 Z-Wave received "043 - Guest Bedroom Sensor" status update battery level 100%
2022-07-02 14:38:24.488 Z-Wave received "043 - Guest Bedroom Sensor" status update battery level 100%
2022-07-02 14:41:40.333 Z-Wave received "012 - Garage Entry Door" status update battery level 100%
2022-07-02 14:47:23.887 Z-Wave received "Crawl Space Temperature" sensor update to 72.3 °F
2022-07-02 14:47:24.546 Z-Wave received "Crawl Space Humidity" sensor update to 50%
2022-07-02 14:49:25.293 Z-Wave received "Refrigerator Temperature" sensor update to 77.9 °F
2022-07-02 14:50:56.098 Z-Wave received "035 - Crawl Space Temperature"

[jay (support)]

When the network goes out, we continuously try to re-establish the reflector connection, which you can see from the event log. Not sure why it didn't work though - perhaps the Mac's network stack got into a bad state? Normally, reflectors will come right back up after a network outage. You might want to look in the Mac's system logs to see if there's any unusual errors around that time. Also note that it does take a while for the network stack to sort itself out after the network comes back. I don't know when it did come back, but if it was after the last 15 minute retry and the time you restarted the server then that's your answer.

Note that Indigo was still working correctly - it was only the reflector (and the Alexa plugin which is dependent on the reflector) which weren't working. Everything else was fine.

My wife went in the garage and Indigo would not turn on the lights. This was tried several times. When I started the Indigo client I received a message that the reflector connection had been lost, restart the server.

[jay (support)]

Also note:

Code: Select all

2022-07-02 12:50:17.753 Application Quitting Indigo Server - received slow quit signal


Something told the Indigo server to shut down. It won't stop itself, so either the Mac client did (via the Stop Server menu item) or macOS sent a message to the server to shut down (like perhaps if the account that was logged in got logged out for some reason). It was restarted a over an hour later:

Code: Select all

2022-07-02 14:07:47.196 Application Starting Indigo Server version 2022.1.0 on macOS Version 12.3.1 (Build 21E258)


So clearly during that time it wouldn't have done anything - but it wasn't "crippled" but rather it was shut down.

[jay (support)]

There is never a message to restart the server when the reflector goes down - it just logs messages that it's trying to restart every 15 minutes.

We were not home when the first event happened. If this happens again, I’ll get a screen snapshot of the prompt to restart server.

We were not home when the first event happened. If this happens again, I’ll get a screen snapshot of the prompt to restart server.

I’d suggest you simulate an internet outage to replicate it now, rather than wait for it happening again in the future, because then when it does happen for real you’ll have already sorted the issue and everything will work fine! I do this kinda thing once every couple of months or so to make sure the systems working well

Well, I ran a case where the Mac was disconnected (Ethernet) from the internet for one hour without an Indigo server shutdown. The Alexa plug-in complained in the log every 30 seconds and loss of reflector every 15 minutes.

[jay (support)]

Which is as expected. Are you sure that it wasn't your Mac trying to restart for some reason? Indigo will never instruct you to restart the server.