Plugin Fails to Recover When Ecobee's Servers are Down

Posted on
Tue Jan 08, 2019 8:55 am
NewfD90 offline
Posts: 61
Joined: Mar 17, 2017

Plugin Fails to Recover When Ecobee's Servers are Down

Plugin (v.2.1.7) would work fine for days and then just stop updating the temperature. I finally caught what's going on. Apparently the plugin would occasionally be hitting the servers at the same time that they were down. Ecobee's servers eventually send back the message that "Servers are undergoing maintenance and are currently unavailable. Please check back later".

It then tries several more times, before giving up. For good apparently. A restart fixes everything.

Relevant logs below (refresh_tokens have been truncated):

Code: Select all
Jan 7, 2019 at 4:05:24 AM
   Ecobee 2 Debug                  Thermostat Update OK, got info on 1 devices

Jan 7, 2019 at 4:10:14 AM
   Ecobee 2 Debug                  Token Request with refresh_token = S
   Ecobee 2 Debug                  Token Refresh OK, access_token = H, refresh_token = 5, expires_in = 3599
   Ecobee 2 Debug                  Thermostat Update OK, got info on 1 devices

Jan 7, 2019 at 4:15:44 AM
   Ecobee 2 Error                  Thermostat Update failed, response = '{
  "status": {
    "code": 3,
    "message": "Processing error. Error populating API thermostats."
  }
}'

Jan 7, 2019 at 4:23:32 AM
   Ecobee 2 Error                  Thermostat Update Error, exception = ('Connection aborted.', error(60, 'Operation timed out'))

Jan 7, 2019 at 4:25:56 AM
   Ecobee 2 Error                  Thermostat Update failed, response = '{
  "status": {
    "code": 3,
    "message": "Processing error. Error populating API thermostats."
  }
}'

Jan 7, 2019 at 4:31:15 AM
   Ecobee 2 Error                  Thermostat Update Error, exception = ('Connection aborted.', error(54, 'Connection reset by peer'))

Jan 7, 2019 at 4:36:05 AM
   Ecobee 2 Error                  Thermostat Update Error, exception = ('Connection aborted.', error(54, 'Connection reset by peer'))

Jan 7, 2019 at 4:41:49 AM
   Ecobee 2 Error                  Thermostat Update Error, exception = HTTPSConnectionPool(host='api.ecobee.com', port=443): Max retries exceeded with url: /1/thermostat?json=%7B%22selection%22%3A%7B%22selectionType%22%3A%22registered%22%2C%22includeRuntime%22%3A%22true%22%2C%22includeSensors%22%3A%22true%22%2C%22includeEvents%22%3A%22true%22%2C%22includeProgram%22%3A%22true%22%2C%22includeEquipmentStatus%22%3A%22true%22%2C%22includeSettings%22%3A%22true%22%7D%7D (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x112fa6210>: Failed to establish a new connection: [Errno 60] Operation timed out',))

Jan 7, 2019 at 4:46:50 AM
   Ecobee 2 Error                  Thermostat Update Error, exception = HTTPSConnectionPool(host='api.ecobee.com', port=443): Max retries exceeded with url: /1/thermostat?json=%7B%22selection%22%3A%7B%22selectionType%22%3A%22registered%22%2C%22includeRuntime%22%3A%22true%22%2C%22includeSensors%22%3A%22true%22%2C%22includeEvents%22%3A%22true%22%2C%22includeProgram%22%3A%22true%22%2C%22includeEquipmentStatus%22%3A%22true%22%2C%22includeSettings%22%3A%22true%22%7D%7D (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x112fa6110>: Failed to establish a new connection: [Errno 60] Operation timed out',))

Jan 7, 2019 at 4:51:50 AM
   Ecobee 2 Error                  Thermostat Update Error, exception = HTTPSConnectionPool(host='api.ecobee.com', port=443): Max retries exceeded with url: /1/thermostat?json=%7B%22selection%22%3A%7B%22selectionType%22%3A%22registered%22%2C%22includeRuntime%22%3A%22true%22%2C%22includeSensors%22%3A%22true%22%2C%22includeEvents%22%3A%22true%22%2C%22includeProgram%22%3A%22true%22%2C%22includeEquipmentStatus%22%3A%22true%22%2C%22includeSettings%22%3A%22true%22%7D%7D (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x112fa6790>: Failed to establish a new connection: [Errno 60] Operation timed out',))

Jan 7, 2019 at 4:56:51 AM
   Ecobee 2 Error                  Thermostat Update Error, exception = HTTPSConnectionPool(host='api.ecobee.com', port=443): Max retries exceeded with url: /1/thermostat?json=%7B%22selection%22%3A%7B%22selectionType%22%3A%22registered%22%2C%22includeRuntime%22%3A%22true%22%2C%22includeSensors%22%3A%22true%22%2C%22includeEvents%22%3A%22true%22%2C%22includeProgram%22%3A%22true%22%2C%22includeEquipmentStatus%22%3A%22true%22%2C%22includeSettings%22%3A%22true%22%7D%7D (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x112fa66d0>: Failed to establish a new connection: [Errno 60] Operation timed out',))

Jan 7, 2019 at 4:58:15 AM
   Ecobee 2 Debug                  Token Request with refresh_token = 5

Jan 7, 2019 at 4:59:33 AM
   Ecobee 2 Error                  Token Refresh Error, exception = HTTPSConnectionPool(host='api.ecobee.com', port=443): Max retries exceeded with url: /token?grant_type=refresh_token&client_id=opSMO6RtoUlhoAtlQehNZdaOZ6EQBO6Q&refresh_token=5 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x112fa6990>: Failed to establish a new connection: [Errno 60] Operation timed out',))
   Ecobee 2 Debug                  Token Request with refresh_token = 5

Jan 7, 2019 at 5:00:53 AM
   Ecobee 2 Error                  Token Refresh Error, exception = HTTPSConnectionPool(host='api.ecobee.com', port=443): Max retries exceeded with url: /token?grant_type=refresh_token&client_id=opSMO6RtoUlhoAtlQehNZdaOZ6EQBO6Q&refresh_token=5 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x112fa6610>: Failed to establish a new connection: [Errno 60] Operation timed out',))

Jan 7, 2019 at 5:02:13 AM
   Ecobee 2 Error                  Thermostat Update Error, exception = HTTPSConnectionPool(host='api.ecobee.com', port=443): Max retries exceeded with url: /1/thermostat?json=%7B%22selection%22%3A%7B%22selectionType%22%3A%22registered%22%2C%22includeRuntime%22%3A%22true%22%2C%22includeSensors%22%3A%22true%22%2C%22includeEvents%22%3A%22true%22%2C%22includeProgram%22%3A%22true%22%2C%22includeEquipmentStatus%22%3A%22true%22%2C%22includeSettings%22%3A%22true%22%7D%7D (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x112fa61d0>: Failed to establish a new connection: [Errno 60] Operation timed out',))
   Ecobee 2 Debug                  Token Request with refresh_token = 5

Jan 7, 2019 at 5:03:31 AM
   Ecobee 2 Error                  Token Refresh Error, exception = HTTPSConnectionPool(host='api.ecobee.com', port=443): Max retries exceeded with url: /token?grant_type=refresh_token&client_id=opSMO6RtoUlhoAtlQehNZdaOZ6EQBO6Q&refresh_token=5 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x112fa6310>: Failed to establish a new connection: [Errno 60] Operation timed out',))
   Ecobee 2 Debug                  Token Request with refresh_token = 5

Jan 7, 2019 at 5:04:51 AM
   Ecobee 2 Error                  Token Refresh Error, exception = HTTPSConnectionPool(host='api.ecobee.com', port=443): Max retries exceeded with url: /token?grant_type=refresh_token&client_id=opSMO6RtoUlhoAtlQehNZdaOZ6EQBO6Q&refresh_token=5 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x112fa63d0>: Failed to establish a new connection: [Errno 60] Operation timed out',))
   Ecobee 2 Debug                  Token Request with refresh_token = 5

Jan 7, 2019 at 5:06:11 AM
   Ecobee 2 Error                  Token Refresh Error, exception = HTTPSConnectionPool(host='api.ecobee.com', port=443): Max retries exceeded with url: /token?grant_type=refresh_token&client_id=opSMO6RtoUlhoAtlQehNZdaOZ6EQBO6Q&refresh_token=5 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x112fa6810>: Failed to establish a new connection: [Errno 60] Operation timed out',))

Jan 7, 2019 at 5:07:31 AM
   Ecobee 2 Error                  Thermostat Update Error, exception = HTTPSConnectionPool(host='api.ecobee.com', port=443): Max retries exceeded with url: /1/thermostat?json=%7B%22selection%22%3A%7B%22selectionType%22%3A%22registered%22%2C%22includeRuntime%22%3A%22true%22%2C%22includeSensors%22%3A%22true%22%2C%22includeEvents%22%3A%22true%22%2C%22includeProgram%22%3A%22true%22%2C%22includeEquipmentStatus%22%3A%22true%22%2C%22includeSettings%22%3A%22true%22%7D%7D (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x112fa6d10>: Failed to establish a new connection: [Errno 60] Operation timed out',))
   Ecobee 2 Debug                  Token Request with refresh_token = 5

Jan 7, 2019 at 5:08:50 AM
   Ecobee 2 Error                  Token Refresh Error, exception = HTTPSConnectionPool(host='api.ecobee.com', port=443): Max retries exceeded with url: /token?grant_type=refresh_token&client_id=opSMO6RtoUlhoAtlQehNZdaOZ6EQBO6Q&refresh_token=5 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x112fa6490>: Failed to establish a new connection: [Errno 60] Operation timed out',))
   Ecobee 2 Debug                  Token Request with refresh_token =5

Jan 7, 2019 at 5:10:10 AM
   Ecobee 2 Error                  Token Refresh Error, exception = HTTPSConnectionPool(host='api.ecobee.com', port=443): Max retries exceeded with url: /token?grant_type=refresh_token&client_id=opSMO6RtoUlhoAtlQehNZdaOZ6EQBO6Q&refresh_token=5 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x112fa6f90>: Failed to establish a new connection: [Errno 60] Operation timed out',))
   Ecobee 2 Debug                  Token Request with refresh_token = 5

Jan 7, 2019 at 5:11:30 AM
   Ecobee 2 Error                  Token Refresh Error, exception = HTTPSConnectionPool(host='api.ecobee.com', port=443): Max retries exceeded with url: /token?grant_type=refresh_token&client_id=opSMO6RtoUlhoAtlQehNZdaOZ6EQBO6Q&refresh_token=5 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x112fa6ed0>: Failed to establish a new connection: [Errno 60] Operation timed out',))

Jan 7, 2019 at 5:12:50 AM
   Ecobee 2 Error                  Thermostat Update Error, exception = HTTPSConnectionPool(host='api.ecobee.com', port=443): Max retries exceeded with url: /1/thermostat?json=%7B%22selection%22%3A%7B%22selectionType%22%3A%22registered%22%2C%22includeRuntime%22%3A%22true%22%2C%22includeSensors%22%3A%22true%22%2C%22includeEvents%22%3A%22true%22%2C%22includeProgram%22%3A%22true%22%2C%22includeEquipmentStatus%22%3A%22true%22%2C%22includeSettings%22%3A%22true%22%7D%7D (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x112fa6a50>: Failed to establish a new connection: [Errno 60] Operation timed out',))
   Ecobee 2 Debug                  Token Request with refresh_token = 5

Jan 7, 2019 at 5:14:08 AM
   Ecobee 2 Error                  Token Refresh Error, exception = HTTPSConnectionPool(host='api.ecobee.com', port=443): Max retries exceeded with url: /token?grant_type=refresh_token&client_id=opSMO6RtoUlhoAtlQehNZdaOZ6EQBO6Q&refresh_token=5 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x112fa6a10>: Failed to establish a new connection: [Errno 60] Operation timed out',))
   Ecobee 2 Debug                  Token Request with refresh_token =

Jan 7, 2019 at 5:15:28 AM
   Ecobee 2 Error                  Token Refresh Error, exception = HTTPSConnectionPool(host='api.ecobee.com', port=443): Max retries exceeded with url: /token?grant_type=refresh_token&client_id=opSMO6RtoUlhoAtlQehNZdaOZ6EQBO6Q&refresh_token=5 (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x112fa6550>: Failed to establish a new connection: [Errno 60] Operation timed out',))
   Ecobee 2 Debug                  Token Request with refresh_token = 5

Jan 7, 2019 at 5:16:47 AM
   Ecobee 2 Error                  Ecobee Account (1077495085): Token Refresh failed, response = '{
  "errors": [{
    "status": "503",
    "detail": "Servers are undergoing maintenance and are currently unavailable. Please check back later"
  }]
}
'

Posted on
Tue Jan 08, 2019 9:12 am
FlyingDiver offline
User avatar
Posts: 7189
Joined: Jun 07, 2014
Location: Southwest Florida, USA

Re: Plugin Fails to Recover When Ecobee's Servers are Down

Release 2.1.8 is available for testing and fixes this issue (I hope).

https://github.com/FlyingDiver/Indigo-E ... /tag/2.1.8

joe (aka FlyingDiver)
my plugins: http://forums.indigodomo.com/viewforum.php?f=177

Page 1 of 1

Who is online

Users browsing this forum: No registered users and 1 guest