INDIGOplotD -- a plot tool for indigo

Posted on
Sun Mar 12, 2017 10:00 am
kw123 offline
User avatar
Posts: 5726
Joined: May 12, 2013
Location: Dallas, TX

Re: INDIGOplotD -- a plot tool for indigo

Marc on the "delta norm hour for min vs hour plot
Screen Shot 2017-03-12 at 10.35.22.png
Screen Shot 2017-03-12 at 10.35.22.png (292.03 KiB) Viewed 1873 times


attached graph
1. upper part is the hour plot, the lower part is the minute plot
2. 3 lines:
blue = energy (aeon calls it accumulated energy thats actually wrong .. that would be power *hour*hour, energy is power *hour or in units=W*hour.. anyway), right scale [KWh]
black line = power (watt)
yellow dots = delta energy normalized to 1 hour [KWh/h * multiplier1000 to make it watt)

you can see several things:
1. my z-wave network was not doing well for some days = no updates
2. delta norm hour is not very accurate as the enegery from the aeon device is not updated often enough
(Energy(n) - Energyr(n-1) )/ deltaTime * normalization factor has some holes. many of the yellow dots are at zero
you can run indigo utilities and look at the sql data for the device. You could see that power is updated more frequently than energy - al least in my case(*)

I do not see any difference with data from SQL and from regular data acquisition.
sql import and regular acquisition are indeed are 2 different programming parts. There could be an issue, but I do not see it .

So here my request:
could you do : indigoplotd menue/
-print data formatted --> creates minute and hour files in indigoplotd/data/ xxx .formatted
-print device/variable source == log file output
- and if you could also the last 100 lines from your indigoutilities printout of THAT device (see below)
Screen Shot 2017-03-12 at 10.47.09.png
Screen Shot 2017-03-12 at 10.47.09.png (38.38 KiB) Viewed 1873 times


and send me output as dropbox zip file. It is too long to post here and it will also loose its formatting


Karl

(*)
the indigo utilizes output for one of my aeon devices
Code: Select all
   id   |             ts             | accumenergytimedelta | accumenergytimedelta_ui | accumenergytotal | accumenergytotal_ui | curenergylevel | curenergylevel_ui
--------+----------------------------+----------------------+-------------------------+------------------+---------------------+----------------+-------------------
 137941 | 2017-03-12 07:45:59.787914 |               445320 | 445320 seconds          |                  |                     |         401.74 | 401.740 W
 137942 | 2017-03-12 07:45:59.85718  |                      |                         |            75503 | 75503.033 kWh       |                |
 137943 | 2017-03-12 07:48:04.826196 |               445445 | 445445 seconds          |                  |                     |        404.848 | 404.848 W
 137944 | 2017-03-12 07:48:04.898209 |                      |                         |            75503 | 75503.047 kWh       |                |
 137945 | 2017-03-12 07:50:10.148516 |               445571 | 445571 seconds          |                  |                     |        414.076 | 414.076 W
 137946 | 2017-03-12 07:50:10.320471 |                      |                         |          75503.1 | 75503.060 kWh       |                |
 137947 | 2017-03-12 07:52:14.835861 |               445695 | 445695 seconds          |                  |                     |          416.5 | 416.500 W
 137948 | 2017-03-12 07:52:14.907692 |                      |                         |          75503.1 | 75503.074 kWh       |                |
 137949 | 2017-03-12 07:54:19.86506  |               445820 | 445820 seconds          |                  |                     |        413.611 | 413.611 W
 137950 | 2017-03-12 07:54:19.941523 |                      |                         |          75503.1 | 75503.088 kWh       |                |
 137951 | 2017-03-12 07:56:24.855733 |               445945 | 445945 seconds          |                  |                     |         422.18 | 422.180 W
 137952 | 2017-03-12 07:56:24.934189 |                      |                         |          75503.1 | 75503.107 kWh       |                |
 137953 | 2017-03-12 07:58:29.901657 |               446070 | 446070 seconds          |                  |                     |        568.467 | 568.467 W
 137954 | 2017-03-12 07:58:29.943636 |                      |                         |          75503.1 | 75503.130 kWh       |                |
 137955 | 2017-03-12 08:00:34.904406 |               446195 | 446195 seconds          |                  |                     |        559.447 | 559.447 W
 137956 | 2017-03-12 08:00:34.981681 |                      |                         |          75503.1 | 75503.149 kWh       |                |
 137957 | 2017-03-12 08:02:39.886039 |               446320 | 446320 seconds          |                  |                     |        558.192 | 558.192 W
 137958 | 2017-03-12 08:02:39.966435 |                      |                         |          75503.2 | 75503.167 kWh       |                |
 137959 | 2017-03-12 08:04:44.938401 |               446445 | 446445 seconds          |                  |                     |        563.004 | 563.004 W
 137960 | 2017-03-12 08:04:44.979261 |                      |                         |          75503.2 | 75503.186 kWh       |                |
 137961 | 2017-03-12 08:06:49.920341 |               446570 | 446570 seconds          |                  |                     |        559.102 | 559.102 W
 137962 | 2017-03-12 08:06:50.004    |                      |                         |          75503.2 | 75503.205 kWh       |                |
 137963 | 2017-03-12 08:08:54.965924 |               446695 | 446695 seconds          |                  |                     |        556.227 | 556.227 W
 137964 | 2017-03-12 08:08:55.003539 |                      |                         |          75503.2 | 75503.224 kWh       |                |
 137965 | 2017-03-12 08:10:59.945278 |               446820 | 446820 seconds          |                  |                     |          562.7 | 562.700 W
 137966 | 2017-03-12 08:11:00.01655  |               446821 | 446821 seconds          |          75503.2 | 75503.242 kWh       |                |
 137967 | 2017-03-12 08:13:04.962097 |               446945 | 446945 seconds          |                  |                     |        553.793 | 553.793 W
 137968 | 2017-03-12 08:13:05.031107 |               446946 | 446946 seconds          |          75503.3 | 75503.261 kWh       |                |
 137969 | 2017-03-12 08:15:10.009476 |               447071 | 447071 seconds          |                  |                     |         561.93 | 561.930 W
 137970 | 2017-03-12 08:15:10.044566 |                      |                         |          75503.3 | 75503.280 kWh       |                |
 137971 | 2017-03-12 08:17:14.989874 |               447195 | 447195 seconds          |                  |                     |        407.625 | 407.625 W
 137972 | 2017-03-12 08:17:15.062185 |               447196 | 447196 seconds          |          75503.3 | 75503.302 kWh       |                |
 137973 | 2017-03-12 08:19:20.013678 |               447321 | 447321 seconds          |                  |                     |        414.806 | 414.806 W
 137974 | 2017-03-12 08:19:20.08109  |                      |                         |          75503.3 | 75503.315 kWh       |                |
 137975 | 2017-03-12 08:21:25.008689 |               447446 | 447446 seconds          |                  |                     |        403.041 | 403.041 W
 137976 | 2017-03-12 08:21:25.080645 |                      |                         |          75503.3 | 75503.329 kWh       |                |
 137977 | 2017-03-12 08:23:30.062478 |               447571 | 447571 seconds          |                  |                     |        403.709 | 403.709 W
 137978 | 2017-03-12 08:23:30.096073 |                      |                         |          75503.4 | 75503.349 kWh       |                |
 137979 | 2017-03-12 08:25:35.070005 |               447696 | 447696 seconds          |                  |                     |         417.31 | 417.310 W
 137980 | 2017-03-12 08:25:35.105608 |                      |                         |          75503.4 | 75503.363 kWh       |                |
 137981 | 2017-03-12 08:27:19.074924 |               447800 | 447800 seconds          |          75503.4 | 75503.369 kWh       |                |
 137982 | 2017-03-12 08:27:20.680218 |               447801 | 447801 seconds          |                  |                     |        414.766 | 414.766 W
 137983 | 2017-03-12 08:27:31.162297 |               447812 | 447812 seconds          |          75503.4 | 75503.377 kWh       |                |
 137984 | 2017-03-12 08:27:31.54833  |                      |                         |                  |                     |        402.451 | 402.451 W
 137985 | 2017-03-12 08:27:35.329228 |               447816 | 447816 seconds          |                  |                     |        409.124 | 409.124 W
 137986 | 2017-03-12 08:27:40.080369 |               447821 | 447821 seconds          |                  |                     |        403.979 | 403.979 W
 137987 | 2017-03-12 08:29:45.107921 |               447946 | 447946 seconds          |                  |                     |        409.016 | 409.016 W
 137988 | 2017-03-12 08:29:45.130339 |                      |                         |          75503.4 | 75503.391 kWh       |                |
 137989 | 2017-03-12 08:31:50.125343 |               448071 | 448071 seconds          |                  |                     |        407.857 | 407.857 W
 137990 | 2017-03-12 08:31:50.249355 |                      |                         |          75503.4 | 75503.404 kWh       |                |
 137991 | 2017-03-12 08:33:55.127521 |               448196 | 448196 seconds          |                  |                     |        403.068 | 403.068 W
 137992 | 2017-03-12 08:33:55.300298 |                      |                         |          75503.4 | 75503.418 kWh       |                |
 137993 | 2017-03-12 08:36:00.17854  |               448321 | 448321 seconds          |                  |                     |        404.684 | 404.684 W
 137994 | 2017-03-12 08:36:00.305305 |                      |                         |          75503.4 | 75503.437 kWh       |                |
 137995 | 2017-03-12 08:38:05.146191 |               448446 | 448446 seconds          |                  |                     |        405.852 | 405.852 W
 137996 | 2017-03-12 08:38:05.321849 |                      |                         |          75503.5 | 75503.451 kWh       |                |
 137997 | 2017-03-12 08:40:10.142174 |               448571 | 448571 seconds          |                  |                     |        405.369 | 405.369 W
 137998 | 2017-03-12 08:40:10.211463 |                      |                         |          75503.5 | 75503.464 kWh       |                |
 137999 | 2017-03-12 08:42:15.142192 |               448696 | 448696 seconds          |                  |                     |        411.199 | 411.199 W
 138000 | 2017-03-12 08:42:15.212092 |                      |                         |          75503.5 | 75503.478 kWh       |                |
 138001 | 2017-03-12 08:44:20.156943 |               448821 | 448821 seconds          |                  |                     |         408.67 | 408.670 W
 138002 | 2017-03-12 08:44:20.22945  |                      |                         |          75503.5 | 75503.492 kWh       |                |
 138003 | 2017-03-12 08:46:25.177092 |               448946 | 448946 seconds          |                  |                     |        411.231 | 411.231 W
 138004 | 2017-03-12 08:46:25.247356 |                      |                         |          75503.5 | 75503.506 kWh       |                |
 138005 | 2017-03-12 08:48:30.221187 |               449071 | 449071 seconds          |                  |                     |        417.545 | 417.545 W
 138006 | 2017-03-12 08:48:30.28064  |                      |                         |          75503.5 | 75503.526 kWh       |                |
 138007 | 2017-03-12 08:50:35.253813 |               449196 | 449196 seconds          |                  |                     |        418.878 | 418.878 W
 138008 | 2017-03-12 08:50:35.375818 |                      |                         |          75503.5 | 75503.540 kWh       |                |
 138009 | 2017-03-12 08:52:40.192538 |               449321 | 449321 seconds          |                  |                     |        419.998 | 419.998 W
 138010 | 2017-03-12 08:52:40.365753 |                      |                         |          75503.6 | 75503.554 kWh       |                |
 138011 | 2017-03-12 08:54:45.250279 |               449446 | 449446 seconds          |                  |                     |        426.872 | 426.872 W
 138012 | 2017-03-12 08:54:45.290212 |                      |                         |          75503.6 | 75503.569 kWh       |                |
 138013 | 2017-03-12 08:55:42.114397 |               449503 | 449503 seconds          |          75503.6 | 75503.576 kWh       |                |
 138014 | 2017-03-12 08:55:42.447386 |                      |                         |                  |                     |        422.157 | 422.157 W
 138015 | 2017-03-12 08:55:44.922834 |               449505 | 449505 seconds          |                  |                     |        429.905 | 429.905 W
 138016 | 2017-03-12 08:55:46.813177 |               449507 | 449507 seconds          |                  |                     |        424.874 | 424.874 W
 138017 | 2017-03-12 08:55:50.582224 |               449511 | 449511 seconds          |                  |                     |         421.67 | 421.670 W
 138018 | 2017-03-12 08:55:53.838034 |               449514 | 449514 seconds          |                  |                     |        427.385 | 427.385 W
 138019 | 2017-03-12 08:55:56.047637 |               449517 | 449517 seconds          |                  |                     |        420.484 | 420.484 W
 138020 | 2017-03-12 08:55:57.68121  |               449518 | 449518 seconds          |                  |                     |        423.184 | 423.184 W
 138021 | 2017-03-12 08:55:59.305933 |               449520 | 449520 seconds          |                  |                     |        420.345 | 420.345 W
 138022 | 2017-03-12 08:56:00.834525 |               449521 | 449521 seconds          |                  |                     |        427.574 | 427.574 W
 138023 | 2017-03-12 08:56:02.509491 |               449523 | 449523 seconds          |                  |                     |        428.772 | 428.772 W
 138024 | 2017-03-12 08:56:05.87129  |               449526 | 449526 seconds          |                  |                     |        428.395 | 428.395 W
 138025 | 2017-03-12 08:56:07.814137 |               449528 | 449528 seconds          |                  |                     |         433.07 | 433.070 W
 138026 | 2017-03-12 08:56:09.282176 |               449530 | 449530 seconds          |                  |                     |        429.002 | 429.002 W
 138027 | 2017-03-12 08:56:10.857828 |               449531 | 449531 seconds          |                  |                     |        426.223 | 426.223 W
 138028 | 2017-03-12 08:56:13.009893 |               449534 | 449534 seconds          |                  |                     |        426.141 | 426.141 W
 138029 | 2017-03-12 08:56:14.714787 |               449535 | 449535 seconds          |                  |                     |        428.849 | 428.849 W
 138030 | 2017-03-12 08:56:17.143621 |               449538 | 449538 seconds          |                  |                     |          425.2 | 425.200 W
 138031 | 2017-03-12 08:56:18.856473 |               449539 | 449539 seconds          |                  |                     |        426.041 | 426.041 W
 138032 | 2017-03-12 08:56:21.414274 |               449542 | 449542 seconds          |                  |                     |        426.859 | 426.859 W
 138033 | 2017-03-12 08:56:28.312361 |               449549 | 449549 seconds          |                  |                     |        426.876 | 426.876 W
 138034 | 2017-03-12 08:56:41.928237 |               449562 | 449562 seconds          |          75503.6 | 75503.583 kWh       |                |
 138035 | 2017-03-12 08:56:42.254812 |               449563 | 449563 seconds          |                  |                     |         419.48 | 419.480 W
 138036 | 2017-03-12 08:56:42.913308 |                      |                         |                  |                     |        423.174 | 423.174 W
 138037 | 2017-03-12 08:56:43.57496  |               449564 | 449564 seconds          |                  |                     |        431.975 | 431.975 W
 138038 | 2017-03-12 08:56:44.896164 |               449565 | 449565 seconds          |                  |                     |        430.789 | 430.789 W
 138039 | 2017-03-12 08:56:45.554139 |               449566 | 449566 seconds          |                  |                     |        432.226 | 432.226 W
 138040 | 2017-03-12 08:56:50.5022   |               449571 | 449571 seconds          |                  |                     |        421.734 | 421.734 W
(100 rows)


Posted on
Wed Mar 15, 2017 1:05 pm
marc.roest@gmail.com offline
Posts: 15
Joined: Feb 01, 2017

Re: INDIGOplotD -- a plot tool for indigo

Hi,

sorry, I have to postpone my reply. For some reason my energy meter is not responding anymore. I need to reset it and gather my data again. I'll get back to you with the required info asap..

sorry again..

Posted on
Thu Mar 16, 2017 1:12 pm
marc.roest@gmail.com offline
Posts: 15
Joined: Feb 01, 2017

Re: INDIGOplotD -- a plot tool for indigo

Hi Karl,

I've tried to make the exports, the last 100 rows didn't work out so I've attached a print screen of the last few. I use 2 sources by the way. High rate power and low rate power which are 2 devices in indigodomo.
https://www.dropbox.com/sh/o2na0nnp2khq ... ZwdJa?dl=0

Thanks in adv once,

Marc

Posted on
Thu Mar 16, 2017 2:26 pm
kw123 offline
User avatar
Posts: 5726
Joined: May 12, 2013
Location: Dallas, TX

INDIGOplotD -- a plot tool for indigo

if you look at the date column
Screen Shot 2017-03-16 at 15.14.50.png
Screen Shot 2017-03-16 at 15.14.50.png (66.86 KiB) Viewed 1811 times
the values are only updated every 30 minutes.

then doing a delta every 5 minutes will get you most of the time 0. only around :00 and :30 you should get a small value. .. the usage is ~ 200 Watt that gives 0.2 KWH .

dividing that by 60 to get to minutes that gives an even a smaller number.

that would explain it:
in SQL import if you don't have a current value it takes the last one. in the regular mode it tries to do a delta, but there was nothing in the last bin. I could change that to check the last bin with value..

and by the way why do you want to make it complicated: the device delivers the Watts as currentenergylevel. just use that one..delta norm hour is supposed to emulate that value if your device does not deliver it. It is for simple counters that only deliver an ever increasing number.

Karl

Posted on
Fri Mar 17, 2017 1:32 pm
marc.roest@gmail.com offline
Posts: 15
Joined: Feb 01, 2017

Re: INDIGOplotD -- a plot tool for indigo

I understand, the reason I use the counter is that I need to poll the device for info, it doesn't send an automatic update very x min.
I've tried 5 mins but then it hangs more often. therefore I'm trying 30 mins now. So if the usage in Watt is very high at that exact time it doesn't give me a clear image of the usage

U understand the values are very small but since the scale of the graph is automatically that shouldn't matter am I right?

For some reason it works for a few days, when I reload SQL data in the plugin and after a few days the minute graph is not updated anymore.

thanks again.

Posted on
Fri Mar 17, 2017 4:06 pm
kw123 offline
User avatar
Posts: 5726
Joined: May 12, 2013
Location: Dallas, TX

Re: INDIGOplotD -- a plot tool for indigo

Also the accumulated energy gives sometimes bad values.
I am using 120 seconds update and that seems to work ok.
So if it does not work once it's likely it will work at least once in 5 minutes.


Sent from my iPhone using Tapatalk

Posted on
Sat Mar 18, 2017 1:57 pm
marc.roest@gmail.com offline
Posts: 15
Joined: Feb 01, 2017

Re: INDIGOplotD -- a plot tool for indigo

I set the refresh to 5 min now.

However I think it's not in the values from the device.

A moment ago my hour graph was up to date but the minute graph stoped showing data at 0.00 past night. When I pressed reload SQL data in de indigoplotD menu and refreshed the graph the data was there. So it must be somewhere in the source of the table stopping with getting updated.

Posted on
Sun Mar 19, 2017 11:42 pm
kw123 offline
User avatar
Posts: 5726
Joined: May 12, 2013
Location: Dallas, TX

Re: INDIGOplotD -- a plot tool for indigo

ok I thought about it. the issue is there is missing data. if you don't have data in a bin, how to decide what to use..

the sql import scans through the raw data and interpolates if no data bin is available. it does not calculate the current value as there are not 2 values available.

the regular mode (every 5 minutes) looks at the current value and the value from the last bin and calculates the delta. if there is no data in the last bin one could use the last value and time then calculate an estimate with the current value, but if current value == old value the result must be zero if no data was read. that might lead to a gross over or underestimation in individual bins
Currently the normal mode does not recalculate past values / bins.

If we want to change that i need to restructure the program.. (keep last valid data point & timestamp then recalculate all bins from the last valid point forward ..

There is an issue one way or the other if you have missing data and want to do interpolation.

This is actually interesting, but it will take me some time.. I hope this makes sense ..

Karl

Posted on
Mon Mar 20, 2017 1:12 pm
marc.roest@gmail.com offline
Posts: 15
Joined: Feb 01, 2017

Re: INDIGOplotD -- a plot tool for indigo

Thanks, it does make (a little) sense ;)

But since I put it to 5 mins two days ago it's still up to date. So maybe that's just the trick for now.

I'll get back to you in a week or so and let you know if its still running.

Thanks in advance for all your patience..

Posted on
Sat Jun 24, 2017 9:08 pm
bkmar1192 offline
Posts: 274
Joined: Sep 12, 2015

Re: INDIGOplotD -- a plot tool for indigo

I keep getting the following over and over again after launching IndigoPlotD. Any help?

INDIGOplotD sql command for Thermostat-temperatureInput1 starting at 4335 added
INDIGOplotD sql command for Thermostat-hvacCoolerIsOn starting at 4335 added
INDIGOplotD sql command for Thermostat-hvacHeaterIsOn starting at 4335 added
INDIGOplotD sql command for Basement Temperature-sensorValue starting at 1333 added
INDIGOplotD sql command for Front Temperature-sensorValue starting at 791 added
INDIGOplotD sql command for Back Yard Temperature-sensorValue starting at 93 added
INDIGOplotD sql commands launched 2017-06-24 20:06:47.454138 waiting for SQL tasks to end to read data into INDIGOplotD pid=39590

Posted on
Sat Jun 24, 2017 10:58 pm
kw123 offline
User avatar
Posts: 5726
Joined: May 12, 2013
Location: Dallas, TX

INDIGOplotD -- a plot tool for indigo

I am out of town. Don't know when I can look aT it.
You could try to restart the plugin
Or switch use sql off/on in config


And which version are you using?

Sent from my iPhone using Tapatalk

Posted on
Fri Jun 30, 2017 8:43 am
bkmar1192 offline
Posts: 274
Joined: Sep 12, 2015

Re: INDIGOplotD -- a plot tool for indigo

kw123 wrote:
I am out of town. Don't know when I can look aT it.
You could try to restart the plugin
Or switch use sql off/on in config


And which version are you using?

Sent from my iPhone using Tapatalk


My database had become corrupted - rebuilt it and everything seems to be ok now.


Sent from my iPhone using Tapatalk

Posted on
Tue Aug 01, 2017 5:34 am
pcbiti offline
Posts: 6
Joined: Jun 07, 2017

Re: INDIGOplotD -- a plot tool for indigo

How can I calculate the power consumption in the easiest way?
I want to read kwh per day, month and year and use it in indigoplotd?
Is there any step by step guide for this?

Posted on
Tue Aug 01, 2017 11:13 am
kw123 offline
User avatar
Posts: 5726
Joined: May 12, 2013
Location: Dallas, TX

Re: INDIGOplotD -- a plot tool for indigo

ow can I calculate the power consumption in the easiest way?
I want to read kwh per day, month and year and use it in indigoplotd?
Is there any step by step guide for this?

see: http://forums.indigodomo.com/viewtopic.php?f=165&t=18758

Who is online

Users browsing this forum: No registered users and 1 guest