Page 1 of 3

INDIGOPlotD error creating gnu plots

PostPosted: Tue Mar 06, 2018 5:10 pm
by GRWilde
I just updated to the latest version of INDIGOPlotD (4.17.41) and suddenly am getting the following error with no plots being generated. The previous version I used was generating plots correctly. Any ideas what is wrong?

plot ,
^
"/Users/grwilde/indigo/INDIGOplotD/gnu/Outdoor Environment-hour-S2.gnu", line 32: invalid expression


INDIGOplotD plotting GNUPLOT error/warning for /Users/grwilde/indigo/INDIGOplotD/gnu/Outdoor Environment-day-S1
INDIGOplotD
plot ,
^
"/Users/grwilde/indigo/INDIGOplotD/gnu/Outdoor Environment-day-S1.gnu", line 32: invalid expression


INDIGOplotD plotting GNUPLOT error/warning for /Users/grwilde/indigo/INDIGOplotD/gnu/Outdoor Environment-day-S2
INDIGOplotD
plot ,
^
"/Users/grwilde/indigo/INDIGOplotD/gnu/Outdoor Environment-day-S2.gnu", line 32: invalid expression


INDIGOplotD plotting GNUPLOT error/warning for /Users/grwilde/indigo/INDIGOplotD/gnu/Energy Monitor-minute-S1
INDIGOplotD
plot ,
^
"/Users/grwilde/indigo/INDIGOplotD/gnu/Energy Monitor-minute-S1.gnu", line 32: invalid expression


INDIGOplotD plotting GNUPLOT error/warning for /Users/grwilde/indigo/INDIGOplotD/gnu/Energy Monitor-minute-S2
INDIGOplotD
plot ,
^
"/Users/grwilde/indigo/INDIGOplotD/gnu/Energy Monitor-minute-S2.gnu", line 32: invalid expression


INDIGOplotD plotting GNUPLOT error/warning for /Users/grwilde/indigo/INDIGOplotD/gnu/Energy Monitor-hour-S1
INDIGOplotD
plot ,
^
"/Users/grwilde/indigo/INDIGOplotD/gnu/Energy Monitor-hour-S1.gnu", line 32: invalid expression

Re: INDIGOPlotD error creating gnu plots

PostPosted: Tue Mar 06, 2018 7:32 pm
by kw123
That’s a real bug. Will fix.


Sent from my iPhone using Tapatalk

Re: INDIGOPlotD error creating gnu plots

PostPosted: Tue Mar 06, 2018 9:15 pm
by kw123
https://www.indigodomo.com/pluginstore/71/


a "-" sign was missing... don't know that one got lost ..:
Code: Select all
 self.DEVICE[str(devNo)]["measurement"][stateNo].find("event") ==-1:
should be fixed..

sorry for that

Karl

Re: INDIGOPlotD error creating gnu plots

PostPosted: Tue Mar 06, 2018 9:44 pm
by GRWilde
The update is listed as uniFiAP.indigoPlugin instead of INDIGOPlotD. Is that right?

Re: INDIGOPlotD error creating gnu plots

PostPosted: Tue Mar 06, 2018 10:41 pm
by kw123
sorry, now posted the correct version, but I can't delete the wrong upload will need to ask MATT/JAY to delete

the correct one is v .42

Karl

Re: INDIGOPlotD error creating gnu plots

PostPosted: Tue Mar 06, 2018 10:56 pm
by GRWilde
Thanks. Plots work OK now.

Re: INDIGOPlotD error creating gnu plots

PostPosted: Tue Mar 06, 2018 11:09 pm
by matt (support)
kw123 wrote:
I can't delete the wrong upload will need to ask MATT/JAY to delete

Done! :-)

Re: INDIGOPlotD error creating gnu plots

PostPosted: Tue Mar 06, 2018 11:11 pm
by kw123
Thx


Sent from my iPhone using Tapatalk

Re: INDIGOPlotD error creating gnu plots

PostPosted: Thu Mar 08, 2018 4:48 pm
by GRWilde
INDIGOPlotD seems now to be dropping recent data prior to midnight, or if I reload the plugin, prior to the time of reload. Previous plot data prior to my last plugin update is still there in the weekly and monthly plots, but all data from the last couple of days is missing. Plot graphs from midnight, or if I reload the plugin -from the latest reload time, is all that appears in the daily plots. The data that is plotted looks correct. The plot devices themselves indicate a last update of 2000-01-01 00:00:00

Re: INDIGOPlotD error creating gnu plots

PostPosted: Thu Mar 08, 2018 9:05 pm
by kw123
TEST 1:
check files like /Users/yourid/indigo/INDIGOplotD/sql/1062219179-Temperature
open with any editor !!but DO NOT SAVE or change!!
they should look like:
Code: Select all
99;20160707164625;23.0
102;20160707164755;23.1
107;20160707164925;23.3
112;20160707165055;23.5
115;20160707165226;23.6


check for gaps

TEST 2
the please check file :
Code: Select all
/Users/userid/indigo/INDIGOplotD/data/day.dat.formatted
and or minute day ...

is some what better formatted than the real data file in columns...

check if there are data holes.

It should look like this:
Code: Select all
20180301145500   18;3;0;0;0; 179; 0.5000;no-data; 4074.9; 196598;58140.2; 98.700; 0.0000; 71.600; 92.400; 0.0000; 0.0000; 0.0000; 64.200; 0.0000; 166.00; 3.5250; 636.32; 636.32; 0.0000; 0.0000; 0.0077; 72.500; 72.500; 72.500; 0.0000; 510.84; 0.0156; 13.327; 99.400; 69.800; 1020.0; 1.0000; 73.000; 47.000; 1020.8;-77.000;no-data;no-data; 55.833;-72.500; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000;no-data;no-data;no-data;no-data;
20180301150000   17;3;0;0;0; 180; 0.5000;no-data; 4317.9; 212571;64581.9; 98.700; 0.0000; 71.600; 92.400; 0.0000; 0.0000; 0.0000; 64.500; 0.0000; 150.59; 3.3000; 699.84; 699.84; 0.0000; 0.0000; 0.0077; 72.500; 72.500; 72.500; 0.0000; 508.62; 0.0156; 13.327; 99.400; 69.800; 1020.3; 1.0000; 72.900; 47.000; 1021.0;-77.000;no-data;no-data; 55.833;-72.500; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000;no-data;no-data;no-data;no-data;
20180301150500   17;3;0;0;0; 181; 0.5000;no-data; 2936.9; 138671;40426.0; 99.000; 0.0000; 71.600; 92.500; 0.0000; 0.0000; 0.0000; 64.220; 0.0000; 197.00; 4.3000; 699.84; 699.84; 0.0000; 0.0000; 0.0077; 72.700; 72.700; 72.700; 0.0000; 508.62; 0.0156; 3.8368; 99.400; 69.800; 1020.4; 1.0000; 72.900; 47.000; 1021.1;-77.000;no-data;no-data; 55.833;-74.000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000;no-data;no-data;no-data;no-data;
20180301151000   20;3;0;0;0; 182; 0.5000;no-data; 3721.3; 180624;53857.1; 98.800; 0.0000; 71.600; 92.300; 0.0000; 0.0000; 0.0000; 64.100; 0.0000; 179.75; 3.2750; 643.96; 643.96; 0.0000; 0.0000; 0.0077; 72.700; 72.700; 72.700; 0.0000; 515.29; 0.0156; 3.8368; 99.500; 69.800; 1020.3; 1.0000; 73.000; 46.000; 1021.2;-77.000;no-data;no-data; 55.833;-74.000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000;no-data;no-data;no-data;no-data;
20180301151500   13;3;0;0;0; 183; 0.5000;no-data; 3104.5; 149837;44320.7; 98.800; 0.0000; 71.600; 92.300; 0.0000; 0.0000; 0.0000; 64.467; 0.0000; 188.54; 3.6000; 643.96; 643.96; 0.0000; 0.0000; 0.0077; 72.700; 72.700; 72.700; 0.0000; 515.29; 0.0156; 1487.3; 99.367; 70.000; 1020.5; 1.0000; 73.200; 46.000; 1021.3;-77.000;no-data;no-data; 55.833;-74.000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000;no-data;no-data;no-data;no-data;
20180301152000   14;3;0;0;0; 184; 0.5000;no-data; 2285.0; 106128;29695.9; 98.800; 0.0000; 71.600; 92.500; 0.0000; 0.0000; 0.0000; 64.000; 0.0000; 146.07; 2.9200; 643.52; 643.52; 0.0000; 0.0000; 0.0077; 72.700; 72.700; 72.700; 0.0000; 509.90; 0.0156; 1487.3; 99.600; 70.000; 1020.5; 1.0000; 73.400; 45.000; 1021.3;-92.000;no-data;no-data; 55.900;-72.000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000;no-data;no-data;no-data;no-data;
20180301152500   17;3;0;0;0; 185; 0.5000;no-data; 2567.8; 120459;35060.7; 98.900; 0.0000; 71.600; 92.500; 0.0000; 0.0000; 0.0000; 64.000; 0.0000; 157.29; 3.0600; 643.52; 643.52; 0.0000; 0.0000; 0.0077; 72.700; 72.700; 72.700; 0.0000; 509.90; 0.0156; 944.70; 99.600; 69.800; 1020.5; 1.0000; 73.200; 46.000; 1021.2;-86.500;no-data;no-data; 55.900;-76.000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000;no-data;no-data;no-data;no-data;
20180301153000   21;3;0;0;0; 186; 0.5000;no-data; 2096.0;97861.6;27602.6; 98.933; 0.0000; 71.600; 92.300; 0.0000; 0.0000; 0.0000; 63.740; 0.0000; 149.81; 3.6600; 671.69; 671.69; 0.0000; 0.0000; 0.0077; 72.700; 72.700; 72.700; 0.0000; 1011.1; 0.0156; 944.70; 99.600; 69.900; 1020.7; 1.0000; 73.200; 46.000; 1021.4;-89.000;no-data;no-data; 55.900;-76.000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000;no-data;no-data;no-data;no-data;


a whole rows with" no-data;" would indicate something is wrong .. some fields in-between with "no-data" is ok.


if test 1 is wrong sql export is wrong or there is no data ; if test 2 is wrong something in the plugin is wrong

mine looks fine.. need some more details

Karl

Re: INDIGOPlotD error creating gnu plots

PostPosted: Thu Mar 08, 2018 10:29 pm
by GRWilde
my /Users/yourid/indigo/INDIGOplotD/sql/56777626-indoorTemperature_F file looks like this at the end, but the last update date is March 6, 2018 at 1:06 AM:

126148;20180305001030;72.9
126149;20180305001102;72.9
126150;20180305001134;72.8
126151;20180305001239;72.8
126152;20180305001343;72.7
126153;20180305001415;72.7
126154;20180305001518;72.6

My /Users/userid/indigo/INDIGOplotD/data/day.dat.formatted file looks empty until data begins appearing:

20171226000000 0;1;0;0;0; 317; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000;
20171227000000 0;2;0;0;0; 318; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000;
20171228000000 0;3;0;0;0; 319; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000;
20171229000000 0;4;0;0;0; 320; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000;
20171230000000 1132;5;0;0;0; 321; 62.756; 73.219; 0.1642; 0.0000; 0.1663; 48.520; 72.923; 1.2440; 121.92; 58.721; 80.646; 73.047; 30.044; 0.5278; 0.0000; 69.857; 71.349;
20171231000000 2406;6;1;1;0; 322; 60.534; 72.229; 0.0983; 0.0000; 0.1105; 49.597; 71.789; 1.1067; 122.46; 57.361; 85.327; 72.451; 30.095; 0.1391; 0.0000; 69.312; 69.683;
20180101000000 2234;0;0;0;0; 323; 59.201; 72.823; 0.1704; 0.0000; 0.1904; 48.546; 72.760; 1.2070; 122.56; 56.849; 83.856; 73.090; 30.137; 0.2249; 0.0000; 69.711; 70.659;
20180102000000 1862;1;0;0;0; 324; 60.675; 71.675; 0.1113; 0.0000; 0.1266; 52.882; 71.521; 1.0173; 121.59; 60.237; 81.645; 72.336; 30.099; 0.3799; 0.0000; 69.046; 69.190;
20180103000000 1800;2;0;0;0; 325; 62.000; 73.242; 0.1156; 0.0000; 0.1206; 52.234; 72.338; 1.0745; 121.54; 60.556; 78.814; 73.552; 30.052; 0.0211; 0.0000; 70.405; 70.615;
20180104000000 1878;3;0;0;0; 326; 63.821; 74.209; 0.1469; 0.0000; 0.1705; 52.407; 73.871; 1.0491; 121.50; 63.021; 72.943; 74.458; 30.120; 0.3046; 0.0000; 71.114; 71.779;

The end of the file looks like this:

Date #dat;W;M;Y;-; n; 1; 2; 3; 4; 5; 6; 7; 8; 9; 10; 11; 12; 13; 14; 15; 16; 17;

Current measurement values:
currentValues.: 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000;
lastMeasurem./T: 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000;
#ofMeasuremts/LastM: 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000;
LastT: 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000;
TBI: 389; 389; 389; 389; 389; 389; 389; 389; 389; 389; 389; 389; 389; 389; 389; 389; 389;
FirstM-1: *******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;
FirstT-1: *******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;
LastM-1: *******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;
LastT-1: *******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;
TBI-1: -2; -2; -2; -2; -2; -2; -2; -2; -2; -2; -2; -2; -2; -2; -2; -2; -2;
LastM-2: *******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;
LastT-2: *******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;
TBI-2: -2; -2; -2; -2; -2; -2; -2; -2; -2; -2; -2; -2; -2; -2; -2; -2; -2;

ResetPeriod+Cost Parmeters:
comsuption columns []
lastCostTimeBin : ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ;
costAtLastCostBracket : ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ;
lastResetBin : ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ;
lastDay : ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ;
valueAtStartOfCostBin : ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ;
currentCostTimeBin : ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ;
lastCostBinWithData : ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ;
valueAtStartOfTimeBin : ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ;
testDayHour : ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ;
1; 2; 3; 4; 5; 6; 7; 8; 9; 10; 11; 12; 13; 14; 15; 16; 17;

I do notice that time on the day.dat.formatted file is 2:34 PM today when I reloaded the plugin, but the time on the day/dat file is the current time.

I also notice that the sqlFix.log that is dated when I reloaded the plugin shows that many records were removed due to duplicate IDs, for instance:

input /Users/grwilde/indigo/INDIGOplotD/sql/56777626-outdoorTemperature_F.sqlout
output /Users/grwilde/indigo/INDIGOplotD/sql/56777626-outdoorTemperature_F
starting at id: 123991
last id written: 126154
read/written: 2163/ 2162; Val OK: 2163 records; removed .. due to duplicate IDs: 0; date: 0; noValue: 0; sameDate&Value:

I hope this helps in isolating my problem.

Re: INDIGOPlotD error creating gnu plots

PostPosted: Thu Mar 08, 2018 11:13 pm
by GRWilde
My indigo_history.sqlite database had somehow become corrupted a couple of days ago and I had to start a new database. Could this be causing my problems?

INDIGOPlotD error creating gnu plots

PostPosted: Thu Mar 08, 2018 11:45 pm
by kw123
Yes then you do not have data
Indigoplot reads the current sql database it then overwrites the local data files

sql Database kaput ==> no data

Strongly suggest to
Either switch to Postgres
Or at least do daily backups of the SQLite dB ( indigo utilities can do that for you)



Sent from my iPhone using Tapatalk

Re: INDIGOPlotD error creating gnu plots

PostPosted: Sat Mar 10, 2018 3:33 pm
by GRWilde
Thanks for your help. I restarted with a new SQLite dB and reset the plots. Plots look fine for the last couple of days since I reset everything.

I have experienced corrupt SQLite databases every few months - not that frequent but still annoying. I did use your indigo utilities to backup the SQLite dB, but am unfamiliar with how to restore the SQLite dB from the backup should it become corrupted again. How is that done?

Re: INDIGOPlotD error creating gnu plots

PostPosted: Sat Mar 10, 2018 5:09 pm
by kw123
Stop sqllogger
Delete old sqlfile
Copy backupfile to log directory

Backup is in ~Indigo/indigoutilies


Sent from my iPhone using Tapatalk