INDIGOPlotD error creating gnu plots

Posted on
Tue Mar 06, 2018 5:10 pm
GRWilde offline
User avatar
Posts: 173
Joined: Nov 15, 2005
Location: Los Angeles

INDIGOPlotD error creating gnu plots

I just updated to the latest version of INDIGOPlotD (4.17.41) and suddenly am getting the following error with no plots being generated. The previous version I used was generating plots correctly. Any ideas what is wrong?

plot ,
^
"/Users/grwilde/indigo/INDIGOplotD/gnu/Outdoor Environment-hour-S2.gnu", line 32: invalid expression


INDIGOplotD plotting GNUPLOT error/warning for /Users/grwilde/indigo/INDIGOplotD/gnu/Outdoor Environment-day-S1
INDIGOplotD
plot ,
^
"/Users/grwilde/indigo/INDIGOplotD/gnu/Outdoor Environment-day-S1.gnu", line 32: invalid expression


INDIGOplotD plotting GNUPLOT error/warning for /Users/grwilde/indigo/INDIGOplotD/gnu/Outdoor Environment-day-S2
INDIGOplotD
plot ,
^
"/Users/grwilde/indigo/INDIGOplotD/gnu/Outdoor Environment-day-S2.gnu", line 32: invalid expression


INDIGOplotD plotting GNUPLOT error/warning for /Users/grwilde/indigo/INDIGOplotD/gnu/Energy Monitor-minute-S1
INDIGOplotD
plot ,
^
"/Users/grwilde/indigo/INDIGOplotD/gnu/Energy Monitor-minute-S1.gnu", line 32: invalid expression


INDIGOplotD plotting GNUPLOT error/warning for /Users/grwilde/indigo/INDIGOplotD/gnu/Energy Monitor-minute-S2
INDIGOplotD
plot ,
^
"/Users/grwilde/indigo/INDIGOplotD/gnu/Energy Monitor-minute-S2.gnu", line 32: invalid expression


INDIGOplotD plotting GNUPLOT error/warning for /Users/grwilde/indigo/INDIGOplotD/gnu/Energy Monitor-hour-S1
INDIGOplotD
plot ,
^
"/Users/grwilde/indigo/INDIGOplotD/gnu/Energy Monitor-hour-S1.gnu", line 32: invalid expression

George Wilde

Posted on
Tue Mar 06, 2018 7:32 pm
kw123 offline
User avatar
Posts: 8333
Joined: May 12, 2013
Location: Dallas, TX

Re: INDIGOPlotD error creating gnu plots

That’s a real bug. Will fix.


Sent from my iPhone using Tapatalk

Posted on
Tue Mar 06, 2018 9:15 pm
kw123 offline
User avatar
Posts: 8333
Joined: May 12, 2013
Location: Dallas, TX

Re: INDIGOPlotD error creating gnu plots

https://www.indigodomo.com/pluginstore/71/


a "-" sign was missing... don't know that one got lost ..:
Code: Select all
 self.DEVICE[str(devNo)]["measurement"][stateNo].find("event") ==-1:
should be fixed..

sorry for that

Karl

Posted on
Tue Mar 06, 2018 9:44 pm
GRWilde offline
User avatar
Posts: 173
Joined: Nov 15, 2005
Location: Los Angeles

Re: INDIGOPlotD error creating gnu plots

The update is listed as uniFiAP.indigoPlugin instead of INDIGOPlotD. Is that right?

George Wilde

Posted on
Tue Mar 06, 2018 10:41 pm
kw123 offline
User avatar
Posts: 8333
Joined: May 12, 2013
Location: Dallas, TX

Re: INDIGOPlotD error creating gnu plots

sorry, now posted the correct version, but I can't delete the wrong upload will need to ask MATT/JAY to delete

the correct one is v .42

Karl

Posted on
Tue Mar 06, 2018 10:56 pm
GRWilde offline
User avatar
Posts: 173
Joined: Nov 15, 2005
Location: Los Angeles

Re: INDIGOPlotD error creating gnu plots

Thanks. Plots work OK now.

George Wilde

Posted on
Tue Mar 06, 2018 11:09 pm
matt (support) offline
Site Admin
User avatar
Posts: 21411
Joined: Jan 27, 2003
Location: Texas

Re: INDIGOPlotD error creating gnu plots

kw123 wrote:
I can't delete the wrong upload will need to ask MATT/JAY to delete

Done! :-)

Image

Posted on
Tue Mar 06, 2018 11:11 pm
kw123 offline
User avatar
Posts: 8333
Joined: May 12, 2013
Location: Dallas, TX

Re: INDIGOPlotD error creating gnu plots

Thx


Sent from my iPhone using Tapatalk

Posted on
Thu Mar 08, 2018 4:48 pm
GRWilde offline
User avatar
Posts: 173
Joined: Nov 15, 2005
Location: Los Angeles

Re: INDIGOPlotD error creating gnu plots

INDIGOPlotD seems now to be dropping recent data prior to midnight, or if I reload the plugin, prior to the time of reload. Previous plot data prior to my last plugin update is still there in the weekly and monthly plots, but all data from the last couple of days is missing. Plot graphs from midnight, or if I reload the plugin -from the latest reload time, is all that appears in the daily plots. The data that is plotted looks correct. The plot devices themselves indicate a last update of 2000-01-01 00:00:00

George Wilde

Posted on
Thu Mar 08, 2018 9:05 pm
kw123 offline
User avatar
Posts: 8333
Joined: May 12, 2013
Location: Dallas, TX

Re: INDIGOPlotD error creating gnu plots

TEST 1:
check files like /Users/yourid/indigo/INDIGOplotD/sql/1062219179-Temperature
open with any editor !!but DO NOT SAVE or change!!
they should look like:
Code: Select all
99;20160707164625;23.0
102;20160707164755;23.1
107;20160707164925;23.3
112;20160707165055;23.5
115;20160707165226;23.6


check for gaps

TEST 2
the please check file :
Code: Select all
/Users/userid/indigo/INDIGOplotD/data/day.dat.formatted
and or minute day ...

is some what better formatted than the real data file in columns...

check if there are data holes.

It should look like this:
Code: Select all
20180301145500   18;3;0;0;0; 179; 0.5000;no-data; 4074.9; 196598;58140.2; 98.700; 0.0000; 71.600; 92.400; 0.0000; 0.0000; 0.0000; 64.200; 0.0000; 166.00; 3.5250; 636.32; 636.32; 0.0000; 0.0000; 0.0077; 72.500; 72.500; 72.500; 0.0000; 510.84; 0.0156; 13.327; 99.400; 69.800; 1020.0; 1.0000; 73.000; 47.000; 1020.8;-77.000;no-data;no-data; 55.833;-72.500; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000;no-data;no-data;no-data;no-data;
20180301150000   17;3;0;0;0; 180; 0.5000;no-data; 4317.9; 212571;64581.9; 98.700; 0.0000; 71.600; 92.400; 0.0000; 0.0000; 0.0000; 64.500; 0.0000; 150.59; 3.3000; 699.84; 699.84; 0.0000; 0.0000; 0.0077; 72.500; 72.500; 72.500; 0.0000; 508.62; 0.0156; 13.327; 99.400; 69.800; 1020.3; 1.0000; 72.900; 47.000; 1021.0;-77.000;no-data;no-data; 55.833;-72.500; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000;no-data;no-data;no-data;no-data;
20180301150500   17;3;0;0;0; 181; 0.5000;no-data; 2936.9; 138671;40426.0; 99.000; 0.0000; 71.600; 92.500; 0.0000; 0.0000; 0.0000; 64.220; 0.0000; 197.00; 4.3000; 699.84; 699.84; 0.0000; 0.0000; 0.0077; 72.700; 72.700; 72.700; 0.0000; 508.62; 0.0156; 3.8368; 99.400; 69.800; 1020.4; 1.0000; 72.900; 47.000; 1021.1;-77.000;no-data;no-data; 55.833;-74.000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000;no-data;no-data;no-data;no-data;
20180301151000   20;3;0;0;0; 182; 0.5000;no-data; 3721.3; 180624;53857.1; 98.800; 0.0000; 71.600; 92.300; 0.0000; 0.0000; 0.0000; 64.100; 0.0000; 179.75; 3.2750; 643.96; 643.96; 0.0000; 0.0000; 0.0077; 72.700; 72.700; 72.700; 0.0000; 515.29; 0.0156; 3.8368; 99.500; 69.800; 1020.3; 1.0000; 73.000; 46.000; 1021.2;-77.000;no-data;no-data; 55.833;-74.000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000;no-data;no-data;no-data;no-data;
20180301151500   13;3;0;0;0; 183; 0.5000;no-data; 3104.5; 149837;44320.7; 98.800; 0.0000; 71.600; 92.300; 0.0000; 0.0000; 0.0000; 64.467; 0.0000; 188.54; 3.6000; 643.96; 643.96; 0.0000; 0.0000; 0.0077; 72.700; 72.700; 72.700; 0.0000; 515.29; 0.0156; 1487.3; 99.367; 70.000; 1020.5; 1.0000; 73.200; 46.000; 1021.3;-77.000;no-data;no-data; 55.833;-74.000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000;no-data;no-data;no-data;no-data;
20180301152000   14;3;0;0;0; 184; 0.5000;no-data; 2285.0; 106128;29695.9; 98.800; 0.0000; 71.600; 92.500; 0.0000; 0.0000; 0.0000; 64.000; 0.0000; 146.07; 2.9200; 643.52; 643.52; 0.0000; 0.0000; 0.0077; 72.700; 72.700; 72.700; 0.0000; 509.90; 0.0156; 1487.3; 99.600; 70.000; 1020.5; 1.0000; 73.400; 45.000; 1021.3;-92.000;no-data;no-data; 55.900;-72.000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000;no-data;no-data;no-data;no-data;
20180301152500   17;3;0;0;0; 185; 0.5000;no-data; 2567.8; 120459;35060.7; 98.900; 0.0000; 71.600; 92.500; 0.0000; 0.0000; 0.0000; 64.000; 0.0000; 157.29; 3.0600; 643.52; 643.52; 0.0000; 0.0000; 0.0077; 72.700; 72.700; 72.700; 0.0000; 509.90; 0.0156; 944.70; 99.600; 69.800; 1020.5; 1.0000; 73.200; 46.000; 1021.2;-86.500;no-data;no-data; 55.900;-76.000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000;no-data;no-data;no-data;no-data;
20180301153000   21;3;0;0;0; 186; 0.5000;no-data; 2096.0;97861.6;27602.6; 98.933; 0.0000; 71.600; 92.300; 0.0000; 0.0000; 0.0000; 63.740; 0.0000; 149.81; 3.6600; 671.69; 671.69; 0.0000; 0.0000; 0.0077; 72.700; 72.700; 72.700; 0.0000; 1011.1; 0.0156; 944.70; 99.600; 69.900; 1020.7; 1.0000; 73.200; 46.000; 1021.4;-89.000;no-data;no-data; 55.900;-76.000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000;no-data;no-data;no-data;no-data;


a whole rows with" no-data;" would indicate something is wrong .. some fields in-between with "no-data" is ok.


if test 1 is wrong sql export is wrong or there is no data ; if test 2 is wrong something in the plugin is wrong

mine looks fine.. need some more details

Karl

Posted on
Thu Mar 08, 2018 10:29 pm
GRWilde offline
User avatar
Posts: 173
Joined: Nov 15, 2005
Location: Los Angeles

Re: INDIGOPlotD error creating gnu plots

my /Users/yourid/indigo/INDIGOplotD/sql/56777626-indoorTemperature_F file looks like this at the end, but the last update date is March 6, 2018 at 1:06 AM:

126148;20180305001030;72.9
126149;20180305001102;72.9
126150;20180305001134;72.8
126151;20180305001239;72.8
126152;20180305001343;72.7
126153;20180305001415;72.7
126154;20180305001518;72.6

My /Users/userid/indigo/INDIGOplotD/data/day.dat.formatted file looks empty until data begins appearing:

20171226000000 0;1;0;0;0; 317; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000;
20171227000000 0;2;0;0;0; 318; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000;
20171228000000 0;3;0;0;0; 319; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000;
20171229000000 0;4;0;0;0; 320; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000;
20171230000000 1132;5;0;0;0; 321; 62.756; 73.219; 0.1642; 0.0000; 0.1663; 48.520; 72.923; 1.2440; 121.92; 58.721; 80.646; 73.047; 30.044; 0.5278; 0.0000; 69.857; 71.349;
20171231000000 2406;6;1;1;0; 322; 60.534; 72.229; 0.0983; 0.0000; 0.1105; 49.597; 71.789; 1.1067; 122.46; 57.361; 85.327; 72.451; 30.095; 0.1391; 0.0000; 69.312; 69.683;
20180101000000 2234;0;0;0;0; 323; 59.201; 72.823; 0.1704; 0.0000; 0.1904; 48.546; 72.760; 1.2070; 122.56; 56.849; 83.856; 73.090; 30.137; 0.2249; 0.0000; 69.711; 70.659;
20180102000000 1862;1;0;0;0; 324; 60.675; 71.675; 0.1113; 0.0000; 0.1266; 52.882; 71.521; 1.0173; 121.59; 60.237; 81.645; 72.336; 30.099; 0.3799; 0.0000; 69.046; 69.190;
20180103000000 1800;2;0;0;0; 325; 62.000; 73.242; 0.1156; 0.0000; 0.1206; 52.234; 72.338; 1.0745; 121.54; 60.556; 78.814; 73.552; 30.052; 0.0211; 0.0000; 70.405; 70.615;
20180104000000 1878;3;0;0;0; 326; 63.821; 74.209; 0.1469; 0.0000; 0.1705; 52.407; 73.871; 1.0491; 121.50; 63.021; 72.943; 74.458; 30.120; 0.3046; 0.0000; 71.114; 71.779;

The end of the file looks like this:

Date #dat;W;M;Y;-; n; 1; 2; 3; 4; 5; 6; 7; 8; 9; 10; 11; 12; 13; 14; 15; 16; 17;

Current measurement values:
currentValues.: 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000;
lastMeasurem./T: 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000;
#ofMeasuremts/LastM: 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000;
LastT: 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000; 0.0000;
TBI: 389; 389; 389; 389; 389; 389; 389; 389; 389; 389; 389; 389; 389; 389; 389; 389; 389;
FirstM-1: *******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;
FirstT-1: *******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;
LastM-1: *******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;
LastT-1: *******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;
TBI-1: -2; -2; -2; -2; -2; -2; -2; -2; -2; -2; -2; -2; -2; -2; -2; -2; -2;
LastM-2: *******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;
LastT-2: *******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;*******;
TBI-2: -2; -2; -2; -2; -2; -2; -2; -2; -2; -2; -2; -2; -2; -2; -2; -2; -2;

ResetPeriod+Cost Parmeters:
comsuption columns []
lastCostTimeBin : ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ;
costAtLastCostBracket : ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ;
lastResetBin : ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ;
lastDay : ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ;
valueAtStartOfCostBin : ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ;
currentCostTimeBin : ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ;
lastCostBinWithData : ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ;
valueAtStartOfTimeBin : ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ;
testDayHour : ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ; ;
1; 2; 3; 4; 5; 6; 7; 8; 9; 10; 11; 12; 13; 14; 15; 16; 17;

I do notice that time on the day.dat.formatted file is 2:34 PM today when I reloaded the plugin, but the time on the day/dat file is the current time.

I also notice that the sqlFix.log that is dated when I reloaded the plugin shows that many records were removed due to duplicate IDs, for instance:

input /Users/grwilde/indigo/INDIGOplotD/sql/56777626-outdoorTemperature_F.sqlout
output /Users/grwilde/indigo/INDIGOplotD/sql/56777626-outdoorTemperature_F
starting at id: 123991
last id written: 126154
read/written: 2163/ 2162; Val OK: 2163 records; removed .. due to duplicate IDs: 0; date: 0; noValue: 0; sameDate&Value:

I hope this helps in isolating my problem.

George Wilde

Posted on
Thu Mar 08, 2018 11:13 pm
GRWilde offline
User avatar
Posts: 173
Joined: Nov 15, 2005
Location: Los Angeles

Re: INDIGOPlotD error creating gnu plots

My indigo_history.sqlite database had somehow become corrupted a couple of days ago and I had to start a new database. Could this be causing my problems?

George Wilde

Posted on
Thu Mar 08, 2018 11:45 pm
kw123 offline
User avatar
Posts: 8333
Joined: May 12, 2013
Location: Dallas, TX

INDIGOPlotD error creating gnu plots

Yes then you do not have data
Indigoplot reads the current sql database it then overwrites the local data files

sql Database kaput ==> no data

Strongly suggest to
Either switch to Postgres
Or at least do daily backups of the SQLite dB ( indigo utilities can do that for you)



Sent from my iPhone using Tapatalk

Posted on
Sat Mar 10, 2018 3:33 pm
GRWilde offline
User avatar
Posts: 173
Joined: Nov 15, 2005
Location: Los Angeles

Re: INDIGOPlotD error creating gnu plots

Thanks for your help. I restarted with a new SQLite dB and reset the plots. Plots look fine for the last couple of days since I reset everything.

I have experienced corrupt SQLite databases every few months - not that frequent but still annoying. I did use your indigo utilities to backup the SQLite dB, but am unfamiliar with how to restore the SQLite dB from the backup should it become corrupted again. How is that done?

George Wilde

Posted on
Sat Mar 10, 2018 5:09 pm
kw123 offline
User avatar
Posts: 8333
Joined: May 12, 2013
Location: Dallas, TX

Re: INDIGOPlotD error creating gnu plots

Stop sqllogger
Delete old sqlfile
Copy backupfile to log directory

Backup is in ~Indigo/indigoutilies


Sent from my iPhone using Tapatalk

Who is online

Users browsing this forum: No registered users and 1 guest