Page 1 of 1

Monthly Rainfall Record at March rollover

Posted: Fri 04 Mar 2016 4:58 pm
by mcrossley
Steve,

I just noticed that a new rainfall record for March was recorded on the 1st during the midnight rollover. MX had been running since the 27th Feb, but at the end of month rollover this happened...

2016-03-01 00:00:00.552 New monthly record, month = 3: 2016-03-01 00:00 87.800 "Highest monthly rainfall" 2015-03-31 00:00 75.200

Most odd, I have removed it from monthlyalltime.ini, but is there an explanation?

Running build 3037

Code: Select all

2016-02-29 23:55:00.334 Writing log entry for 29/02/2016 23:55:00
2016-02-29 23:55:00.338 Written log entry for 29/02/2016 23:55:00
2016-02-29 23:55:00.363 Writing today.ini, LastUpdateTime = 29/02/2016 23:55:00 raindaystart = 181.8 rain counter = 183.2
2016-02-29 23:55:00.369 INSERT IGNORE INTO fulldata (LogDateTime,Temp,Humidity,Dewpoint,Windspeed,Windgust,Windbearing,RainRate,TodayRainSoFar,Pressure,Raincounter,InsideTemp,InsideHumidity,LatestWindGust,WindChill,HeatIndex,UVindex,SolarRad,Evapotrans,AnnualEvapTran,ApparentTemp,MaxSolarRad,HrsSunShine,CurrWindBearing,RG11rain,RainSinceMidnight,WindbearingSym,CurrWindBearingSym) Values('16-02-29 23:55',3.9,94,3.0,11.0,24.0,193,0.0,1.4,1015.88,183.2,18.3,48,9.0,0.0,3.9,0.0,0,0.97,37.29,-1.1,0,0.1,223,0.0,1.4,'SSW','SW')
2016-02-29 23:55:00.393 MySQL: 1 rows were affected.
2016-02-29 23:55:00.865 WU Response: OK: success

2016-03-01 00:00:00.426 Hour changed:0
2016-03-01 00:00:00.427 Calculating sunrise and sunset times
2016-03-01 00:00:00.429 Sunrise: 06:55:39
2016-03-01 00:00:00.430 Sunset : 17:47:54
2016-03-01 00:00:00.432 Tomorrow sunrise: 06:53:19
2016-03-01 00:00:00.433 Tomorrow sunset : 17:49:47
2016-03-01 00:00:00.446 Midnight rain reset, count = 183.2 time = 00:00
2016-03-01 00:00:00.447 === Day reset, today = 1
2016-03-01 00:00:00.448 === Day reset for 29/02/2016 00:00:00
2016-03-01 00:00:00.451 Dayfile.txt entry:
2016-03-01 00:00:00.451 29/02/16,28.0,166,23:57,-2.6,02:39,6.1,15:24,1015.88,23:53,1028.41,00:00,1.0,21:31,1.4,2.3,106.6,12.0,23:56,70,13:19,95,07:38,0.97,0.1,6.1,15:24,2.7,11:48,-5.0,02:39,0.8,21:32,-2.6,02:39,3.0,23:51,-3.5,02:39,194,13.2,0.0,334,11:44,2.0,11:36
2016-03-01 00:00:00.452 Dayfile.txt opened for writing
2016-03-01 00:00:00.453 Writing entry to dayfile.txt
2016-03-01 00:00:00.547 INSERT IGNORE INTO daydata (LogDate,HighWindGust,HWindGBear,THWindG,MinTemp,TMinTemp,MaxTemp,TMaxTemp,MinPress,TMinPress,MaxPress,TMaxPress,MaxRainRate,TMaxRR,TotRainFall,AvgTemp,TotWindRun,HighAvgWSpeed,THAvgWSpeed,LowHum,TLowHum,HighHum,THighHum,TotalEvap,HoursSun,HighHeatInd,THighHeatInd,HighAppTemp,THighAppTemp,LowAppTemp,TLowAppTemp,HighHourRain,THighHourRain,LowWindChill,TLowWindChill,HighDewPoint,THighDewPoint,LowDewPoint,TLowDewPoint,DomWindDir,HeatDegDays,CoolDegDays,HighSolarRad,THighSolarRad,HighUV,THighUV,HWindGBearSym,DomWindDirSym) Values('16-02-29',28.0,166,'23:57',-2.6,'02:39',6.1,'15:24',1015.88,'23:53',1028.41,'00:00',1.0,'21:31',1.4,2.3,106.6,12.0,'23:56',70,'13:19',95,'07:38',0.97,0.1,6.1,'15:24',2.7,'11:48',-5.0,'02:39',0.8,'21:32',-2.6,'02:39',3.0,'23:51',-3.5,'02:39',194,13.2,0.0,334,'11:44',2.0,'11:36','SSE','SSW')
2016-03-01 00:00:00.552 New monthly record, month = 3: 2016-03-01 00:00 87.800 "Highest monthly rainfall" 2015-03-31 00:00 75.200
2016-03-01 00:00:21.633 MySQL: 1 rows were affected.
2016-03-01 00:00:21.634 Raincounter = 183.2 Raindaystart = 181.8
2016-03-01 00:00:21.634 Rainyesterday (calibrated) set to 1.40000000000001
2016-03-01 00:00:21.635 RainDayThreshold = -1
2016-03-01 00:00:21.635 rdt1000=200 ry1000=1400
2016-03-01 00:00:21.636 Yesterday was a rain day
2016-03-01 00:00:21.637 Consecutive rain days = 1
2016-03-01 00:00:21.638  New month starting - 3
2016-03-01 00:00:21.657 Saving month.ini file as data/month201602.ini
2016-03-01 00:00:21.659 Raindaystart set to 183.2
2016-03-01 00:00:21.661 StartofdayET set to 37.338
2016-03-01 00:00:21.680 Writing today.ini, LastUpdateTime = 29/02/2016 23:55:00 raindaystart = 183.2 rain counter = 183.2
2016-03-01 00:00:21.684 Writing yesterday.ini
2016-03-01 00:00:21.701 Written yesterday.ini
2016-03-01 00:00:21.702 Creating NOAA monthly report for 29 February 2016
2016-03-01 00:00:23.531 Duplicate entry at line 2227 of dayfile.txt: 16/02/16. Please correct this by editing the file
2016-03-01 00:00:30.575 Saving monthly report as Reports/NOAAMO0216.txt
2016-03-01 00:00:30.579 Creating NOAA yearly report
2016-03-01 00:00:37.248 Reading reception stats
2016-03-01 00:00:45.127 Saving yearly report as Reports/NOAAYR2016.txt
2016-03-01 00:00:45.131 NOAA reports will be uploaded at next web update
2016-03-01 00:00:45.133 Executing daily program: EndOfDayTasks.sh params: >/dev/null 2>&1
2016-03-01 00:00:45.158 === Day reset complete
2016-03-01 00:00:45.166 Now recording data for day=1 month=3 year=2016
2016-03-01 00:00:45.166 Reset sunshine hours, yesterday = 0.05
2016-03-01 00:00:45.167 Writing yesterday.ini
2016-03-01 00:00:45.251 Written yesterday.ini
2016-03-01 00:00:45.335 Writing log entry for 01/03/2016 00:00:45
2016-03-01 00:00:45.339 Written log entry for 01/03/2016 00:00:45
2016-03-01 00:00:45.416 Writing today.ini, LastUpdateTime = 01/03/2016 00:00:45 raindaystart = 183.2 rain counter = 183.2
2016-03-01 00:00:45.453 Creating backup folder backup/daily/20160301000045/
2016-03-01 00:00:45.551 Created backup folder backup/daily/20160301000045/
2016-03-01 00:00:45.554 INSERT IGNORE INTO fulldata (LogDateTime,Temp,Humidity,Dewpoint,Windspeed,Windgust,Windbearing,RainRate,TodayRainSoFar,Pressure,Raincounter,InsideTemp,InsideHumidity,LatestWindGust,WindChill,HeatIndex,UVindex,SolarRad,Evapotrans,AnnualEvapTran,ApparentTemp,MaxSolarRad,HrsSunShine,CurrWindBearing,RG11rain,RainSinceMidnight,WindbearingSym,CurrWindBearingSym) Values('16-03-01 00:00',3.9,94,3.0,12.0,28.0,187,0.0,0.0,1015.85,183.2,18.2,48,8.0,-0.2,3.9,0.0,0,0.00,37.34,-1.4,0,0.0,185,0.0,0.0,'S','S')
2016-03-01 00:00:45.577 MySQL: 1 rows were affected.
2016-03-01 00:00:48.891 WU Response: OK: success

2016-03-01 00:00:52.252 Uploading NOAA reports
2016-03-01 00:05:00.591 Writing log entry for 01/03/2016 00:05:00
2016-03-01 00:05:00.594 Written log entry for 01/03/2016 00:05:00
2016-03-01 00:05:00.648 Writing today.ini, LastUpdateTime = 01/03/2016 00:05:00 raindaystart = 183.2 rain counter = 183.2
2016-03-01 00:05:00.662 INSERT IGNORE INTO fulldata (LogDateTime,Temp,Humidity,Dewpoint,Windspeed,Windgust,Windbearing,RainRate,TodayRainSoFar,Pressure,Raincounter,InsideTemp,InsideHumidity,LatestWindGust,WindChill,HeatIndex,UVindex,SolarRad,Evapotrans,AnnualEvapTran,ApparentTemp,MaxSolarRad,HrsSunShine,CurrWindBearing,RG11rain,RainSinceMidnight,WindbearingSym,CurrWindBearingSym) Values('16-03-01 00:05',4.0,94,3.1,11.0,28.0,191,0.0,0.0,1015.71,183.2,18.2,48,10.0,0.1,4.0,0.0,0,0.00,37.34,-0.9,0,0.0,221,0.0,0.0,'S','SW')
2016-03-01 00:05:00.692 MySQL: 1 rows were affected.
2016-03-01 00:05:01.133 WU Response: OK: success

Re: Monthly Rainfall Record at March rollover

Posted: Fri 04 Mar 2016 5:04 pm
by steve
Mine's the same. I don't know whether this a new bug in 3037, or whether it's always been there and it depends on the previous month's total and the existing record (i.e. the February total beat the existing March record - that's what happened in my case). It looks like a timing issue where a new reading arrives just after midnight but before it's reset the rain counters. I'll investigate.

Re: Monthly Rainfall Record at March rollover

Posted: Fri 04 Mar 2016 5:20 pm
by steve
I think there was a similar problem to this reported a while ago, and I was working on changes to fix the problem, but I think I hadn't finished the changes (and had forgotten about them) when I decided to release build 3037.

Re: Monthly Rainfall Record at March rollover

Posted: Sat 05 Mar 2016 2:20 pm
by freddie
steve wrote:I think there was a similar problem to this reported a while ago, and I was working on changes to fix the problem, but I think I hadn't finished the changes (and had forgotten about them) when I decided to release build 3037.
I think it may have been me. See https://cumulus.hosiene.co.uk/viewtopic.php?f=27&t=14798

Re: Monthly Rainfall Record at March rollover

Posted: Sat 05 Mar 2016 2:22 pm
by freddie
Mark: did you spot this?
mcrossley wrote:

Code: Select all

2016-03-01 00:00:23.531 Duplicate entry at line 2227 of dayfile.txt: 16/02/16. Please correct this by editing the file

Re: Monthly Rainfall Record at March rollover

Posted: Sat 05 Mar 2016 2:30 pm
by mcrossley
No I didn't, I'll get that fixed, thanks.

Re: Monthly Rainfall Record at March rollover

Posted: Sat 05 Mar 2016 2:53 pm
by steve
freddie wrote:I think it may have been me. See https://cumulus.hosiene.co.uk/viewtopic.php?f=27&t=14798
Ah yes, and this now proves my theory.

Re: Monthly Rainfall Record at March rollover

Posted: Sat 05 Mar 2016 3:16 pm
by steve
I was just about to reset my March record from the entry in the diags file, but the old record was from last year, and was clearly also a result of the same bug! I guess at some point I should put my data into Cumulus 1 and get it to re-calculate the correct figure, but I'm not sure I can be bothered given that I have quite a lot of errors in my data logs anyway due to sensor failures, amongst other things.

I do have a working anemometer again, for the time being at least.

Re: Monthly Rainfall Record at March rollover

Posted: Sat 05 Mar 2016 5:12 pm
by mcrossley
steve wrote: I do have a working anemometer again, for the time being at least.
Good news, much wrong with it?

Re: Monthly Rainfall Record at March rollover

Posted: Sat 05 Mar 2016 5:35 pm
by steve
mcrossley wrote: much wrong with it?
Yes, it was broken :lol:

I have borrowed a replacement.