Archive not being read
Posted: Tue 25 Oct 2016 12:01 pm
I had a web server FTP issue overnight which caused a big slowdown on my MX server. I stopped MX, resolved the web server FTP issue, and copied the data files from the previous daily backup to the data directory. I then restarted MX expecting it to download archive data since the previous daily backup (09:00 UTC on 24/10/2016). This is not happening. Excerpt from MXdiags file:
Is there something I haven't done? I have performed this procedure many times before, so didn't think I was missing out anything. Any ideas?
MX version 3.0.0 build 3041 running on Ubuntu 16.04 (kernel 4.4.0.45), serial connection to Davis VP2 running firmware version 3.15.
Code: Select all
2016-10-25 11:49:45.197 ========================== Cumulus MX starting ==========================
2016-10-25 11:49:45.202 Command line: /home/install/CumulusMX/CumulusMX.exe
2016-10-25 11:49:45.202 Cumulus MX v.3.0.0 build 3041
2016-10-25 11:49:45.204 Platform: Unix
2016-10-25 11:49:45.204 OS version: Unix 4.4.0.45
2016-10-25 11:49:45.204 Current culture: English (United Kingdom)
2016-10-25 11:49:45.204 Directory separator=/ Decimal separator=. List separator=,
2016-10-25 11:49:45.204 Date separator=/ Time separator=:
2016-10-25 11:49:45.204 Standard time zone name: UTC
2016-10-25 11:49:45.204 Daylight saving time name:
2016-10-25 11:49:45.204 Daylight saving time? False
2016-10-25 11:49:45.204 25/10/2016 11:49:45
2016-10-25 11:49:45.205 Data path = data/
2016-10-25 11:49:45.249 Creating backup folder backup/20161025114945/
2016-10-25 11:49:45.262 Created backup folder backup/20161025114945/
2016-10-25 11:49:45.286 Reading Cumulus.ini file
2016-10-25 11:49:45.295 ASM=10 AST=00:10:00
2016-10-25 11:49:45.296 Cumulus start date: 03 July 2014
2016-10-25 11:49:45.302 Debug logging is enabled
2016-10-25 11:49:45.302 Data logging is enabled
2016-10-25 11:49:45.302 Logging interval = 1
2016-10-25 11:49:45.444 Calculating sunrise and sunset times
2016-10-25 11:49:45.450 Sunrise: 06:56:00
2016-10-25 11:49:45.450 Sunset : 16:54:19
2016-10-25 11:49:45.450 Tomorrow sunrise: 06:57:51
2016-10-25 11:49:45.450 Tomorrow sunset : 16:52:15
2016-10-25 11:49:45.450 Tomorrow length diff: -235
2016-10-25 11:49:45.461 Station type: Davis Vantage Pro2
2016-10-25 11:49:45.461 WindUnit=kts RainUnit=mm TempUnit=°C PressureUnit=hPa
2016-10-25 11:49:45.462 YTDRain=0.000 Year=0
2016-10-25 11:49:45.462 RainDayThreshold=-1.000
2016-10-25 11:49:45.462 Offsets and Multipliers:
2016-10-25 11:49:45.462 PO=0.000 TO=0.000 HO=0 WDO=0 ITO=0.000 UVO=0.000
2016-10-25 11:49:45.462 WSM=1.250 WGM=1.000 TM=1.000 TM2=1.000 HM=1.000 RM=1.000 UVM=1.000
2016-10-25 11:49:45.462 Spike removal:
2016-10-25 11:49:45.462 TD=999.000 GD=999.000 WD=999.000 HD=999.000 PD=999.000
2016-10-25 11:49:45.462 MR=999.000 MH=999.000
2016-10-25 11:49:45.462 Cumulus Starting
2016-10-25 11:49:45.463 Opening station
2016-10-25 11:49:45.481 Last update time from today.ini: 24/10/2016 09:00:00
2016-10-25 11:49:45.481 Read today file: Date = 24/10/2016, LastUpdateTime = 24/10/2016 09:00:00, Month = 10
2016-10-25 11:49:45.482 ReadTodayfile: set notraininit false
2016-10-25 11:49:45.488 /home/install/CumulusMX/data/alltime.ini
2016-10-25 11:49:45.490 Alltime.ini file read
2016-10-25 11:49:45.504 MonthlyAlltime.ini file read
2016-10-25 11:49:45.508 Month.ini file read
2016-10-25 11:49:45.528 Year.ini file read
2016-10-25 11:49:45.530 Finding raintoday from logfile data/Oct16log.txt
2016-10-25 11:49:45.530 Expecting listsep=, decimal=.
2016-10-25 11:49:46.946 Midnight rain found in the following entry:
2016-10-25 11:49:46.946 24/10/16,00:00,5.0,96,4.4,0.0,0.0,0,0.0,0.2,1013.24,535.8,19.7,55,0.0,5.0,5.0,0.0,0,0.00,0.00,3.8,0,0.0,0,0.0,0.0
2016-10-25 11:49:46.969 Setting raintoday from logfile = 0
2016-10-25 11:49:46.969 Calculating rain counter = 535.8
2016-10-25 11:49:46.969 Midnight rain found = 535.8
2016-10-25 11:49:46.971 Getting rain totals, rain season start = 1
2016-10-25 11:49:46.971 Today = 25/10/16
2016-10-25 11:49:47.039 Rainthismonth from dayfile.txt: 17.4
2016-10-25 11:49:47.039 Rainthisyear from dayfile.txt: 539.6
2016-10-25 11:49:47.041 Station type = Davis
2016-10-25 11:49:47.042 LOOP2 enabled
2016-10-25 11:49:47.042 Serial device = /dev/ttyUSB0
2016-10-25 11:49:47.062 Connected OK
2016-10-25 11:49:47.065 Reading firmware version
2016-10-25 11:49:47.873 0A-0D-4F-4B-0A-0D-33-2E-31-35-0A-0D-00-00-00-00-00-00-00-00
2016-10-25 11:49:47.873 FW version = 3.15
2016-10-25 11:49:47.874 Last update time = 24/10/2016 09:00:00
2016-10-25 11:49:47.877 Setting console time
2016-10-25 11:49:47.978 Wait for ACK...
2016-10-25 11:49:48.016 ACK received
2016-10-25 11:49:48.018 Wait for ACK...
2016-10-25 11:49:48.025 ACK received
2016-10-25 11:49:48.028 Reading console time
2016-10-25 11:49:49.433 31-31-0B-19-0A-74-3F-3F
2016-10-25 11:49:49.433 Console clock: 25/10/2016 11:49:49
2016-10-25 11:49:49.433 Start reading archive data
2016-10-25 11:49:49.435 Reading archive data
2016-10-25 11:49:49.435 Loading last N hour data from data logs: 24/10/2016 09:00:00
2016-10-25 11:49:50.913 Loaded 61 entries to last hour data list
2016-10-25 11:49:52.422 Loaded 181 entries to last 3 hour data list
2016-10-25 11:49:53.946 Loaded 4321 entries to graph data list
2016-10-25 11:49:55.934 Loaded 10081 entries to recent data list
2016-10-25 11:49:55.999 Loaded 89 entries to daily data list
2016-10-25 11:49:56.025 Get Archive Data
2016-10-25 11:49:56.026 Rollover hour = 9
2016-10-25 11:49:56.026 Last Archive Date: 24/10/2016 09:00:00
2016-10-25 11:49:56.026 Date: 8536
2016-10-25 11:49:56.026 Time: 900
2016-10-25 11:49:56.103 629 web tags initialised
2016-10-25 11:49:56.109 HTML root path = /home/install/CumulusMX/interface
2016-10-25 11:49:56.127 Sending DMPAFT
2016-10-25 11:49:56.135 Received response to DMPAFT, sending date and time
2016-10-25 11:49:56.135 58-21-84-03-A6-31
2016-10-25 11:49:56.135 Wait for ACK...
2016-10-25 11:49:56.184 Starting web socket server on port 8002
2016-10-25 11:49:57.139 Updating highs and lows
2016-10-25 11:49:57.144 Day reset required
2016-10-25 11:49:57.145 Start normal reading loop
2016-10-25 11:49:57.159 === Day reset, today = 25
2016-10-25 11:49:57.159 === Day reset for 24/10/2016 00:00:00
2016-10-25 11:49:57.169 Dayfile.txt entry:
2016-10-25 11:49:57.169 24/10/16,0.0,0,09:00,6.6,09:00,6.6,09:00,1014.26,09:00,1014.26,09:00,0.0,09:00,0.0,6.6,0.0,0.0,09:00,94,09:00,94,09:00,0.00,0.0,6.6,09:00,5.6,09:00,5.6,09:00,0.0,09:00,6.6,09:00,5.7,09:00,5.7,09:00,0,0.0,0.0,0,09:00,0.0,09:00
2016-10-25 11:49:57.169 Dayfile.txt opened for writing
2016-10-25 11:49:57.169 Writing entry to dayfile.txt
2016-10-25 11:49:57.170 Raincounter = 535.8 Raindaystart = 535.8
2016-10-25 11:49:57.170 Rainyesterday (calibrated) set to 0
2016-10-25 11:49:57.171 RainDayThreshold = -1
2016-10-25 11:49:57.171 rdt1000=200 ry1000=0
2016-10-25 11:49:57.171 Yesterday was a dry day
2016-10-25 11:49:57.171 Consecutive dry days = 1
2016-10-25 11:49:57.173 New monthly record, month = 10: 2016-10-24 09:00 6.556 "Lowest maximum temp" 2016-10-23 14:41 10.833
2016-10-25 11:49:57.199 New monthly record, month = 10: 2016-10-24 11:49 0.000 "Low daily temp range" 2014-10-14 09:00 1.700
2016-10-25 11:49:57.213 Raindaystart set to 535.8
2016-10-25 11:49:57.213 StartofdayET set to 0
2016-10-25 11:49:57.218 Writing today.ini, LastUpdateTime = 24/10/2016 09:00:00 raindaystart = 535.8 rain counter = 535.8
2016-10-25 11:49:57.221 Writing yesterday.ini
2016-10-25 11:49:57.222 Written yesterday.ini
2016-10-25 11:49:57.222 === Day reset complete
2016-10-25 11:49:57.223 Now recording data for day=25 month=10 year=2016
2016-10-25 11:49:57.223 Midnight rain reset, count = 535.8 time = 11:49
2016-10-25 11:49:57.224 Reset sunshine hours, yesterday = 0
2016-10-25 11:49:57.224 Writing yesterday.ini
2016-10-25 11:49:57.225 Written yesterday.ini
2016-10-25 11:49:57.232 Start Timers
2016-10-25 11:49:57.232 Starting 1-minute timer
2016-10-25 11:49:57.235 Attempting realtime FTP connect
2016-10-25 11:49:57.447 Sending command LPS 2 1 - pass 1
2016-10-25 11:49:57.541 Starting Realtime timer, interval = 2 seconds
2016-10-25 11:49:57.541 Wundlist count is zero
2016-10-25 11:49:57.541 MySqlList count is zero
2016-10-25 11:49:57.948 Wait for ACK
2016-10-25 11:49:57.954 Loop2: 4C-4F-4F-00-01-FF-7F-04-76-96-02-38-08-02-01-FF-45-00-08-00-04-00-04-00-43-00-FF-7F-FF-7F-31-00-FF-5A-FF-34-00-34-00-FF-00-00-00-FF-FF-7F-00-00-FF-FF-00-00-00-00-00-00-00-00-00-00-02-00-00-17-00-92-74-92-74-FD-75-FF-01-0D-0C-05-13-0D-15-01-03-02-02-FF-7F-FF-7F-FF-7F-FF-7F-FF-7F-FF-7F-0A-0D-95-F1
2016-10-25 11:49:57.965 10-min gust from loop2: 3.5
2016-10-25 11:49:57.965 Using 10-min gust from loop2
2016-10-25 11:49:58.067 Sending command LOOP 50 - pass 1
2016-10-25 11:49:58.568 Wait for ACK
2016-10-25 11:49:58.581 Data 1: 4C-4F-4F-00-00-D8-02-04-76-96-02-38-08-02-01-01-45-00-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-5A-FF-FF-FF-FF-FF-FF-FF-00-00-FF-FF-7F-00-00-FF-FF-00-00-61-00-77-0A-00-00-00-00-00-00-FF-FF-FF-FF-FF-FF-FF-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-F8-02-06-2C-90-02-76-06-0A-0D-C6-D0
2016-10-25 11:49:58.612 Data 2: 4C-4F-4F-00-00-D8-02-04-76-96-02-38-08-02-01-01-45-00-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-5A-FF-FF-FF-FF-FF-FF-FF-00-00-FF-FF-7F-00-00-FF-FF-00-00-61-00-77-0A-00-00-00-00-00-00-FF-FF-FF-FF-FF-FF-FF-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-F8-02-06-2C-90-02-76-06-0A-0D-C6-D0
2016-10-25 11:49:58.814 Data 3: 4C-4F-4F-00-00-D8-02-04-76-96-02-38-08-02-01-01-45-00-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-5A-FF-FF-FF-FF-FF-FF-FF-00-00-FF-FF-7F-00-00-FF-FF-00-00-61-00-77-0A-00-00-00-00-00-00-FF-FF-FF-FF-FF-FF-FF-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-F8-02-06-2C-90-02-76-06-0A-0D-C6-D0
2016-10-25 11:50:00.282 Writing log entry for 25/10/2016 11:50:00
2016-10-25 11:50:00.282 max gust: 3.5
2016-10-25 11:50:00.283 Written log entry for 25/10/2016 11:50:00
2016-10-25 11:50:00.284 Writing today.ini, LastUpdateTime = 25/10/2016 11:50:00 raindaystart = 535.8 rain counter = 535.8
2016-10-25 11:50:00.304 Creating backup folder backup/daily/20161025115000/
2016-10-25 11:50:00.314 Created backup folder backup/daily/20161025115000/
2016-10-25 11:50:00.339 http://data.awekas.at/eingabe_pruefung.php?val=freddie;<password>;25.10.2016;11:50;11.1;90;1023.1;0.0;1.2;69;;;;en;0;6.4;;;;;;0.0;Cum_3.0.0;;;0.0;5.6;11.1;0.8;;18.6;-3.7;;32.9;0;;90;53;;100;35;;100;0.0;;1023.1;1002.6;;1031.2;973.7;;1036.2;;;1.2;;;28.9;;;46.6;;;6.4;;;46.7;;;85.3;;;;0.0;17.4;539.6;;0.0;;12.4;;145.8;;0.0;;;;;0.0;;;;;;;;;;;;;;;;;;;;;
2016-10-25 11:50:00.534 http://api.weathercloud.net/v01/set?wid=e1deffbe805e6e0c&key=<key>&tempin=190&temp=111&chill=111&dew=95&heat=111&humin=56&hum=90&wspd=4&wspdhi=18&wspdavg=3&wdir=69&wdiravg=69&bar=10231&rain=0&rainrate=0&time=1150&date=20161025&type=291&ver=3.0.0
2016-10-25 11:50:00.541 http://www.pwsweather.com/pwsupdate/pwsupdate.php?ID=IPONTESB2&PASSWORD=****************&dateutc=2016-10-25+11%3A50%3A00&winddir=69&windspeedmph=0.7&windgustmph=4.0&humidity=90&tempf=52.0&rainin=0.00&dailyrainin=0.00&baromin=30.215&dewptf=49.2&softwaretype=Cumulus%20v3.0.0&action=updateraw
2016-10-25 11:50:00.549 http://wow.metoffice.gov.uk/automaticreading?siteid=883096001&siteAuthenticationKey=******&dateutc=2016-10-25+11%3A50%3A00&winddir=69&windspeedmph=0.7&windgustmph=4.0&humidity=90&tempf=52.0&rainin=0.00&dailyrainin=0.00&baromin=30.215&dewptf=49.2&softwaretype=Cumulus%20v3.0.0&action=updateraw
2016-10-25 11:50:00.818 Data 4: 4C-4F-4F-00-00-D9-02-04-76-96-02-38-08-02-01-01-45-00-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-5A-FF-FF-FF-FF-FF-FF-FF-00-00-FF-FF-7F-00-00-FF-FF-00-00-61-00-77-0A-00-00-00-00-00-00-FF-FF-FF-FF-FF-FF-FF-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-F8-02-06-2C-90-02-76-06-0A-0D-E9-D9
2016-10-25 11:50:00.961 Awekas Response: OK: OK
2016-10-25 11:50:00.985 PWS Response: OK:
<html>
<head>
<title>PWS Weather Station Update</title>
</head>
<body>
Data Logged and posted in METAR mirror.
</body>
</html>
2016-10-25 11:50:01.579 WOW Response: OK: {}
2016-10-25 11:50:02.056 WeatherCloud Response: OK: 200
2016-10-25 11:50:03.825 Data 5: 4C-4F-4F-00-00-D9-02-03-76-96-02-38-07-02-01-01-45-00-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-5A-FF-FF-FF-FF-FF-FF-FF-00-00-FF-FF-7F-00-00-FF-FF-00-00-61-00-77-0A-00-00-00-00-00-00-FF-FF-FF-FF-FF-FF-FF-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-F8-02-06-2C-90-02-76-06-0A-0D-4A-22
2016-10-25 11:50:04.628 Data 6: 4C-4F-4F-00-00-D9-02-03-76-96-02-38-07-02-01-01-45-00-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-5A-FF-FF-FF-FF-FF-FF-FF-00-00-FF-FF-7F-00-00-FF-FF-00-00-61-00-77-0A-00-00-00-00-00-00-FF-FF-FF-FF-FF-FF-FF-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-F8-02-06-2C-90-02-76-06-0A-0D-4A-22
2016-10-25 11:50:06.636 Data 7: 4C-4F-4F-00-00-D9-02-03-76-96-02-38-07-02-02-01-47-00-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-5A-FF-FF-FF-FF-FF-FF-FF-00-00-FF-FF-7F-00-00-FF-FF-00-00-61-00-77-0A-00-00-00-00-00-00-FF-FF-FF-FF-FF-FF-FF-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-F8-02-06-2C-90-02-76-06-0A-0D-41-11
2016-10-25 11:50:08.641 Data 8: 4C-4F-4F-00-00-D9-02-03-76-96-02-38-07-02-02-01-47-00-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-5A-FF-FF-FF-FF-FF-FF-FF-00-00-FF-FF-7F-00-00-FF-FF-00-00-61-00-77-0A-00-00-00-00-00-00-FF-FF-FF-FF-FF-FF-FF-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-F8-02-06-2C-90-02-76-06-0A-0D-41-11
2016-10-25 11:50:10.645 Data 9: 4C-4F-4F-00-00-D9-02-03-76-96-02-38-07-02-00-01-47-00-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-5A-FF-FF-FF-FF-FF-FF-FF-00-00-FF-FF-7F-00-00-FF-FF-00-00-61-00-77-0A-00-00-00-00-00-00-FF-FF-FF-FF-FF-FF-FF-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-F8-02-06-2C-90-02-76-06-0A-0D-8C-CA
2016-10-25 11:50:12.650 Data 10: 4C-4F-4F-00-00-D9-02-03-76-96-02-38-07-02-01-01-47-00-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-5A-FF-FF-FF-FF-FF-FF-FF-00-00-FF-FF-7F-00-00-FF-FF-00-00-61-00-77-0A-00-00-00-00-00-00-FF-FF-FF-FF-FF-FF-FF-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-F8-02-06-2C-90-02-76-06-0A-0D-62-37
2016-10-25 11:50:14.658 Data 11: 4C-4F-4F-00-00-D9-02-03-76-96-02-38-07-02-00-01-47-00-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-5A-FF-FF-FF-FF-FF-FF-FF-00-00-FF-FF-7F-00-00-FF-FF-00-00-61-00-77-0A-00-00-00-00-00-00-FF-FF-FF-FF-FF-FF-FF-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-F8-02-06-2C-90-02-76-06-0A-0D-8C-CA
MX version 3.0.0 build 3041 running on Ubuntu 16.04 (kernel 4.4.0.45), serial connection to Davis VP2 running firmware version 3.15.