Archive not being read

[freddie]

I had a web server FTP issue overnight which caused a big slowdown on my MX server. I stopped MX, resolved the web server FTP issue, and copied the data files from the previous daily backup to the data directory. I then restarted MX expecting it to download archive data since the previous daily backup (09:00 UTC on 24/10/2016). This is not happening. Excerpt from MXdiags file:

Code: Select all

2016-10-25 11:49:45.197  ========================== Cumulus MX starting ==========================
2016-10-25 11:49:45.202 Command line: /home/install/CumulusMX/CumulusMX.exe
2016-10-25 11:49:45.202 Cumulus MX v.3.0.0 build 3041
2016-10-25 11:49:45.204 Platform: Unix
2016-10-25 11:49:45.204 OS version: Unix 4.4.0.45
2016-10-25 11:49:45.204 Current culture: English (United Kingdom)
2016-10-25 11:49:45.204 Directory separator=/ Decimal separator=. List separator=,
2016-10-25 11:49:45.204 Date separator=/ Time separator=:
2016-10-25 11:49:45.204 Standard time zone name:   UTC
2016-10-25 11:49:45.204 Daylight saving time name:
2016-10-25 11:49:45.204 Daylight saving time? False
2016-10-25 11:49:45.204 25/10/2016 11:49:45
2016-10-25 11:49:45.205 Data path = data/
2016-10-25 11:49:45.249 Creating backup folder backup/20161025114945/
2016-10-25 11:49:45.262 Created backup folder backup/20161025114945/
2016-10-25 11:49:45.286 Reading Cumulus.ini file
2016-10-25 11:49:45.295 ASM=10 AST=00:10:00
2016-10-25 11:49:45.296 Cumulus start date: 03 July 2014
2016-10-25 11:49:45.302 Debug logging is enabled
2016-10-25 11:49:45.302 Data logging is enabled
2016-10-25 11:49:45.302 Logging interval = 1
2016-10-25 11:49:45.444 Calculating sunrise and sunset times
2016-10-25 11:49:45.450 Sunrise: 06:56:00
2016-10-25 11:49:45.450 Sunset : 16:54:19
2016-10-25 11:49:45.450 Tomorrow sunrise: 06:57:51
2016-10-25 11:49:45.450 Tomorrow sunset : 16:52:15
2016-10-25 11:49:45.450 Tomorrow length diff: -235
2016-10-25 11:49:45.461 Station type: Davis Vantage Pro2
2016-10-25 11:49:45.461 WindUnit=kts RainUnit=mm TempUnit=°C PressureUnit=hPa
2016-10-25 11:49:45.462 YTDRain=0.000 Year=0
2016-10-25 11:49:45.462 RainDayThreshold=-1.000
2016-10-25 11:49:45.462 Offsets and Multipliers:
2016-10-25 11:49:45.462 PO=0.000 TO=0.000 HO=0 WDO=0 ITO=0.000 UVO=0.000
2016-10-25 11:49:45.462 WSM=1.250 WGM=1.000 TM=1.000 TM2=1.000 HM=1.000 RM=1.000 UVM=1.000
2016-10-25 11:49:45.462 Spike removal:
2016-10-25 11:49:45.462 TD=999.000 GD=999.000 WD=999.000 HD=999.000 PD=999.000
2016-10-25 11:49:45.462 MR=999.000 MH=999.000
2016-10-25 11:49:45.462 Cumulus Starting
2016-10-25 11:49:45.463 Opening station
2016-10-25 11:49:45.481 Last update time from today.ini: 24/10/2016 09:00:00
2016-10-25 11:49:45.481 Read today file: Date = 24/10/2016, LastUpdateTime = 24/10/2016 09:00:00, Month = 10
2016-10-25 11:49:45.482 ReadTodayfile: set notraininit false
2016-10-25 11:49:45.488 /home/install/CumulusMX/data/alltime.ini
2016-10-25 11:49:45.490 Alltime.ini file read
2016-10-25 11:49:45.504 MonthlyAlltime.ini file read
2016-10-25 11:49:45.508 Month.ini file read
2016-10-25 11:49:45.528 Year.ini file read
2016-10-25 11:49:45.530 Finding raintoday from logfile data/Oct16log.txt
2016-10-25 11:49:45.530 Expecting listsep=, decimal=.
2016-10-25 11:49:46.946 Midnight rain found in the following entry:
2016-10-25 11:49:46.946 24/10/16,00:00,5.0,96,4.4,0.0,0.0,0,0.0,0.2,1013.24,535.8,19.7,55,0.0,5.0,5.0,0.0,0,0.00,0.00,3.8,0,0.0,0,0.0,0.0
2016-10-25 11:49:46.969 Setting raintoday from logfile = 0
2016-10-25 11:49:46.969 Calculating rain counter = 535.8
2016-10-25 11:49:46.969 Midnight rain found = 535.8
2016-10-25 11:49:46.971 Getting rain totals, rain season start = 1
2016-10-25 11:49:46.971 Today = 25/10/16
2016-10-25 11:49:47.039 Rainthismonth from dayfile.txt: 17.4
2016-10-25 11:49:47.039 Rainthisyear from dayfile.txt: 539.6
2016-10-25 11:49:47.041 Station type = Davis
2016-10-25 11:49:47.042 LOOP2 enabled
2016-10-25 11:49:47.042 Serial device = /dev/ttyUSB0
2016-10-25 11:49:47.062 Connected OK
2016-10-25 11:49:47.065 Reading firmware version
2016-10-25 11:49:47.873 0A-0D-4F-4B-0A-0D-33-2E-31-35-0A-0D-00-00-00-00-00-00-00-00
2016-10-25 11:49:47.873 FW version = 3.15
2016-10-25 11:49:47.874 Last update time = 24/10/2016 09:00:00
2016-10-25 11:49:47.877 Setting console time
2016-10-25 11:49:47.978 Wait for ACK...
2016-10-25 11:49:48.016 ACK received
2016-10-25 11:49:48.018 Wait for ACK...
2016-10-25 11:49:48.025 ACK received
2016-10-25 11:49:48.028 Reading console time
2016-10-25 11:49:49.433 31-31-0B-19-0A-74-3F-3F
2016-10-25 11:49:49.433 Console clock: 25/10/2016 11:49:49
2016-10-25 11:49:49.433 Start reading archive data
2016-10-25 11:49:49.435 Reading archive data
2016-10-25 11:49:49.435 Loading last N hour data from data logs: 24/10/2016 09:00:00
2016-10-25 11:49:50.913 Loaded 61 entries to last hour data list
2016-10-25 11:49:52.422 Loaded 181 entries to last 3 hour data list
2016-10-25 11:49:53.946 Loaded 4321 entries to graph data list
2016-10-25 11:49:55.934 Loaded 10081 entries to recent data list
2016-10-25 11:49:55.999 Loaded 89 entries to daily data list
2016-10-25 11:49:56.025 Get Archive Data
2016-10-25 11:49:56.026 Rollover hour = 9
2016-10-25 11:49:56.026 Last Archive Date: 24/10/2016 09:00:00
2016-10-25 11:49:56.026 Date: 8536
2016-10-25 11:49:56.026 Time: 900
2016-10-25 11:49:56.103 629 web tags initialised
2016-10-25 11:49:56.109 HTML root path = /home/install/CumulusMX/interface
2016-10-25 11:49:56.127 Sending DMPAFT
2016-10-25 11:49:56.135 Received response to DMPAFT, sending date and time
2016-10-25 11:49:56.135 58-21-84-03-A6-31
2016-10-25 11:49:56.135 Wait for ACK...
2016-10-25 11:49:56.184 Starting web socket server on port 8002
2016-10-25 11:49:57.139 Updating highs and lows
2016-10-25 11:49:57.144 Day reset required
2016-10-25 11:49:57.145 Start normal reading loop
2016-10-25 11:49:57.159 === Day reset, today = 25
2016-10-25 11:49:57.159 === Day reset for 24/10/2016 00:00:00
2016-10-25 11:49:57.169 Dayfile.txt entry:
2016-10-25 11:49:57.169 24/10/16,0.0,0,09:00,6.6,09:00,6.6,09:00,1014.26,09:00,1014.26,09:00,0.0,09:00,0.0,6.6,0.0,0.0,09:00,94,09:00,94,09:00,0.00,0.0,6.6,09:00,5.6,09:00,5.6,09:00,0.0,09:00,6.6,09:00,5.7,09:00,5.7,09:00,0,0.0,0.0,0,09:00,0.0,09:00
2016-10-25 11:49:57.169 Dayfile.txt opened for writing
2016-10-25 11:49:57.169 Writing entry to dayfile.txt
2016-10-25 11:49:57.170 Raincounter = 535.8 Raindaystart = 535.8
2016-10-25 11:49:57.170 Rainyesterday (calibrated) set to 0
2016-10-25 11:49:57.171 RainDayThreshold = -1
2016-10-25 11:49:57.171 rdt1000=200 ry1000=0
2016-10-25 11:49:57.171 Yesterday was a dry day
2016-10-25 11:49:57.171 Consecutive dry days = 1
2016-10-25 11:49:57.173 New monthly record, month = 10: 2016-10-24 09:00 6.556 "Lowest maximum temp" 2016-10-23 14:41 10.833
2016-10-25 11:49:57.199 New monthly record, month = 10: 2016-10-24 11:49 0.000 "Low daily temp range" 2014-10-14 09:00 1.700
2016-10-25 11:49:57.213 Raindaystart set to 535.8
2016-10-25 11:49:57.213 StartofdayET set to 0
2016-10-25 11:49:57.218 Writing today.ini, LastUpdateTime = 24/10/2016 09:00:00 raindaystart = 535.8 rain counter = 535.8
2016-10-25 11:49:57.221 Writing yesterday.ini
2016-10-25 11:49:57.222 Written yesterday.ini
2016-10-25 11:49:57.222 === Day reset complete
2016-10-25 11:49:57.223 Now recording data for day=25 month=10 year=2016
2016-10-25 11:49:57.223 Midnight rain reset, count = 535.8 time = 11:49
2016-10-25 11:49:57.224 Reset sunshine hours, yesterday = 0
2016-10-25 11:49:57.224 Writing yesterday.ini
2016-10-25 11:49:57.225 Written yesterday.ini
2016-10-25 11:49:57.232 Start Timers
2016-10-25 11:49:57.232 Starting 1-minute timer
2016-10-25 11:49:57.235 Attempting realtime FTP connect
2016-10-25 11:49:57.447 Sending command LPS 2 1 - pass 1
2016-10-25 11:49:57.541 Starting Realtime timer, interval = 2 seconds
2016-10-25 11:49:57.541 Wundlist count is zero
2016-10-25 11:49:57.541 MySqlList count is zero
2016-10-25 11:49:57.948 Wait for ACK
2016-10-25 11:49:57.954 Loop2: 4C-4F-4F-00-01-FF-7F-04-76-96-02-38-08-02-01-FF-45-00-08-00-04-00-04-00-43-00-FF-7F-FF-7F-31-00-FF-5A-FF-34-00-34-00-FF-00-00-00-FF-FF-7F-00-00-FF-FF-00-00-00-00-00-00-00-00-00-00-02-00-00-17-00-92-74-92-74-FD-75-FF-01-0D-0C-05-13-0D-15-01-03-02-02-FF-7F-FF-7F-FF-7F-FF-7F-FF-7F-FF-7F-0A-0D-95-F1
2016-10-25 11:49:57.965 10-min gust from loop2: 3.5
2016-10-25 11:49:57.965 Using 10-min gust from loop2
2016-10-25 11:49:58.067 Sending command LOOP 50 - pass 1
2016-10-25 11:49:58.568 Wait for ACK
2016-10-25 11:49:58.581 Data 1: 4C-4F-4F-00-00-D8-02-04-76-96-02-38-08-02-01-01-45-00-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-5A-FF-FF-FF-FF-FF-FF-FF-00-00-FF-FF-7F-00-00-FF-FF-00-00-61-00-77-0A-00-00-00-00-00-00-FF-FF-FF-FF-FF-FF-FF-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-F8-02-06-2C-90-02-76-06-0A-0D-C6-D0
2016-10-25 11:49:58.612 Data 2: 4C-4F-4F-00-00-D8-02-04-76-96-02-38-08-02-01-01-45-00-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-5A-FF-FF-FF-FF-FF-FF-FF-00-00-FF-FF-7F-00-00-FF-FF-00-00-61-00-77-0A-00-00-00-00-00-00-FF-FF-FF-FF-FF-FF-FF-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-F8-02-06-2C-90-02-76-06-0A-0D-C6-D0
2016-10-25 11:49:58.814 Data 3: 4C-4F-4F-00-00-D8-02-04-76-96-02-38-08-02-01-01-45-00-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-5A-FF-FF-FF-FF-FF-FF-FF-00-00-FF-FF-7F-00-00-FF-FF-00-00-61-00-77-0A-00-00-00-00-00-00-FF-FF-FF-FF-FF-FF-FF-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-F8-02-06-2C-90-02-76-06-0A-0D-C6-D0
2016-10-25 11:50:00.282 Writing log entry for 25/10/2016 11:50:00
2016-10-25 11:50:00.282 max gust: 3.5
2016-10-25 11:50:00.283 Written log entry for 25/10/2016 11:50:00
2016-10-25 11:50:00.284 Writing today.ini, LastUpdateTime = 25/10/2016 11:50:00 raindaystart = 535.8 rain counter = 535.8
2016-10-25 11:50:00.304 Creating backup folder backup/daily/20161025115000/
2016-10-25 11:50:00.314 Created backup folder backup/daily/20161025115000/
2016-10-25 11:50:00.339 http://data.awekas.at/eingabe_pruefung.php?val=freddie;<password>;25.10.2016;11:50;11.1;90;1023.1;0.0;1.2;69;;;;en;0;6.4;;;;;;0.0;Cum_3.0.0;;;0.0;5.6;11.1;0.8;;18.6;-3.7;;32.9;0;;90;53;;100;35;;100;0.0;;1023.1;1002.6;;1031.2;973.7;;1036.2;;;1.2;;;28.9;;;46.6;;;6.4;;;46.7;;;85.3;;;;0.0;17.4;539.6;;0.0;;12.4;;145.8;;0.0;;;;;0.0;;;;;;;;;;;;;;;;;;;;;
2016-10-25 11:50:00.534 http://api.weathercloud.net/v01/set?wid=e1deffbe805e6e0c&key=<key>&tempin=190&temp=111&chill=111&dew=95&heat=111&humin=56&hum=90&wspd=4&wspdhi=18&wspdavg=3&wdir=69&wdiravg=69&bar=10231&rain=0&rainrate=0&time=1150&date=20161025&type=291&ver=3.0.0
2016-10-25 11:50:00.541 http://www.pwsweather.com/pwsupdate/pwsupdate.php?ID=IPONTESB2&PASSWORD=****************&dateutc=2016-10-25+11%3A50%3A00&winddir=69&windspeedmph=0.7&windgustmph=4.0&humidity=90&tempf=52.0&rainin=0.00&dailyrainin=0.00&baromin=30.215&dewptf=49.2&softwaretype=Cumulus%20v3.0.0&action=updateraw
2016-10-25 11:50:00.549 http://wow.metoffice.gov.uk/automaticreading?siteid=883096001&siteAuthenticationKey=******&dateutc=2016-10-25+11%3A50%3A00&winddir=69&windspeedmph=0.7&windgustmph=4.0&humidity=90&tempf=52.0&rainin=0.00&dailyrainin=0.00&baromin=30.215&dewptf=49.2&softwaretype=Cumulus%20v3.0.0&action=updateraw
2016-10-25 11:50:00.818 Data 4: 4C-4F-4F-00-00-D9-02-04-76-96-02-38-08-02-01-01-45-00-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-5A-FF-FF-FF-FF-FF-FF-FF-00-00-FF-FF-7F-00-00-FF-FF-00-00-61-00-77-0A-00-00-00-00-00-00-FF-FF-FF-FF-FF-FF-FF-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-F8-02-06-2C-90-02-76-06-0A-0D-E9-D9
2016-10-25 11:50:00.961 Awekas Response: OK: OK
2016-10-25 11:50:00.985 PWS Response: OK:
<html>
<head>
   <title>PWS Weather Station Update</title>
</head>
<body>
Data Logged and posted in METAR mirror.

</body>
</html>
2016-10-25 11:50:01.579 WOW Response: OK: {}
2016-10-25 11:50:02.056 WeatherCloud Response: OK: 200
2016-10-25 11:50:03.825 Data 5: 4C-4F-4F-00-00-D9-02-03-76-96-02-38-07-02-01-01-45-00-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-5A-FF-FF-FF-FF-FF-FF-FF-00-00-FF-FF-7F-00-00-FF-FF-00-00-61-00-77-0A-00-00-00-00-00-00-FF-FF-FF-FF-FF-FF-FF-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-F8-02-06-2C-90-02-76-06-0A-0D-4A-22
2016-10-25 11:50:04.628 Data 6: 4C-4F-4F-00-00-D9-02-03-76-96-02-38-07-02-01-01-45-00-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-5A-FF-FF-FF-FF-FF-FF-FF-00-00-FF-FF-7F-00-00-FF-FF-00-00-61-00-77-0A-00-00-00-00-00-00-FF-FF-FF-FF-FF-FF-FF-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-F8-02-06-2C-90-02-76-06-0A-0D-4A-22
2016-10-25 11:50:06.636 Data 7: 4C-4F-4F-00-00-D9-02-03-76-96-02-38-07-02-02-01-47-00-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-5A-FF-FF-FF-FF-FF-FF-FF-00-00-FF-FF-7F-00-00-FF-FF-00-00-61-00-77-0A-00-00-00-00-00-00-FF-FF-FF-FF-FF-FF-FF-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-F8-02-06-2C-90-02-76-06-0A-0D-41-11
2016-10-25 11:50:08.641 Data 8: 4C-4F-4F-00-00-D9-02-03-76-96-02-38-07-02-02-01-47-00-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-5A-FF-FF-FF-FF-FF-FF-FF-00-00-FF-FF-7F-00-00-FF-FF-00-00-61-00-77-0A-00-00-00-00-00-00-FF-FF-FF-FF-FF-FF-FF-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-F8-02-06-2C-90-02-76-06-0A-0D-41-11
2016-10-25 11:50:10.645 Data 9: 4C-4F-4F-00-00-D9-02-03-76-96-02-38-07-02-00-01-47-00-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-5A-FF-FF-FF-FF-FF-FF-FF-00-00-FF-FF-7F-00-00-FF-FF-00-00-61-00-77-0A-00-00-00-00-00-00-FF-FF-FF-FF-FF-FF-FF-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-F8-02-06-2C-90-02-76-06-0A-0D-8C-CA
2016-10-25 11:50:12.650 Data 10: 4C-4F-4F-00-00-D9-02-03-76-96-02-38-07-02-01-01-47-00-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-5A-FF-FF-FF-FF-FF-FF-FF-00-00-FF-FF-7F-00-00-FF-FF-00-00-61-00-77-0A-00-00-00-00-00-00-FF-FF-FF-FF-FF-FF-FF-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-F8-02-06-2C-90-02-76-06-0A-0D-62-37
2016-10-25 11:50:14.658 Data 11: 4C-4F-4F-00-00-D9-02-03-76-96-02-38-07-02-00-01-47-00-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-5A-FF-FF-FF-FF-FF-FF-FF-00-00-FF-FF-7F-00-00-FF-FF-00-00-61-00-77-0A-00-00-00-00-00-00-FF-FF-FF-FF-FF-FF-FF-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-F8-02-06-2C-90-02-76-06-0A-0D-8C-CA

Is there something I haven't done? I have performed this procedure many times before, so didn't think I was missing out anything. Any ideas?

MX version 3.0.0 build 3041 running on Ubuntu 16.04 (kernel 4.4.0.45), serial connection to Davis VP2 running firmware version 3.15.

[steve]

It looks like some kind of error occurred in the system code when MX tried to read the ACK after sending the date and time for the archive download, as the archive downloading thread was terminated silently. Normally, what would happen is that MX would print a message indicating successful reading of the ACK or otherwise, or if an exception occurred, the exception message would appear in the diags file and/or on the command line. None of these occurred, so apparently the system killed the thread. It's possible there is some information in the system logs.

Did you just try this the once?

I've added some more exception trapping to the archive download thread (although that's unlikely to have any effect as an exception apparently isn't being thrown) and some diagnostic messages if the thread terminates with an error.

[freddie]

It's possible there is some information in the system logs.

Unfortunately there isn't.

Did you just try this the once?

No, I tried it four times before posting this.

I've added some more exception trapping to the archive download thread (although that's unlikely to have any effect as an exception apparently isn't being thrown) and some diagnostic messages if the thread terminates with an error.

Okay, but I guess that won't be available before my archive gets overwritten

I think I'll give it another few goes before giving up. Thanks for taking the time to reply.

[freddie]

I think I'll give it another few goes before giving up.

Same result again

Code: Select all

2016-10-25 20:10:51.040 Reading console time
2016-10-25 20:10:52.445 34-0A-14-19-0A-74-3F-3F
2016-10-25 20:10:52.446 Console clock: 25/10/2016 20:10:52
2016-10-25 20:10:52.446 Start reading archive data
2016-10-25 20:10:52.447 Reading archive data
2016-10-25 20:10:52.448 Loading last N hour data from data logs: 24/10/2016 09:00:00
2016-10-25 20:10:53.940 Loaded 61 entries to last hour data list
2016-10-25 20:10:55.415 Loaded 181 entries to last 3 hour data list
2016-10-25 20:10:56.928 Loaded 4321 entries to graph data list
2016-10-25 20:10:58.884 Loaded 10081 entries to recent data list
2016-10-25 20:10:58.949 Loaded 89 entries to daily data list
2016-10-25 20:10:58.979 Get Archive Data
2016-10-25 20:10:58.979 Rollover hour = 9
2016-10-25 20:10:58.979 Last Archive Date: 24/10/2016 09:00:00
2016-10-25 20:10:58.979 Date: 8536
2016-10-25 20:10:58.979 Time: 900
2016-10-25 20:10:59.059 629 web tags initialised
2016-10-25 20:10:59.066 HTML root path = /home/install/CumulusMX/interface
2016-10-25 20:10:59.080 Sending DMPAFT
2016-10-25 20:10:59.089 Received response to DMPAFT, sending date and time
2016-10-25 20:10:59.089 58-21-84-03-A6-31
2016-10-25 20:10:59.089 Wait for ACK...
2016-10-25 20:10:59.143 Starting web socket server on port 8002
2016-10-25 20:11:00.093 Updating highs and lows
2016-10-25 20:11:00.097 Day reset required
2016-10-25 20:11:00.098 Start normal reading loop
2016-10-25 20:11:00.111 === Day reset, today = 25
2016-10-25 20:11:00.111 === Day reset for 24/10/2016 00:00:00
2016-10-25 20:11:00.121 Dayfile.txt entry:
2016-10-25 20:11:00.121 24/10/16,0.0,0,09:00,6.6,09:00,6.6,09:00,1014.26,09:00,1014.26,09:00,0.0,09:00,0.0,6.6,0.0,0.0,09:00,94,09:00,94,09:00,0.00,0.0,6.6,09:00,5.6,09:00,5.6,09:00,0.0,09:00,6.6,09:00,5.7,09:00,5.7,09:00,0,0.0,0.0,0,09:00,0.0,09:00
2016-10-25 20:11:00.121 Dayfile.txt opened for writing
2016-10-25 20:11:00.121 Writing entry to dayfile.txt
2016-10-25 20:11:00.122 Raincounter = 535.8 Raindaystart = 535.8
2016-10-25 20:11:00.122 Rainyesterday (calibrated) set to 0
2016-10-25 20:11:00.123 RainDayThreshold = -1
2016-10-25 20:11:00.123 rdt1000=200 ry1000=0
2016-10-25 20:11:00.123 Yesterday was a dry day
2016-10-25 20:11:00.123 Consecutive dry days = 1
2016-10-25 20:11:00.125 New monthly record, month = 10: 2016-10-24 09:00 6.556 "Lowest maximum temp" 2016-10-23 14:41 10.833
2016-10-25 20:11:00.151 New monthly record, month = 10: 2016-10-24 20:11 0.000 "Low daily temp range" 2014-10-14 09:00 1.700
2016-10-25 20:11:00.165 Raindaystart set to 535.8
2016-10-25 20:11:00.165 StartofdayET set to 0
2016-10-25 20:11:00.170 Writing today.ini, LastUpdateTime = 24/10/2016 09:00:00 raindaystart = 535.8 rain counter = 535.8
2016-10-25 20:11:00.173 Writing yesterday.ini
2016-10-25 20:11:00.175 Written yesterday.ini
2016-10-25 20:11:00.175 === Day reset complete
2016-10-25 20:11:00.175 Now recording data for day=25 month=10 year=2016
2016-10-25 20:11:00.176 Midnight rain reset, count = 535.8 time = 20:11
2016-10-25 20:11:00.176 Reset sunshine hours, yesterday = 0
2016-10-25 20:11:00.176 Writing yesterday.ini
2016-10-25 20:11:00.177 Written yesterday.ini
2016-10-25 20:11:00.184 Start Timers
2016-10-25 20:11:00.185 Starting 1-minute timer
2016-10-25 20:11:00.187 Attempting realtime FTP connect
2016-10-25 20:11:00.481 Starting Realtime timer, interval = 2 seconds
2016-10-25 20:11:00.481 Wundlist count is zero
2016-10-25 20:11:00.482 MySqlList count is zero
2016-10-25 20:11:00.701 Sending command LPS 2 1 - pass 1
2016-10-25 20:11:01.204 Wait for ACK
2016-10-25 20:11:01.210 Loop2: 4C-4F-4F-14-01-FF-7F-24-76-A5-02-38-EE-01-00-FF-A1-00-00-00-00-00-00-00-9D-00-FF-7F-FF-7F-2F-00-FF-5C-FF-32-00-31-00-FF-00-00-00-FF-FF-7F-00-00-FF-FF-00-00-00-00-00-00-00-00-00-00-02-00-00-17-00-B2-74-B2-74-1E-76-FF-03-10-15-0E-13-0B-15-17-03-02-02-FF-7F-FF-7F-FF-7F-FF-7F-FF-7F-FF-7F-0A-0D-E2-C6
2016-10-25 20:11:01.230 10-min gust from loop2: 0.0
2016-10-25 20:11:01.331 Sending command LOOP 50 - pass 1
2016-10-25 20:11:01.831 Wait for ACK
2016-10-25 20:11:01.845 Data 1: 4C-4F-4F-14-00-CE-04-24-76-A5-02-38-EE-01-00-00-A1-00-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-5C-FF-FF-FF-FF-FF-FF-FF-00-00-FF-FF-7F-00-00-FF-FF-00-00-61-00-77-0A-00-00-00-00-00-00-FF-FF-FF-FF-FF-FF-FF-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-F7-02-06-09-92-02-76-06-0A-0D-46-F1
2016-10-25 20:11:01.873 Data 2: 4C-4F-4F-14-00-CE-04-24-76-A5-02-38-EE-01-00-00-A1-00-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-5C-FF-FF-FF-FF-FF-FF-FF-00-00-FF-FF-7F-00-00-FF-FF-00-00-61-00-77-0A-00-00-00-00-00-00-FF-FF-FF-FF-FF-FF-FF-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-F7-02-06-09-92-02-76-06-0A-0D-46-F1
2016-10-25 20:11:03.078 Data 3: 4C-4F-4F-14-00-CE-04-24-76-A5-02-38-EE-01-00-00-A1-00-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-5C-FF-FF-FF-FF-FF-FF-FF-00-00-FF-FF-7F-00-00-FF-FF-00-00-61-00-77-0A-00-00-00-00-00-00-FF-FF-FF-FF-FF-FF-FF-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-00-F7-02-06-09-92-02-76-06-0A-0D-46-F1

[freddie]

Now I've just restarted using my data files from 3-4 minutes previously and the archive data gets downloaded!

Code: Select all

2016-10-25 20:17:24.216 Sending DMPAFT
2016-10-25 20:17:24.224 Received response to DMPAFT, sending date and time
2016-10-25 20:17:24.224 59-21-D7-07-CB-ED
2016-10-25 20:17:24.225 Wait for ACK...
2016-10-25 20:17:24.250 ACK received
2016-10-25 20:17:24.250 Waiting for response
2016-10-25 20:17:24.269 Starting web socket server on port 8002
2016-10-25 20:17:24.451 Response:  03 00 01 00 A8 ED
2016-10-25 20:17:24.451 Reading data: 3 pages , offset = 1
2016-10-25 20:17:24.451 Reading archive page 0
2016-10-25 20:17:24.452 Waiting for response
2016-10-25 20:17:24.652 Reading response
2016-10-25 20:17:24.652 Data: 00-59-21-D7-07-F0-01-F0-01-EF-01-00-00-00-00-24-76-FF-7F-17-00-A5-02-38-5C-00-00-FF-FF-FF-00-FF-7F-FF-09-FF-FF-FF-FF-FF-FF-FF-FF-00-FF-FF-FF-FF-FF-FF-FF-FF-FF-59-21-D8-07-F0-01-F0-01-EF-01-00-00-00-00-24-76-FF-7F-17-00-A5-02-38-5C-00-00-FF-FF-FF-00-FF-7F-FF-09-FF-FF-FF-FF-FF-FF-FF-FF-00-FF-FF-FF-FF-FF-FF-FF-FF-FF-59-21-D9-07-EF-01-EF-01-EE-01-00-00-00-00-23-76-FF-7F-16-00-A5-02-38-5C-00-00-FF-FF-FF-00-FF-7F-FF-09-FF-FF-FF-FF-FF-FF-FF-FF-00-FF-FF-FF-FF-FF-FF-FF-FF-FF-59-21-DA-07-EF-01-EF-01-EE-01-00-00-00-00-25-76-FF-7F-17-00-A5-02-38-5C-00-00-FF-FF-FF-00-FF-7F-FF-09-FF-FF-FF-FF-FF-FF-FF-FF-00-FF-FF-FF-FF-FF-FF-FF-FF-FF-59-21-DB-07-EE-01-EE-01-EE-01-00-00-00-00-24-76-FF-7F-14-00-A5-02-38-5C-00-00-FF-FF-FF-00-FF-7F-FF-09-FF-FF-FF-FF-FF-FF-FF-FF-00-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-FF-61-F8
2016-10-25 20:17:24.656 Loaded archive record for Page=0 Record=1 Timestamp=25/10/2016 20:08:00
2016-10-25 20:17:24.656 Processing archive record for 25/10/2016 20:08:00
2016-10-25 20:17:24.679 Page=0 Record=1 Timestamp=25/10/2016 20:08:00
2016-10-25 20:17:24.684 Writing log entry for 25/10/2016 20:08:00
2016-10-25 20:17:24.684 max gust: 0.0

Some sort of overflow when the archive size is big? Although I don't recall having a problem with this before.

[steve]

It does appear to be related to having significant entries to download, but it's hard to say what's happening as the thread just terminates. It's possible that an error result is returned but currently MX just ignores the result of the thread termination.

I've certainly downloaded a reasonably large number of entries myself, after power failures.