CumulusMX and logfiles in WXSim

[broadstairs]

Anyone here using WXSim and accessing their CMX log files? All of a sudden I think when I went to build 3215 my WXSimate crashes trying to load data from my logfiles in the data directory. I have checked that my units definitions are the same in WXSimate as they are defined in CMX.

Two questions - first has anything changed in the logfiles at that release and second anyone else having that problem?

Stuart

[mcrossley]

No changes to the log files that I am aware of in quite a while.

[broadstairs]

Mark it's strange my WXSimate local data download using the CMX logfiles has started to crash with an arithmetic overflow error and I'm sure it was after updating to 3215 it started. I changed to Weather Display logfiles and it downloads the data correctly. I'll do some more testing because this is WXSim running in Linux using Wine so there could be an issue there somewhere but it's strange that it works OK with the WD logfiles and my CMX ones work OK accessed via CMX or when I use Kate to view so they are not corrupt as far as I can tell.

Stuart

[mcrossley]

I think there are other people on the forum using WXSimate - @mapantz is one? - and no other reports of issues so far.

[broadstairs]

To eliminate running in Linux I copied the logs to my Windows 7 system and tried loading the local data in WXSimate on there but it barfs as well! I just wonder if it is confused by Linux line endings! Next thing to try!

Stuart

PS. Just tested line endings but it's not that. By removing the DEC and NOV log files I get an error saying it cannot find them which is what I'd expect. So it is opening the files but for some reason cannot correctly read them. I don't understand why they fail on Windows as well

[mcrossley]

Can you compare the Oct and Dec log files?

Maybe post them in a zip and I'll see if I can spot anything

[broadstairs]

I've had a quick look and cannot see any differences, even loaded into a spreadsheet and they both have the same number of columns when opened as a comma separated file. It is a real puzzle. I'll ask on the WXSim board on the WD forum to see if anyone there has the issue. I'll zip them up and post later in case you can spot anything.

Stuart

[broadstairs]

Mark

Here are the CMX Oct and Nov log files.

Stuart

CMXlogs.zip

[Mapantz]

All OK on mine

[broadstairs]

I have now found the spurious data in the November log file which was causing the problem. One line just after the line at 29/11/2022 10:35 there is a line containing the number 9 and nothing else

29/11/22,10:35,8.9,97,8.4,4,10,1,0.0,2.2,1019.6,439.0,20.0,62,5,8.0,8.9,0.0,172,0.02,535.78,7.2,207,0.7,2,0.0,2.2,8.0,8.9
9
29/11/22,10:36,8.9,97,8.4,4,10,1,0.0,2.2,1019.6,439.0,20.0,62,3,8.0,8.9,1.0,183,0.02,535.78,7.2,208,0.7,293,0.0,2.2,8.0,8.9

I just duplicated the first line shown here and the log files load in WXSimate no problem!

So how did this happen?

Stuart

[mcrossley]

No way of telling I'm afraid.

I'd suspect it happened during a shutdown perhaps.

[broadstairs]

Mark I've just checked the log and it was not at a shutdown! I've attached the log file here.

Stuart

20221129-101000.zip

[mcrossley]

Really no idea then, was the file ever opened by something other than CMX?
It is between valid log entries, normally if you get corruption by CMX it is when the process is stopped during the construction and writing an entry. Normally it is characterised by lots of null characters being written.

[broadstairs]

To be honest Mark this is a test system trialling WXSim under wine with CMX in Mono. Somehow I doubt anything else opened it other than WXSimate which I believe only opens files for read as they are often opened by the weather station software. Also I've suggested to Tom that he attempts to bypass this kind of error as it should not completely crash his program, be better to chuck out an error message saying which file is suspect.

Stuart