Daily Temp & Daily Rain charts failure

[RHards]

My web page http://www.rhards.co.uk/WeatherMX/trends.htm worked perfectly adequately for my purposes up until a couple of weeks ago.

Daily Temp and Daily Rain charts seemed to get stuck displaying only one days results (6 March IIRC), daily displaying fewer and fewer days records.

Now they're effectively blank (although Daily Temp seems to have some artefact on the left of where the date axis should be).

Running on a Pi Zero W

I'd be very grateful for any helpful pointers.

Thanks,
Richard

[freddie]

Very likely a problem in your dayfile.txt. But you should post your MXDiags file here for checking so we can be sure.

[RHards]

Thanks Freddie,

I have 10 TXT files in the MXdiags folder on my Pi, dating back to 14 March. Should I attach all of them or just the most recent?

FWIW, I've not had either Debug logging or Data logging checked in Dashboard options. Should I check them now?

[freddie]

Start with the most recent and see if it flags any errors. If not then switch on debug, let it run for a while and then post the file.

[RHards]

Here's the most recent.

Out of interest, how come the file size seems to vary as much as it does, if they are generally logging the same things? Most are around 80KB but this, and one (of two) from yesterday are 20KB.

[freddie]

A new file is created each time you restart Cumulus. So the size of the file will depend on the amount of time between restarts.

[water01]

Code: Select all

2020-03-22 03:00:05.790 Error uploading /home/pi/CumulusMX/web/moonphasetagT.txttmp to WeatherMX/moonphasetag.php : Can't open that file: No such file or directory
2020-03-22 03:00:32.928 Error uploading web/dailyrain.json to /dailyrain.json : Timed out trying to read data from the socket stream!

Looks like you have an invalid file path in your Extra Web Files are which is causing the failure of the dailyrain.json file.

It should be moonphasetagT.txt without the tmp on the end.

The other possibility is that you have the correct name but there is a zero length file on your server for moonphasetag.php. FTP in CumulusMX seems to have a problem with overwriting zero length files, so delete it from the server with FileZilla or your FTP tool of choice.

Code: Select all

2020-03-22 08:09:17.897 Error uploading realtime.txt to realtime.txt : Timed out trying to read data from the socket stream!

Other files are failing to load because of this error although the interesting thing is this failure is nearly 9 minutes after the moonphase failure. Maybe the failure is because the first failure is leaving an FTP socket open which fails a later upload. I know that Mark Crossley said he had spotted a few problems with the resilience of the FTP and was looking to improve it in a later build.

In the meantime fix the moonphase upload problem and it should fix the other failures.

Plus what Freddie found below (missed that!!).

[freddie]

There is an error showing in the diags file:

Code: Select all

GetRainfallTotals: Error on line 222 of dayfile.txt: Input string was not in the correct format

So whatever day is on line 222 contains an error. This can occur if Cumulus isn't shut down correctly - for example, if there is a power cut.

[RHards]

Thanks David and Freddie,

I think that seems to have fixed the issues.

Intriguingly, the two daily charts seem to have repopulated themselves this morning (earlier, about 2AM, couldn't sleep) there was just an entry in each for yesterday, but now…

If I'm honest, I'm not entirely sure which particular action sorted it out. While I was connected, I took the opportunity to have a bit of a general tidy up. Curiously, the moonphasetag file extensions hadn't been changed by me since I was trying to get it going when I first set it up last July, and it's worked perfectly (other than the moonphase indicator) until 6 March. I'll probably have another go now, I think I'll have a bit of time on my hands!

I edited Dayfile.txt in notepad, so I'm not precisely aware of the line number, but in about the right place was one line with spaces in front of it roughly equal to the total line length of the average other lines. I deleted all the spaces, and that's where we are now. I should have made a note of the date, but I seem to recall it was late in February, rather the 6 March.

Thanks again, and stay healthy everyone,
Richard

[freddie]

I edited Dayfile.txt in notepad, so I'm not precisely aware of the line number, but in about the right place was one line with spaces in front of it roughly equal to the total line length of the average other lines. I deleted all the spaces, and that's where we are now. I should have made a note of the date, but I seem to recall it was late in February, rather the 6 March.

As an aside, I would download a more feature-rich text editor such as Notepad++ for future editing of Cumulus data files. From your description, it seems as if MX was shut down in an uncontrolled way (i.e. power failure) at some point which resulted in this data file corruption.

Good to hear things are working a bit better now.

Stay safe.