Data Errors

[Grimers]

Hi Steve,

I've just been battling for nearly 2 hours with this and it's too late to keep going.

Anyway, earlier on this evening MX stopped receiving data so my graphs "flat lined".

So, I stop Cumulus and try to get it to reload the data several times from different dates/times by editing the today.ini file and all I got was lots of innacurate data and graph spikes etc. So, now I have just a "good ish" backup of earlier this evening but there's still problems in the data.

Please could you have a look at the data and see what's going on and tell me what I have to do to get it correct again?

Many thanks!

[steve]

Editing today.ini will just cause more problems. The correct way to recover is to stop Cumulus and copy into the data folder all of the files from one of the Cumulus backup folders - the latest one just before the problem occurred, either one of the daily backups or one of the backups taken when Cumulus starts. The folder names are timestamps in the form 'YYYYMMDDhhmmss'.

[Grimers]

Thanks, Steve.

I tried your fix but it hasn't worked. And there's no data from midnight today for some reason. You can check my website if you like.

EDIT: I think MX thinks that midnight on the 7th is midnight today?

EDIT: Ok, the data is fine but for some reason I have no data from midnight?

[steve]

You have probably hit the problem mentioned in the known issues - "Processing of Davis archive data can stop after day rollover". Restarting MX should make it continue from the point that it stopped.

[Grimers]

You have probably hit the problem mentioned in the known issues - "Processing of Davis archive data can stop after day rollover". Restarting MX should make it continue from the point that it stopped.

Ah, thanks Steve. You're a legend.

I actually shut Cumulus down and edited the today.ini file to make it download the data again and it seems to be working great so far.

Thanks a lot!

[Grimers]

Hi Steve,

There's more problems this evening that I've manage to correct, however looking at a local weather site, he's also using Cumulus MX and got the flat line today so something's wrong in the program somewhere.

For some reason, my longest wet period is only 5 days up to the 6th February even though it rained yesterday?

[steve]

If you zip up the MXdiags folder and attach it, I'll take a look.

[Grimers]

Hi Steve,

I edited the longest wet period value myself last night.

Please find attached MXdiags.zip.

[steve]

The current count of the consecutive rain days presumably got reset by whatever it was you did to today.ini when you should have been copying the backup files, or just starting Cumulus again as I suggested. The diags files don't go back far enough to see what happened. You will probably need to edit today.ini again (with MX stopped) to set your Consecutive Rain Days figure - it's currently showing as 2 on your web site.

I can see no sign of any issues with reading data in the diags files, so I don't know what those "more problems" are that you alluded to. There are no exceptions, which might have resulted in the data reading loop stopping, and no 'data stopped' messages, so no sign of anything that would have caused graphs to flat-line.

It looks like you need to correct your Weatherbug ID:

2016-02-08 22:37:19.332 Weatherbug Response: OK: Not a valid Station ID. Must be of the form 'p#####'.

[Grimers]

The current count of the consecutive rain days presumably got reset by whatever it was you did to today.ini when you should have been copying the backup files, or just starting Cumulus again as I suggested. The diags files don't go back far enough to see what happened. You will probably need to edit today.ini again (with MX stopped) to set your Consecutive Rain Days figure - it's currently showing as 2 on your web site.

I can see no sign of any issues with reading data in the diags files, so I don't know what those "more problems" are that you alluded to. There are no exceptions, which might have resulted in the data reading loop stopping, and no 'data stopped' messages, so no sign of anything that would have caused graphs to flat-line.

Well, I'm confused. Because I didn't even touch anything related to MX when it flat lined so something must have happened in MX or in the data logger to break it.

I have edited the today.ini file and everything seems to be ok. I presume that because the 1st February was the last dry day, it has been 7 days as that's not been recounted today for some reason? e.g. On my Today page it says 6 days to 07 February not 7 days to 08 February.

Also, I'd just like to add that I DID copy the backup files and I didn't mess around with the today.ini file and I didn't change my Weatherbug ID.

[steve]

Well, I'm confused. Because I didn't even touch anything related to MX when it flat lined so something must have happened in MX or in the data logger to break it.

I'm not talking about your original problem, I have no idea what caused that. I am talking about the "more problems" that you posted about today. I can see no evidence in the diags file that you uploaded of any "more problems".

I have edited the today.ini file and everything seems to be ok. I presume that because the 1st February was the last dry day, it has been 7 days as that's not been recounted today for some reason? e.g. On my Today page it says 6 days to 07 February not 7 days to 08 February.

No it doesn't, your Today page says: "Days Since Last Dry Day: 7" which is correct if Feb 1st was your last dry day (as today isn't included)

Also, I'd just like to add that I DID copy the backup files and I didn't mess around with the today.ini file

You posted (at 0906 yesterday) that you did edit today.ini

and I didn't change my Weatherbug ID.

Well whoever configured those settings, they're wrong.

[Grimers]

Well, I'm confused. Because I didn't even touch anything related to MX when it flat lined so something must have happened in MX or in the data logger to break it.

I'm not talking about your original problem, I have no idea what caused that. I am talking about the "more problems" that you posted about today. I can see no evidence in the diags file that you uploaded of any "more problems".

I have edited the today.ini file and everything seems to be ok. I presume that because the 1st February was the last dry day, it has been 7 days as that's not been recounted today for some reason? e.g. On my Today page it says 6 days to 07 February not 7 days to 08 February.

No it doesn't, your Today page says: "Days Since Last Dry Day: 7" which is correct if Feb 1st was your last dry day (as today isn't included)

Also, I'd just like to add that I DID copy the backup files and I didn't mess around with the today.ini file

You posted (at 0906 yesterday) that you did edit today.ini

and I didn't change my Weatherbug ID.

Well whoever configured those settings, they're wrong.

Yes, I've edited the today.ini file again to change the value but before it wasn't correct for some reason, again it wasn't explained as to why it didn't change. I cannot remember editing the today.ini file, sorry about that. I must've edited it for either the rainfall error or to redownload the data again off the data logger. Re the Weatherbug ID, I have just checked and I put in my Weather Underground ID by accident in there.

So, what I'd really like to know is why the longest wet period was wrong before I edited it and why it didn't change on the day rollover today when we had rain yesterday?