Force Cumulus to re-read the data logger

[Feek]

Is there any way to force Cumulus to re-read the data from the logger?

I have a few hours of flatlined data but as far as I'm aware, my FO console will still have the data stored but it wasn't picked up after a reboot.

Can I force Cumulus to reload todays data from the logger?

Thanks

[steve]

The easiest way to do that is to 'rewind' by copying the files from a backup folder, as mentioned in the readme.txt. A backup (they should probably really be called 'checkpoints') is created each time Cumulus starts, so depending on how often you stop/start Cumulus, you may have to go back quite a way. A not quite so convenient alternative is to manually remove the latest entries from the log files and edit the 'timestamp' in today.ini.

Looking at your graphs, it looks like you run Cumulus 24/7, so you may not want to go back as far as the latest backup. So you could remove the data in Mar12log.txt back as far as about 0100, and set the timestamp in today.ini to that time, and when you start Cumulus it should download the required missing data.

[Feek]

Looking at your graphs, it looks like you run Cumulus 24/7, so you may not want to go back as far as the latest backup. So you could remove the data in Mar12log.txt back as far as about 0100, and set the timestamp in today.ini to that time, and when you start Cumulus it should download the required missing data.

That worked perfectly, thanks Steve.

[njc]

Steve, Is there a way to download archive data from beyond the current day and have Cumulus MX process it? I've been struggling with this all morning and I have made some progress, but not 100%.

Here's what happened, around 10:30pm last night I reset my wireless AP, this caused Cumulus MX to no longer communicate with my VP2, and was storing the same data every 5m (I have now set RestartIfDataStops=1 since restarting Cumulus MX seemed to fix the comms).

So I found this and many other threads and was able to get the archive data downloaded. The remaining issue was the rainfall total for the day went to 0 on all new data from the station (not the archive). Also, I found that dayfile.txt had multiple entries for yesterday (2/24), the latest of which was really data for today. So I'm trying to go back to yesterday at midnight (~36hrs ago) and have Cumulus download and process the data for yesterday and today so that all the data is correct. I'm having trouble now getting Cumulus MX to download archive data for yesterday, yet I was able to do it earlier. I have backed up all files that I have edited so I can go back.

Any thoughts on how to properly do this?

Thanks,
Nick

[steve]

The correct way to do it is as described above - choose a backup folder and copy all of the files from it to the data folder, and then start Cumulus. If you have multiple dayfile.txt entries and incorrect daily rainfall, it sounds like you haven't done that. What exactly did you do?

Are you actually using Cumulus MX, or Cumulus 1? This is the Cumulus 1 section of the forum.

[njc]

I'm using Cumulus MX but this is the only place I found these details so I thought it appropriate to post here.

I think I may have it straightened out. I had to manually go through the dayfile.txt and combine the multiple rows for yesterday. It seems like there was a row for up until 22:30, then there was a row from that point onward, but it contained data points for today also (like highest temp said 53 at 07:00 but that's today's data not yesterday).

Basically I got everything consistent up to midnight this morning in both dayfile and the mmmddlog.txt, set today.ini timestamp to today at 00:00, and started Cumulus MX. It pulled the archive from the station and I think everything is ok. A couple of follow up questions for you:

--Is data is dayfile.txt written after the day is over? I notice I do not have data in there for today's date.
--Is "Daily Rain" on the charts the rain for the calendar day, last 24hr, or the span of the graph? It seems to not be calendar day...

Nick

P.S. Thanks for this awesome software! The customization ability and features are awesome. I have customized the web pages quite a bit too (thanks to Mark Crossley and Gerrit Grunwald for those). I also use the scheduled HTTP with webtags to hit a page on my server which updates my SQL db..

[njc]

I may have spoke too soon. Most things seem ok, but yesterday.ini is not correct. It has zeros for everything. I could manually edit it but is there a way for the program to process it?

Thanks,
Nick

[steve]

I'm using Cumulus MX but this is the only place I found these details so I thought it appropriate to post here.

Please keep posts about MX in the MX section, I am easily confused.

set today.ini timestamp to today at 00:00, and started Cumulus MX.

This is the cause of your problems. Editing the timestamp in today.ini will cause all kinds of problems with the data, e.g duplicate entries in dayfile.txt

Is data is dayfile.txt written after the day is over?

Yes

Is "Daily Rain" on the charts the rain for the calendar day, last 24hr, or the span of the graph? It seems to not be calendar day...

It's for the meteorlogical day that you have set. If it's not correct, then it's likely to be a result of the problems you have caused by editing today.ini. If you have corrected dayfile.txt, then restarting MX will cause the daily totals for the graph to be re-read from there.

[steve]

I may have spoke too soon. Most things seem ok, but yesterday.ini is not correct. It has zeros for everything. I could manually edit it but is there a way for the program to process it?

Another result of editing today.ini. Cumulus only writes to it at the start of a new day, so if you want it changing you'll need to edit it.

[njc]

Thanks, Steve. I only edited today.ini because of the instructions on this thread in order to force a re-download of the archive data. Would there have been a better way?

Sorry for posting in the wrong thread/section. I believe this issue would apply to both versions however.

[steve]

I only edited today.ini because of the instructions on this thread in order to force a re-download of the archive data. Would there have been a better way?

Yes, the better way would have been to have done as in my first post in this thread, as I suggested in my first reply to you. Use the files from a backup folder, or alternatively, but much less simply, edit today.ini and manually restore the data files to the same point.