Correcting Errors in the logs

[thekow]

Hey there i was messing around with my sensors and obviously i triggered my rain sensors. Is there i way i can set those records back to 0? Which files would i need to update to make sure everything is accurate. I says it was a record day so a few files would have been updated.

[water01]

My first port of call would be the Edit menu in Cumulus, you can change most incorrect readings there.

[Matt.j5b]

All records for all time, monthly, this month, this year can be edited from the edit menu if you either fetch the correct readings from the log file or the dayfile ( in the Cumulus data folder) once you have corrected the log file or dayfile or type in the correct readings into the editor. The dayfile can be edited with the dayfile editor under edit. The log file (December 2012 is Dec12log) is edited either when opened in a text editor or use Cumulus toolbox as it loads the file into the table making it much easier to edit. You can also look at the alltimelog in the Cumulus data folder if it broke an all time record to see what the figures was before the new record. Under edit, Today's rain you can edit today rain but it does not change the all time, this month, this year and the log file used for the graphs for example, it only adjusts the rain total for today if it is wrong.

It also may have affected your current wet/dry spell so that is edited in the today.ini file in the Cumulus data folder under ConsecutiveRainDays and ConsecutiveDryDays. If this happened before today you need to edit the dayfile and if it happened yesterday you may wish to edit the Yesterday total under rain in the yesterday.ini file but that figure will disappear tomorrow when a new yesterday is created.

Details on the log file and dayfile format and the edit menu are in the help file in Cumulus under "Data log file format" ,under "The Displays" is "The Records (Highs and Lows) Editors" and "The Dayfile.txt Editor".

[thekow]

OK thanks guys.

[jandrew]

My set up updates the log files (eg Dec12log.txt) every minute.
I suppose that that is a bit over the top and not everybody will do it.
But it occurs to me that with that amount of archive detail it should be easy to write a short program which will recreate all the other log files.
Just delete them all (or just move them to a safe location) then run the program.
There might be a need for the program to do some calculations (eg degree days) and it might churn away for a while. But it should be easier to amend incorrect readings in one place only - ie the Dec12log.txt file.

jandrew

[steve]

But it should be easier to amend incorrect readings in one place only - ie the Dec12log.txt file.

Generally, that's all you need to do anyway. Cumulus can recreate all (just about) of the other data from that one file. It's a few clicks rather than just the one, but it doesn't take very long to do.

[Intheswamp]

I know this thread is a little dated but figured my questions fall inline with it.

Yesterday we got a good rain but I found out his morning that my VP2 rain gauge was clogged up with trash...that little Davis screen is about useless isn't it?

Anyhow, I've viewed my jun13log.txt file and have found where some of the rain was logged. It looks like with each data transmission from the ISS that each total rain amount is logged. For example, there may be five log entries for .01" of rain and then when the tipper tips again it will change to .02" and there will be several log entries with that amount of rain. As more rain falls this logged amount continues to change...ever increasing but with several entries for each total amount. A question I have is how do I edit the log to show the correct rainfall amount? After the last log entry that shows rainfall, do I simply enter the total correct amount of rain in the next log entry and call it "good"? Is it that simple?

The tip-off to my problem came when I saw where Cumulus/VP2 had recorded .02" of rain this morning (it hadn't rained)...it was water that had seeped through the clog. So, I guess where it's showing this erroneous .02" I can simply go in and zero it out?

Also, once I get the Cumulus data edited do I need to edit anything in the VP2 console?

Thanks,
Ed

[Intheswamp]

Well, I had some time tonight to look over the log file and after studying over it I finally understood something. The rain did not last as long of a time as what was logged. At 5:20pm the first recorded rain was logged... .09". After that rainwater managed to seep through the blockage at a rate of .01" every hour or two until .15" was recorded. Then, before the roll-over, the seeping stopped, the roll-over cleared the daily rainfall total and all was well again until the water started seeping through the clog again this morning. Interesting, but basically useless information.

Well, I may just clear all my data and start from scratch as someone has recommended that I do. I've got three weeks of data right now with about 3" of rain and a few highs that are interesting, but nothing that says "don't get rid of this!".

Ed

Code: Select all

17/06/13,17:20,74.7,90,71.6,7.0,14.0,330,0.34,0.09,29.985,2.65,77.1,57,3.0,74.7,74.7,0.0,0,0.000,0.000,79.2,423,0.0,14,0.00,0.09
17/06/13,17:30,72.2,92,69.7,7.0,15.0,324,0.11,0.11,29.983,2.67,77.2,57,5.0,72.2,72.2,0.0,0,0.000,0.000,75.8,384,0.0,334,0.00,0.11
17/06/13,17:40,71.2,93,69.1,5.0,15.0,333,0.05,0.11,29.990,2.67,77.3,57,3.0,71.2,71.2,0.0,0,0.000,0.000,75.6,345,0.0,258,0.00,0.11
17/06/13,17:50,70.7,95,69.2,2.0,5.0,204,0.00,0.11,29.973,2.67,77.3,57,4.0,70.7,70.7,0.0,0,0.000,0.000,76.8,306,0.0,161,0.00,0.11
17/06/13,18:00,70.5,96,69.3,2.0,5.0,55,0.00,0.12,29.980,2.68,77.4,57,2.0,70.5,70.5,0.0,0,0.000,0.000,76.7,267,0.0,81,0.00,0.12
17/06/13,18:10,70.5,97,69.6,1.0,3.0,105,0.00,0.12,29.984,2.68,77.4,57,1.0,70.5,70.5,0.0,0,0.000,0.000,77.4,229,0.0,102,0.00,0.12
17/06/13,18:20,70.3,97,69.4,0.0,2.0,102,0.00,0.12,29.978,2.68,77.4,57,0.0,70.3,70.3,0.0,0,0.000,0.000,77.6,191,0.0,102,0.00,0.12
17/06/13,18:30,70.0,96,68.8,1.0,4.0,108,0.00,0.13,29.965,2.69,77.5,58,1.0,70.0,70.0,0.0,0,0.000,0.000,76.5,155,0.0,116,0.00,0.13
17/06/13,18:40,69.9,97,69.0,1.0,4.0,108,0.00,0.13,29.948,2.69,77.5,58,2.0,69.9,69.9,0.0,0,0.000,0.000,76.5,120,0.0,142,0.00,0.13
17/06/13,18:50,70.0,97,69.1,2.0,4.0,194,0.00,0.13,29.958,2.69,77.6,58,1.0,70.0,70.0,0.0,0,0.000,0.000,76.1,88,0.0,327,0.00,0.13
17/06/13,19:00,70.0,98,69.4,1.0,2.0,315,0.00,0.13,29.954,2.69,77.6,58,2.0,70.0,70.0,0.0,0,0.000,0.000,76.8,59,0.0,46,0.00,0.13
17/06/13,19:10,70.0,98,69.4,1.0,2.0,33,0.00,0.13,29.953,2.69,77.7,58,0.0,70.0,70.0,0.0,0,0.000,0.000,76.8,34,0.0,12,0.00,0.13
17/06/13,19:20,69.9,98,69.3,1.0,2.0,106,0.00,0.13,29.949,2.69,77.7,58,0.0,69.9,69.9,0.0,0,0.000,0.000,76.6,15,0.0,180,0.00,0.13
17/06/13,19:30,69.9,98,69.3,1.0,3.0,148,0.00,0.13,29.954,2.69,77.8,58,0.0,69.9,69.9,0.0,0,0.000,0.000,76.6,4,0.0,115,0.00,0.13
17/06/13,19:40,69.9,98,69.3,0.0,1.0,115,0.00,0.14,29.957,2.70,77.8,58,0.0,69.9,69.9,0.0,0,0.000,0.000,77.2,0,0.0,115,0.00,0.14
17/06/13,19:50,70.0,98,69.4,1.0,2.0,127,0.00,0.14,29.955,2.70,77.9,58,0.0,70.0,70.0,0.0,0,0.000,0.000,76.8,0,0.0,146,0.00,0.14
17/06/13,20:00,70.0,98,69.4,1.0,2.0,145,0.00,0.14,29.951,2.70,77.9,58,1.0,70.0,70.0,0.0,0,0.000,0.000,76.8,0,0.0,147,0.00,0.14
17/06/13,20:10,70.0,98,69.4,2.0,4.0,182,0.00,0.14,29.949,2.70,77.9,59,2.0,70.0,70.0,0.0,0,0.000,0.000,76.2,0,0.0,182,0.00,0.14
17/06/13,20:20,70.0,98,69.4,1.0,3.0,140,0.00,0.14,29.946,2.70,78.0,59,1.0,70.0,70.0,0.0,0,0.000,0.000,76.8,0,0.0,41,0.00,0.14
17/06/13,20:30,70.0,98,69.4,0.0,2.0,43,0.00,0.14,29.951,2.70,77.6,56,1.0,70.0,70.0,0.0,0,0.000,0.000,77.3,0,0.0,71,0.00,0.14
17/06/13,20:40,70.0,98,69.4,1.0,4.0,159,0.00,0.14,29.959,2.70,76.0,53,1.0,70.0,70.0,0.0,0,0.000,0.000,76.8,0,0.0,180,0.00,0.14
17/06/13,20:50,70.1,98,69.5,2.0,5.0,179,0.00,0.14,29.966,2.70,74.8,52,3.0,70.1,70.1,0.0,0,0.000,0.000,76.4,0,0.0,157,0.00,0.14
17/06/13,21:00,70.2,98,69.6,3.0,6.0,176,0.00,0.14,29.967,2.70,73.8,52,1.0,70.2,70.2,0.0,0,0.000,0.000,76.0,0,0.0,182,0.00,0.14
17/06/13,21:10,70.2,98,69.6,3.0,5.0,187,0.00,0.14,29.973,2.70,73.1,52,1.0,70.2,70.2,0.0,0,0.000,0.000,76.0,0,0.0,192,0.00,0.14
17/06/13,21:20,70.3,98,69.7,2.0,5.0,174,0.00,0.14,29.975,2.70,72.5,51,2.0,70.3,70.3,0.0,0,0.000,0.000,76.7,0,0.0,165,0.00,0.14
17/06/13,21:30,70.4,98,69.8,3.0,5.0,174,0.00,0.14,29.981,2.70,71.9,51,1.0,70.4,70.4,0.0,0,0.000,0.000,76.3,0,0.0,165,0.00,0.14
17/06/13,21:40,70.5,98,69.9,2.0,5.0,181,0.00,0.14,29.977,2.70,71.4,51,1.0,70.5,70.5,0.0,0,0.000,0.000,77.0,0,0.0,178,0.00,0.14
17/06/13,21:50,70.5,98,69.9,2.0,5.0,178,0.00,0.14,29.983,2.70,71.0,51,0.0,70.5,70.5,0.0,0,0.000,0.000,77.0,0,0.0,177,0.00,0.14
17/06/13,22:00,70.6,98,70.0,2.0,3.0,182,0.00,0.15,29.983,2.71,71.2,54,1.0,70.6,70.6,0.0,0,0.000,0.000,77.1,0,0.0,178,0.00,0.15
17/06/13,22:10,70.6,98,70.0,3.0,5.0,172,0.00,0.15,29.974,2.71,72.3,54,4.0,70.6,70.6,0.0,0,0.000,0.000,76.6,0,0.0,175,0.00,0.15
17/06/13,22:20,70.5,98,69.9,3.0,6.0,168,0.00,0.15,29.969,2.71,73.2,54,5.0,70.5,70.5,0.0,0,0.000,0.000,76.4,0,0.0,184,0.00,0.15
17/06/13,22:30,70.4,98,69.8,2.0,5.0,157,0.00,0.15,29.972,2.71,73.9,54,2.0,70.4,70.4,0.0,0,0.000,0.000,76.8,0,0.0,190,0.00,0.15
17/06/13,22:40,70.3,98,69.7,1.0,2.0,175,0.00,0.15,29.976,2.71,73.0,51,0.0,70.3,70.3,0.0,0,0.000,0.000,77.2,0,0.0,178,0.00,0.15
17/06/13,22:50,70.3,98,69.7,1.0,2.0,138,0.00,0.15,29.975,2.71,71.9,51,2.0,70.3,70.3,0.0,0,0.000,0.000,77.2,0,0.0,136,0.00,0.15
17/06/13,23:00,70.3,98,69.7,1.0,2.0,136,0.00,0.15,29.973,2.71,71.8,54,0.0,70.3,70.3,0.0,0,0.000,0.000,77.2,0,0.0,136,0.00,0.15
17/06/13,23:10,70.2,98,69.6,1.0,2.0,129,0.00,0.15,29.969,2.71,72.7,54,1.0,70.2,70.2,0.0,0,0.000,0.000,77.1,0,0.0,125,0.00,0.15
17/06/13,23:20,70.2,99,69.9,1.0,2.0,117,0.00,0.15,29.969,2.71,73.4,54,0.0,70.2,70.2,0.0,0,0.000,0.000,77.2,0,0.0,116,0.00,0.15
17/06/13,23:30,70.1,99,69.8,1.0,3.0,131,0.00,0.15,29.971,2.71,73.9,54,1.0,70.1,70.1,0.0,0,0.000,0.000,77.1,0,0.0,146,0.00,0.15
17/06/13,23:40,70.2,99,69.9,1.0,2.0,157,0.00,0.15,29.968,2.71,73.5,51,1.0,70.2,70.2,0.0,0,0.000,0.000,77.2,0,0.0,188,0.00,0.15
17/06/13,23:50,70.2,99,69.9,1.0,2.0,178,0.00,0.15,29.963,2.71,72.1,51,2.0,70.2,70.2,0.0,0,0.000,0.000,77.2,0,0.0,173,0.00,0.15

[Matt.j5b]

The rainfall entries recorded in the log file is as the following (according to the wiki : http://wiki.sandaysoft.com/a/Monthly_log_files), under "Cumulus specific files ".

08: Current rainfall rate
09: Total rainfall today so far (i.e. resets to zero at rollover)
11: Total rainfall counter (content depends on weather station type, might be rainfall total so far this year)

The total rainfall today (resets at end of the day) and the total counter will go up as it rains. The total rainfall today is used for the graphs which is if you made them all 0 would remove it from the graph. The total counter is the basis for the daily total and 24 hour total and you don't need to edit that one. Edit the dayfile to correct the monthly/annual totals. Under edit, Today's rain you can edit today rain but it does not change the all time, this month, this year, monthly and the log file used for the graphs for example, it only adjusts the rain total for today if it is wrong, it will disappear after a day or two.

The dayfile can be edited with the dayfile editor under edit. The log file is edited either when opened in a text editor or use Cumulus toolbox as it loads the file into the table making it much easier to edit. You can also look at the alltimelog in the Cumulus data folder if it broke an all time record to see what the figures was before the new record.

[Touchtone]

I know this thread is a little dated but figured my questions fall inline with it.

Also, once I get the Cumulus data edited do I need to edit anything in the VP2 console?

Thanks,
Ed

Yes you will need to edit the rainfall totals in your VP2 console if you want your console to read the same as Cumulus after you have corrected Cumulus. The above information from other contributors seems to have covered resetting Cumulus adequately.
Refer to page 26 of the console manual under "Setting Weather Variables". It's best to set the daily rain first as any adjustment here changes the monthly & yearly figures.
When you have the daily total set you can set the monthly & the yearly totals.
To set each one select the item you wish to change & then press "2nd" & then press & hold the "set" button until all digits are lit & only one is blinking then use the < or > keys to select the digit you wish to change & then use the + or - keys to to add or subtract. Press "Done" when you have finished & move to the next one & repeat the procedure.

[steve]

Yesterday we got a good rain but I found out his morning that my VP2 rain gauge was clogged up with trash...that little Davis screen is about useless isn't it?

I sympathise. My rain gauge gets clogged by seabirds (I'll spare you the obvious explanation, but some of them are rather large...) unless I remember to check periodically. If I forget, after a few days with no rain recorded, I realise what's happened and have to sort it out.

I poke a stalk through to allow the collected rain to fall through, and then clean out the collector. And then I correct my data as best I can. But these days my weather statistic collecting has had to take on a lower priority, due to Cumulus, so I'm not as fussy as I once was about perfect data, and there may be better ways to approach this.

My rain gauge screen blew away within a few hours of installing the station.