Page 1 of 1
Cleaning up New Data
Posted: Sat 22 Oct 2016 7:50 pm
by Phil23
Hi All,
Replaced my Fine Offset with a VP2 last month & have just noticed some issues in the data.
Initially ran old data transferred to MX, but then moved the station to a different PC and started data fresh.
(That's if memory serves me correctly, it was 3 weeks back, could have been new data on the old PC).
At any rate, the data I have starts at 5:30pm September 29th.
Have noticed though that Highest hourly rain is out the window at 612mm recorded about 15 minutes after start-up.
I also see rainfall counter entries of 64.8 from when the data starts at 5:30pm.
What's the best way of cleaning this up?
As I'm starting afresh, I'm happy to dump all of September, as it's only a day & a bit of data, but I'd like the 612mm gone.
I have no problems editing the text files, just want to be sure I do it correctly.
Thanks
Phil.
Re: Cleaning up New Data
Posted: Sun 30 Oct 2016 9:32 pm
by Phil23
Phil23 wrote:Hi All,
Replaced my Fine Offset with a VP2 last month & have just noticed some issues in the data.
Initially ran old data transferred to MX, but then moved the station to a different PC and started data fresh.
(That's if memory serves me correctly, it was 3 weeks back, could have been new data on the old PC).
At any rate, the data I have starts at 5:30pm September 29th.
Have noticed though that Highest hourly rain is out the window at 612mm recorded about 15 minutes after start-up.
I also see rainfall counter entries of 64.8 from when the data starts at 5:30pm.
What's the best way of cleaning this up?
As I'm starting afresh, I'm happy to dump all of September, as it's only a day & a bit of data, but I'd like the 612mm gone.
I have no problems editing the text files, just want to be sure I do it correctly.
Thanks
Phil.
Hi Again,
Been having the occasional look at this, & alltimelog.txt contains this line:
Code: Select all
2016-09-29 17:46 619.200 "High hourly rain" 2016-09-29 17:20 0.000
Which is the incorrect data. I read in the Wiki that editing this file serves no purpose.
alltime.ini and year.ini contains this:-
Code: Select all
highhourlyrainvalue=619.2
highhourlyraintime=2016-09-29T17:46:00
And presume that's one of the entries needing editing.
Month.ini has this:-
Code: Select all
HourlyHigh=10
HHourlyTime=2016-10-31T08:00:00
So I'm presuming that would be the correct value to enter in to alltime.ini & year.ini.
Can anyone help & let me know if I'm on the right track.
Still not sure about the relevance of the raincount value and whether it also needs editing.
Thanks.
Phil.
This in the data directory if anyone is willing to take a look.
data.zip
Re: Cleaning up New Data
Posted: Sun 30 Oct 2016 9:40 pm
by steve
Rainfall data will usually go awry when changing stations, as it relies on a sensible progression of the rain counter, which of course is different in a different station. The easiest way to correct all-time (etc) records is to replace the .ini files with those from a backup - either a full backup you took yourself prior to changing stations, or from the last set of data in the Cumulus backup folder prior to the change.
Re: Cleaning up New Data
Posted: Mon 31 Oct 2016 2:24 am
by Phil23
Thanks Steve,
I was sure I started fresh data with the new station & MX.
My old data was 1.9.4 & Fine offset & lots of bad readings I didn't want to carry over.
Only anomaly I can see is the rain counter started at 68 from memory.
The high hourly rain is registered as 16 minutes after I started it.
Started it on 29/09/16 at 5:30 pm, that's why I was wondering if the best thing is to eliminate Septembers data as it's only 2 days.
Phil.
Re: Cleaning up New Data
Posted: Mon 31 Oct 2016 5:50 pm
by steve
It's possible you had a 'false start' so the rain counter got recorded as zero. Once you got it connected properly, the entire rain counter would then have been counted in one go. I agree that deleting September is a good idea.