I need to clean some data for Temp (have a reading of -250 !), rainfall, and wind. I got some rogue readings for 2 or 3 times over the past 24 hours (and in fact they repeat 100s of times in the data file).
I know I can clean the ini and txt files for the various day / yesterday / month / alltime settings (although its a long and painful process), and clear out the bad data from the dayfiles, but I am missing something... when I reload the site the max / min temperatures are re-calculated; also, the gauges for temp go wild because -250 is clearly a problem... and they just "loop" (running from -250 to +30).
This loop could be linked to the 100s of bad data points I suppose ?
Anyway, thoughts ? What files can I supply that will help anyone ? Is it a case of doing a restore from a couple of days ago and see if it re-occurs ?
Have an Aercus 3083 (i.e. Fine Offset with UV clone), and am running version 3042...
Welcome to the Cumulus Support forum.
Latest Cumulus MX V4 release 4.4.2 (build 4085) - 12 March 2025
Latest Cumulus MX V3 release 3.28.6 (build 3283) - 21 March 2024
Legacy Cumulus 1 release 1.9.4 (build 1099) - 28 November 2014
(a patch is available for 1.9.4 build 1099 that extends the date range of drop-down menus to 2030)
Download the Software (Cumulus MX / Cumulus 1 and other related items) from the Wiki
If you are posting a new Topic about an error or if you need help PLEASE read this first viewtopic.php?p=164080#p164080
Latest Cumulus MX V4 release 4.4.2 (build 4085) - 12 March 2025
Latest Cumulus MX V3 release 3.28.6 (build 3283) - 21 March 2024
Legacy Cumulus 1 release 1.9.4 (build 1099) - 28 November 2014
(a patch is available for 1.9.4 build 1099 that extends the date range of drop-down menus to 2030)
Download the Software (Cumulus MX / Cumulus 1 and other related items) from the Wiki
If you are posting a new Topic about an error or if you need help PLEASE read this first viewtopic.php?p=164080#p164080
Need to remove or correct rogue entries
Moderator: mcrossley
-
steve
- Cumulus Author
- Posts: 26672
- Joined: Mon 02 Jun 2008 6:49 pm
- Weather Station: None
- Operating System: None
- Location: Vienne, France
- Contact:
Re: Need to remove or correct rogue entries
Today's max and min so far are loaded from today.ini at startup. Are they they the max and min that you're referring to?
You could try 'rewinding' using the Cumulus backup files - if the station didn't leave those values in its memory, they shouldn't reoccur.
Are you using the 'spike removal' settings? They normally help to significantly reduce the garbage that Fine Offset stations are prone to generating. You have selected the correct station type in Cumulus?
You could try 'rewinding' using the Cumulus backup files - if the station didn't leave those values in its memory, they shouldn't reoccur.
Are you using the 'spike removal' settings? They normally help to significantly reduce the garbage that Fine Offset stations are prone to generating. You have selected the correct station type in Cumulus?
Steve
-
sstmjoy
- Posts: 3
- Joined: Sat 14 Jan 2017 7:03 pm
- Weather Station: Aercus WH3083
- Operating System: MAC OS Sierra 10.12.2
Re: Need to remove or correct rogue entries
I have stopped file uploads to my website, so you can see the values I am struggling with (last uploaded yesterday).
You can see what the gauges are doing at : http://steve-joy.com/weather/gauges.htm
The low apparent temperature can be seen at http://steve-joy.com/weather/today.htm
(you can see some other really silly values on that page too)
I have cleaned up some of the data manually now, so the other pages look relatively OK - at least they are within the realms of reality - (apart from wind run),
Yes I have the right station selected - I thought I had spike settings turned on, but I will check that.
I will disable FTP and try with a backup, and see what happens
Thanks a lot.
You can see what the gauges are doing at : http://steve-joy.com/weather/gauges.htm
The low apparent temperature can be seen at http://steve-joy.com/weather/today.htm
(you can see some other really silly values on that page too)
I have cleaned up some of the data manually now, so the other pages look relatively OK - at least they are within the realms of reality - (apart from wind run),
Yes I have the right station selected - I thought I had spike settings turned on, but I will check that.
I will disable FTP and try with a backup, and see what happens
Thanks a lot.
-
sstmjoy
- Posts: 3
- Joined: Sat 14 Jan 2017 7:03 pm
- Weather Station: Aercus WH3083
- Operating System: MAC OS Sierra 10.12.2
Re: Need to remove or correct rogue entries
I have kind of got it working now... still got a couple of rogue data points but its working, restored from a backup and got rid of the bad data.
Thanks
Thanks