Page 1 of 1
Data loss
Posted: Mon 07 Jan 2013 3:56 pm
by jachym
Hi,
I have this strange problem.
In 2011 I got a new WH 1080 weather station. I decided I would start regularly logging weather data from 2012. So on Jan 1 I set up everything and started measuring in 5min intervals.
I do not use real-time logging, but rather upload the saved data from my station once a week.
Everything was working fine until last week. I connected the station via USB to the computer and opened Cumulus. The normal dialog for importing data appeared, data was downloaded and then processed.
However, for some strange reason, suddenly all the history data disappeared.... in other words, all I can see now in all time records, select-a-graph etc. is data calculated from that last upload (approximately one week).
I went to the Cumulus folder on my computer and checked the data there, but all the previous monthly log files are normally there and contain all the data as before.
I realized this when all the records have been reset and I first thought that it might be that Cumulus calculates these records for every year - this was the first upload in 2013 and so it was exactly one year since I started recording. But then when I noticed that also all the information from the Select-a-graph is not displayed from the period before this last upload I suspected this is not normal.
Does anyone have any idea what could have happened? And what interests me most is, is there any way of importing those history data back so that I can again view them in the Select-a-graph section, possibly so that they are also taken into account when displaying monthly averages, all time records etc.? As I said, the log files are normally there so I have no idea why Cumulus started ignoring them.
Thx in advance
Re: Data loss
Posted: Mon 07 Jan 2013 3:59 pm
by steve
Please zip up the diags folder and attach it.
Re: Data loss
Posted: Mon 07 Jan 2013 4:04 pm
by jachym
OK, thx for help. I am at work now, but I will do it tonight when I come home.
Re: Data loss
Posted: Tue 08 Jan 2013 3:17 am
by jachym
Here it is, although I always thought the important bit is the "data" folder, what is in fact this one?
Re: Data loss
Posted: Tue 08 Jan 2013 8:28 am
by steve
Your Windows settings have changed, such that the system routines which Cumulus uses no longer recognise your data.
On 30th December, your separator settings were:
2012-12-30 03:05:32.484 : List separator=; Decimal separator=. Date separator=- Time separator=:
and they are now:
6.1.2013 03:02:51.015 : List separator=; Decimal separator=, Date separator=. Time separator=:
This means that Windows cannot convert the decimal values in your log files, as they use decimal full stops (periods) rather than commas, which is what your setting is now:
6.1.2013 03:02:53.000 : Error plotting charts at line 1 of dayfile.txt: '1.6' is not a valid floating point value
6.1.2013 03:02:53.000 : Please correct the error by editing dayfile.txt
6.1.2013 03:02:53.000 : Error plotting charts at line 2 of dayfile.txt: '5.2' is not a valid floating point value
6.1.2013 03:02:53.000 : Please correct the error by editing dayfile.txt
6.1.2013 03:02:53.000 : Error plotting charts at line 3 of dayfile.txt: '5.3' is not a valid floating point value
6.1.2013 03:02:53.000 : Please correct the error by editing dayfile.txt
Similarly, your date and time settings have changed:
2012-12-30 03:05:32.500 : Short date format: 2012-12-30
2012-12-30 03:05:32.500 : Long date format: 2012-12-30
2012-12-30 03:05:32.500 : Short time format: 03:05
2012-12-30 03:05:32.500 : Long time format: 03:05:32
Now:
6.1.2013 03:02:51.046 : Short date format: 6.1.2013
6.1.2013 03:02:51.046 : Long date format: 6. leden 2013
6.1.2013 03:02:51.046 : Short time format: 3:02
6.1.2013 03:02:51.046 : Long time format: 3:02:51
This will also cause problems.
The simplest solution is to change your system settings back to how they were previously. You may also need to correct any data logged with the new settings. The easiest way to do this is probably to 'rewind' to the point where your settings changed, using the files in this backup folder:
6.1.2013 03:02:51.265 : Creating backup folder C:\Program Files\Cumulus\backup\20130106030251\
You probably need to delete your current January log file, it should get recreated.
Re: Data loss
Posted: Tue 08 Jan 2013 1:44 pm
by jachym
Hi Steve,
thank you VERY much for your help.
I thought about it and I first thought I am not aware of making any changes in my windows setting, but then I remembered that I actually installed a program that replaced the standard XP clock in the start menu and that might have caused the changes.
It should not be a problem to change it back to what it was, just one more thing. I dont really understand what you meant by deleting the last logged data. Does that mean I will lose it? Because if I connect my weather station again, it would then download all the data from it, but not all the data are still there. The station memory is only enough for about a week of data so it would partly overlap, but some of the oldest data from like end of Dec and beginning of Jan are already overwritten.
What exactly should I delete? Or should I somehow change the actual monthly files? And if I make the corrections in the time, will cumulus automatically recalculate all the records etc.?
Re: Data loss
Posted: Tue 08 Jan 2013 1:56 pm
by steve
Your logger is set to 5 minutes, so it holds 14 days of data. So you can rewind using those backup files (copy them into the data folder then start Cumulus), and in theory all of the required data to go back to 30th December (before your format change) should be in your station, so Cumulus will catch up. If you don't delete your current January log, Cumulus will append the data to it, so you'll get duplicates. Take a copy of your current data files first just in case the 'rewind' doesn't work for some reason.
The alternative is to edit your files to change the format of any new data logged with your changed settings.
Re: Data loss
Posted: Tue 08 Jan 2013 2:01 pm
by jachym
OK so I will first back up all the data and then I think I will first try changing the data. Is it enough to just simply use the "Find and replace" function and apply it in the January and December monthly file accordingly?
Re: Data loss
Posted: Tue 08 Jan 2013 3:48 pm
by steve
Yes, and you also need to check dayfile.txt, and do the same if necessary. You may also have to change the date formats in all of the .ini files.
Re: Data loss
Posted: Sun 13 Jan 2013 7:43 pm
by jachym
Hi
So thx a lot I managed to change my computer settings and also changed the ini a data files using find and replace. The graphs and everything works except one more thing and that is the record values. They obviously stayed as they were, calculated from just that one week in january. Is there any way to make cumulus recalculate the records when loading the data?
Re: Data loss
Posted: Sun 13 Jan 2013 7:54 pm
by steve
The record editors (on the edit menu) can fetch the data from the log files and update the records.