Cumulus data files changes
Posted: Wed 20 May 2020 3:21 pm
Running the latest Cumulusutils has highlighted the changes over time in the Cumulus data files and the impact on the modules that HansR has implemented - after considerable trouble shooting .
I have Cumulus data from October 2008. I have been interchanging the data files between Cumulus1 install and CumulusMX, ignoring the fact that the old data files did not have all the data fields that are in later Cumulus1 and now CumulusMX versions. Generally that has not been an issue even though the source for Cumulus1 is with Davis Envoy/USB logger, and CumulusMX with Davis Vue and WiFiLogger so after interchanging the data files are a combination Envoy/USB and Vue/WiFiLogger.
A few bad data issues were discovered in dayfile and monthlog files when running Cumulusutils' pwsFWI, dayrecord and Yadr modules and these were quickly found and corrected after reading the cumulusutils.txt log file.
Now the big one was the introduction of the Windrose module as a beta. Eventually Hans was able to identify the issue which was that my oldest files did not have all the data fields that are in the current version of Cumulus1 i.e. Wind bearing. Hans made changes and that issue is now overcome.
After I updated to the latest Cumulusutils v.3.6.5 and still had issues I concluded it was either me or Hans' fault
It seemed that when running the modules individually, like pwsFWI everything processed and FTP/updated. However when I selected the parameter All or Website the files were all created but seemed to me that these were not being FTP/updated. I hadn't yet tried the new Thrifty option as still presumed I had a bug somewhere. Now in rechecking each of the modules after doing a cumulusutils.exe Website run all the updates are on the website www.komokaweather.com/cumulusutils/index.html
My reason for concluding (wrongly) the files were not being FTP/updated was looking at my website files using Filezilla and the files had the old time and date.
However, there was still an underlining issue with my Windrose module, and amongst the many lines in the cumulusutils.txt log file it identified my Oct08log file. I checked this file and found the data was tab delimited for this file rather then comma. Don't know how that occurred and hadn't come up on any other program or script I have been using, but the good thing is that now that has been corrected.
The moral of this post is, as often mentioned in forum replies to support questions, to check your data, and check again, and again
Enjoy,
Paul
I have Cumulus data from October 2008. I have been interchanging the data files between Cumulus1 install and CumulusMX, ignoring the fact that the old data files did not have all the data fields that are in later Cumulus1 and now CumulusMX versions. Generally that has not been an issue even though the source for Cumulus1 is with Davis Envoy/USB logger, and CumulusMX with Davis Vue and WiFiLogger so after interchanging the data files are a combination Envoy/USB and Vue/WiFiLogger.
A few bad data issues were discovered in dayfile and monthlog files when running Cumulusutils' pwsFWI, dayrecord and Yadr modules and these were quickly found and corrected after reading the cumulusutils.txt log file.
Now the big one was the introduction of the Windrose module as a beta. Eventually Hans was able to identify the issue which was that my oldest files did not have all the data fields that are in the current version of Cumulus1 i.e. Wind bearing. Hans made changes and that issue is now overcome.
After I updated to the latest Cumulusutils v.3.6.5 and still had issues I concluded it was either me or Hans' fault
It seemed that when running the modules individually, like pwsFWI everything processed and FTP/updated. However when I selected the parameter All or Website the files were all created but seemed to me that these were not being FTP/updated. I hadn't yet tried the new Thrifty option as still presumed I had a bug somewhere. Now in rechecking each of the modules after doing a cumulusutils.exe Website run all the updates are on the website www.komokaweather.com/cumulusutils/index.html
My reason for concluding (wrongly) the files were not being FTP/updated was looking at my website files using Filezilla and the files had the old time and date.
However, there was still an underlining issue with my Windrose module, and amongst the many lines in the cumulusutils.txt log file it identified my Oct08log file. I checked this file and found the data was tab delimited for this file rather then comma. Don't know how that occurred and hadn't come up on any other program or script I have been using, but the good thing is that now that has been corrected.
The moral of this post is, as often mentioned in forum replies to support questions, to check your data, and check again, and again
Enjoy,
Paul