Page 1 of 1

Adding Historical Data Without Wind, Rain or Solar

Posted: Thu 05 May 2022 11:47 am
by Grouper
Hi All,

I've successfully added the pre CMX data I had for this WS (Ecowitt HP2551) sourced from a combination of Ecowitt.net export and the WS SD card CSV data. I used Excel & Notepad++ to perform the required conversion & calculations. Then used Createmissing.exe to create the Dayfiles. I'll share this Excel calculator once I have polished it a bit more.

However I'm now looking at adding the ~16 years of data that I have from my old WS (La Crosse WS3500). This was a very basic WS with no wind, rain or solar data collection. I gather that I can't leave any of the fields blank in the Monthly file. I can see that the wind & solar I can just set to 0 without causing too many problems eg.windchill will just be the same as the outside temp etc. If I set all the rain figures to 0, I guess it will look like the world's longest drought ! I presume that could be avoided from appearing on the records pages if I manually ignore this data for rain when manually editing the all time, yearly, monthly records etc ?

Is there a value that I can put in the monthly files for this wind, rain & solar data that will be ignored by Createmissing & CMX ? Or are zeros the best approach ?

The wiki suggests that Createmissing can calculate some missing derived fields in the monthly file for you but what value do you need to put in to get it to do this ? I couldn't get it to work with empty, space or -9999 etc, but it was useful for creating the dayfiles.

Thanks,
Dave

Re: Adding Historical Data Without Wind, Rain or Solar

Posted: Thu 05 May 2022 1:29 pm
by PaulMy
Hi,
The wiki suggests that Createmissing can calculate some missing derived fields in the monthly file for you
CreateMissing is for adding missing fields, or missing days, to the dayfile.txt file. The data must already be in the monthly log file for CreateMissing to add it to dayfile.txt https://cumuluswiki.org/a/Software#Create_Missing

Enjoy,
Paul

Re: Adding Historical Data Without Wind, Rain or Solar

Posted: Fri 06 May 2022 8:51 am
by mcrossley
Create missing assumes that the base data will be there, so the base T/H/W fields cannot be blank, if there is no data then the best you can do is add them as zeros.

Fields beyond 16 can be "null", ie nothing between the commas
See the history of the monthly log file here: https://cumuluswiki.org/a/Standard_log_files

Re: Adding Historical Data Without Wind, Rain or Solar

Posted: Fri 06 May 2022 9:40 am
by Grouper
Thanks Paul & Mark for the replies, I'll crack on with my approach and start loading the data. It may take a while :)