Cumulus MX offline for 3 days - how to import missing data

[Laephis]

Hello,

I just noticed that Cumulus MX was offline for me for several days (crashed maybe?) and obviously didn't record any weather data during that time. I have the missing data from EasyWeather in CSV format and also data from WeeWX (NOAA reports, etc.), but I'm unsure of the best way to import that data without messing up existing records. I've researched Dayfile.txt and can see the dates missing, but the number of rows is extensive and not sure if everything will line up neatly. The "Createmissing.exe" tool looks potentially useful, but the documentation doesn't seem to cover my exact use case.

Can anyone point me in the right direction for adding back this missing data?

Thanks!

[mcrossley]

Unfortunately the GW-1000 does not have a logger that records the data. So the usual method of winding Cumulus back and letting it catch up from the stations logger data will not work.

[Phil23]

Sounds like the dayfile will only need 3 records adding, but the Jul21Log.txt could be missing 3days x 24hours x RecordsPerHour lines.

I'd have a look at that file & see if you can rebuild the missing records in it from the CSV file.

Then test it all on an alternate machine with no station configured,
(Just not sure how possible that is in latest releases).

[Laephis]

Hmm, ok, thanks both for your replies. It's only 3 days of data, so not a huge deal in the long run, but slightly annoying since it's rained quite a bit and now my yearly totals are off. (Not worried so much about temp/wind data.)

[LindaFNM]

I’ve been down this road rather a lot lately!! If you have the data, you can easily import the date, time and temperatures, without too much hassle. Get the data you do have in Cumulus format (date/time), do it in the month following as it’s much less complicated. Export the Cumulus file to a spreadsheet, cut the good data after the missing lines and save in a separate file. Paste the data you have from the alternative source into the bottom of the file, then paste back the rest of the data you previously saved. Save as a text file.

Delete the day records that aren’t complete from the day file for that month then run the ‘create missing’ program. This gives you entires for the days you’ve missed, albeit with some gaps which you can manually fill by editing the daylog. If you want a more in depth explanation let me know.

I’ve started building databases to make this sort of thing a lot easier, and have a database of ‘raw’ data in order to create missing as much as possible.

It’s time consuming, irritating and oddly addictive . It would help of course, if all weather stations and weather programs used data in a nice, standardised format…….. but then what would I do on dark winter evenings

[Phil23]

Would be curious to see the csv file you have.
Is it from an SD card that is installed in the console?

You could upload a zip of it out of interest, along with details of it's origin.

Phil.