Missing Day in Dayfile

[gw73]

Hi
Still running ver.3.28.5 build 3282. On August 29th, I had a lightning strike and was out of power and wifi for 1 day. By the time I got everything running again, I was missing one day in my dayfile. Can I just add a line back in and will I need to change my August 24 log. I need to add this day back in because we had a large amount of rain. I've searched a bit and am not finding a good answer. Thanks

Gary

[PaulMy]

Hi,
Does your station have a data logger, and does it still have the CumulusMX missed data? If so, you can back-date your \data from a good backup and restart CumulusMX.

Enjoy,
Paul

[gw73]

I have two consoles, one a Weatherlink, and the other a vantage vue, it has a data logger. They are both connected to a vantage pro 2. How would I back-date my data from a good backup? Thanks

Gary

[PaulMy]

Hi,
CumulusMX makes a backup of certain files each time you start CMX and the last 10 are saved in \CumulusMX\backup folder. and also at the end of each day and the last 10 are in the \CumulusMX\backup\daily\ folder.

With CumulusMX stopped:
First make your own copy of the full working \CumulusaMX folder, just in case.
Then from one of your backups from before the missed date, copy the content of the good backup and paste all in your \CumulusMX\data folder to replace the existing files.

Restart CumulusMX and it will catch up the data from that backed up date/time from your logger. The only difference in your CumulusMX data will be that the catch up will be from your logger's logging interval, i.e. 5-minute rather than live data that CumulusMX receives while it is running. But this is the same as when you would normally stop CumulusMX for whatever reason, and restart it.

Enjoy,
Paul

[gw73]

Thank you for the clear instructions. I will try it out later and let you know how it turned out.

Ggary

[gw73]

I believe I need to provide more information. When I followed your suggestion, Cumulus started up and attempted to download data, but no historical data was found. Consequently, I used my backup to restore MX to its previous state. Both consoles upload data to Davis WeatherLink (WL), and the older Vantage Vue also transfers everything to my computer. The WL console, which is a Pro account, uploads to Davis and was offline for a couple of days. Although I am still new to this, I am fairly certain that Cumulus MX is receiving its data from Davis. I am unsure if there is a way to retrieve data from the Vantage Vue, or I would be content with getting the rainfall data into WL by editing a dayfile or log file. I realize this might sound confusing, so I would greatly appreciate any further advice.

Thanks
Gary

[PaulMy]

Hi,
Could you zip and attach the recent files in \CumulusMX\MXdiags that contain the log from your restarts. This will help in seeing how your CumulusMX is starting, what errors. etc.

Also a bit of clarification:

Both consoles upload data to Davis WeatherLink (WL), and the older Vantage Vue console also transfers everything to my computer.

It doesn't matter, but I presume you have one outside station, a VP2.

You have a Vue console which has a logger, and what type - USB/Serial or IP?
I presume it is an IP and this uploads to Weatherlink.com and this is a basic free account. Can you provide the Bulletin browser URL to this account? i.e. mine is https://www.weatherlink.com/bulletin/a3 ... ad6e1f09d1 and yours would start the same but have a different set of letters-numbers.

This Vue console with a logger can connect directly to CumulusMX. And if it is an IP logger it can also upload to Weatherlink.com. To do both then CumulusMX settings will need a Disconnect period: i.e. 10 seconds for it to do both. I presume this is you original setup?

If the WiFi/internet was lost then there would have been no connection for either CumulusMX to receive data nor the logger updating to Weatherlink.com. However the logger would still be receiving the data from the ISS so historical data should be recoverable.

You also have a Weatherlink Console, and I assume you mean the new 6313 colour console? This uses WiFi/internet for uploads to another Weatherlink.com account which is a Pro account, and can you provide its Bulletin browser URL to this account?

If your WiFi was lost then there would have been no ongoing updates by the 6313 console to its Weatherlink.com account, and I am not sure if it would catch up if WiFi/internet was restored. The Weatherlink Live (which I presume you don't have) does do catch up to Weatherlink.com if WiFi/internet is restored.

If I recall correctly your CumulusMX build 3282 has settings for connecting to the new 6313 console Weatherlink.com as a Davis Weatherlink Cloud (WLL/WLC) station type. CumulusMX version 4 has made some changes to this station type that make it much better in downloading data both current and archive.

If my assumptions are correct then your only option is to have your CumulusMX station settings as Davis VP2/Vue with the Davis Connection Settings as TCP/IP and its correct IP address. Then do the restore from a previous good backup.

Confusing? Davis has too many Weatherlinks!


EDIT: I have read a thread from earlier this year and found the links to your weatherlink.com Sandhills and Sandhill_old sites


Enjoy,
Paul

[gw73]

Good morning.
I've attached the last \CumulusMX\MXdiags files. The vantage vue has a serial data logger like this. https://www.davisinstruments.com/produc ... indows-usb. I have a Weatherlink Console, the new 6313 color console. I see you have found my stations on WL. I know this sounds funny but I'm still a little new at using Cumulus, I've fed my weather to Weather Underground for years and when I got the Vp 2 in December I had to change many things. I have a small computer dedicated to the Vantage vue and all the records are stored on it using again WL 6.0.3.

Thanks

[PaulMy]

Hi,
Ok that helps, the Vue with data logger connected to WeatherlinkPC v6.0.3 and I presume that is how you have been updating to this station's Weatherlink.com site (basic account Sandhills_old). Is the data that was missed by CumulusMX because of your power and WiFi issue in the 202408.wlk file?

And you are also using CumulusMX with your Weatherlink console 6313 Weatherlink.com site (Pro account Sandhills). Is the data that was missed by CMX because of the power and WiFi issue in this Weatherlink.com account data tab?

On the issue of CumulusMX not catching up the historical data from your Weatherlink console's Weatherlink.com site (Pro account Sandhills) the MXdiags shows:

Code: Select all

2024-09-02 17:29:42.907 GetHistoricData: Get WL.com Historic Data
2024-09-02 17:29:42.907 GetHistoricData: Downloading Historic Data from WL.com from: 2024-09-02T17:15:00 to: 2024-09-02T17:29:42
2024-09-02 17:29:42.907 WeatherLink URL = https://api.weatherlink.com/v2/historic/176516?api-key=API_KEY&start-timestamp=1725315300&end-timestamp=1725316182
2024-09-02 17:29:42.907 Roll over hour = 0
2024-09-02 17:29:43.454 GetHistoricData: WeatherLink API Historic Response code: 200
2024-09-02 17:29:43.454 GetHistoricData: WeatherLink API Historic Response: {"station_id_uuid":"4351d700-8db5-4afb-8657-7eda731e5985","sensors":[{"lsid":687551,"data":[],"sensor_type":509,"data_structure_type":27},{"lsid":687554,"data":[],"sensor_type":43,"data_structure_type":24},{"lsid":687552,"data":[],"sensor_type":242,"data_structure_type":20},{"lsid":687553,"data":[],"sensor_type":365,"data_structure_type":22}],"generated_at":1725316183,"station_id":176516}
2024-09-02 17:29:43.469 GetHistoricData: No historic data available
2024-09-02 17:29:43.469 History: WeatherLink API archive reading thread completed

could be that you are running v.3.28.5 build 3282. Mark had made some improvements on the Davis Cloud station type in later builds and CMX v4.

On your question:

Still running ver.3.28.5 build 3282. On August 29th, I had a lightning strike and was out of power and wifi for 1 day. By the time I got everything running again, I was missing one day in my dayfile. Can I just add a line back in and will I need to change my August 24 log. I need to add this day back in because we had a large amount of rain.

Possibly!

One way is if your WeatherlinkPC 202408.wlk file has the full August data then you can use the WLK converter, which I think you have already tried, to convert to CMX data, and then copy that converted data into your CMX 202408.txt data file, and run CreateMissing utility to have it added to the dayfile.

Another way may be by updating CMX to current version and build, and then restart CMX with data from before the power/wifi issue as previously mentioned.

Enjoy,
Paul

[gw73]

Thanks, I will try your suggestions.

[gw73]

Hi
I have been pretty busy but what I did was convert the WLK file to cmx data. That worked and I got my data into my Aug24 log file. But when I tried the createMissing file I got the error, date is out of order on two different lines. I opened the day file in Excel and thought I got everything correct, but it seems to have made it worse, with quite a few more errors afterward. Should I use something else to edit these files? The built-in editor doesn't really let me fix these kinds of errors. I probably introduced these errors when I converted all my .wlk files from my vantage vue. Anyway, I am still dealing with the lightning damage plus I am still farming some so my time is limited right now.

Thanks
After taking a day off from this I tried editing in Excel and got it right this time. Now I have the missing data in the dayfile now. Thanks again!

[PaulMy]

Hi,
Surprised that you were able to get the dayfile correct in Excel as this is not recommended because Excel introduces (or could) strange characters, so you must have done it correctly. And glad you got it updated with correct data, well done.

Enjoy,
Paul

[gw73]

Actually, it was Google Sheets, since my regular computer was taken out with the lightning strike and it had Excel. I plan to update MX v4 soon. I keep getting more experience with Cumulus and it might go better.

Gary