Welcome to the Cumulus Support forum.

Latest Cumulus MX V4 release 4.4.2 (build 4085) - 12 March 2025

Latest Cumulus MX V3 release 3.28.6 (build 3283) - 21 March 2024

Legacy Cumulus 1 release 1.9.4 (build 1099) - 28 November 2014
(a patch is available for 1.9.4 build 1099 that extends the date range of drop-down menus to 2030)

Download the Software (Cumulus MX / Cumulus 1 and other related items) from the Wiki

If you are posting a new Topic about an error or if you need help PLEASE read this first viewtopic.php?p=164080#p164080

Missing Day of data from weather station

From build 3044 the development baton passed to Mark Crossley. Mark has been responsible for all the Builds since. He has made the code available on GitHub. It is Mark's hope that others will join in this development, but at the very least he welcomes your ideas for future developments (see Cumulus MX Development suggestions).

Moderator: mcrossley

Post Reply
Prospect
Posts: 8
Joined: Wed 17 Jan 2024 4:08 pm
Weather Station: Weatherflow Tempest
Operating System: Windows 10

Missing Day of data from weather station

Post by Prospect »

I have a Weatherflow Tempest using installed since Wednesday 17th January 2024 but on Sunday 21/1/24 (the Storm Isha) which I would like to see in CMX as these contain record wind gust 73 knots and rain etc.

The Tempest history is there on the Tempest app/pc program but not getting into CMX.

Any suggestion why a day would go missing?
User avatar
mcrossley
Posts: 14384
Joined: Thu 07 Jan 2010 9:44 pm
Weather Station: Davis VP2/WLL
Operating System: Bullseye Lite rPi
Location: Wilmslow, Cheshire, UK
Contact:

Re: Missing Day of data from weather station

Post by mcrossley »

Please post your MXdiags log file
Prospect
Posts: 8
Joined: Wed 17 Jan 2024 4:08 pm
Weather Station: Weatherflow Tempest
Operating System: Windows 10

Re: Missing Day of data from weather station

Post by Prospect »

Hi
I have attached all the text files from the MXDiags.

Initally when first set up CMX I had the wrong StationID I corrected yesterday, but I have data for 17/01 to 20/01 and 22/01 onwards and complete gap for the 21/01/23 which due to the record winds/rain I would like include.

Regards

Craig
You do not have the required permissions to view the files attached to this post.
User avatar
mcrossley
Posts: 14384
Joined: Thu 07 Jan 2010 9:44 pm
Weather Station: Davis VP2/WLL
Operating System: Bullseye Lite rPi
Location: Wilmslow, Cheshire, UK
Contact:

Re: Missing Day of data from weather station

Post by mcrossley »

The oldest log file there 22 Jan 16:49:36, attempted to download data for the period 20/01/2024 17:30:00 to 2024-01-22 16:49:43 but got an error message...

Code: Select all

2024-01-22 16:49:44.064 Error downloading tempest history: {"status":{"status_code":404,"status_message":"NOT FOUND"}}
Which presumably had the incorrect station-id set.

The simplest way you could recover the data now you have the station ID set correctly....

Restore a backup from the /backups folder that was just before the date/time you want to recover from (with CMX stopped!).
Do not restore the Cumulus.ini file, just the /data folder.

restart CMX and it will request history data from that backup time to current. You will of course lose any "live" data from then until now and be relying purely on the historic data.

See: https://www.cumuluswiki.org/a/FAQ#On_re ... t_last_ran
Prospect
Posts: 8
Joined: Wed 17 Jan 2024 4:08 pm
Weather Station: Weatherflow Tempest
Operating System: Windows 10

Re: Missing Day of data from weather station

Post by Prospect »

Hi Mark

Thanks for your reply, the oldest backup folder is 2024-01-22 the day after the record winds etc.

Tried CreateMissing going back to 17/1/24 but in the charts still going a straight line between the day in question.
I had the Tempest on a tripod from 17/1 to 20/1 (in my gargage overnight) and installed on its pole on Sat 20/1 when it was safe due to ice previous days so if you can open the image there willbe early straight lines where no readings from 16:50 on the 20/1 till 17:00 on the 22/1.

The data is not missing on the Tempest app
You do not have the required permissions to view the files attached to this post.
User avatar
mcrossley
Posts: 14384
Joined: Thu 07 Jan 2010 9:44 pm
Weather Station: Davis VP2/WLL
Operating System: Bullseye Lite rPi
Location: Wilmslow, Cheshire, UK
Contact:

Re: Missing Day of data from weather station

Post by mcrossley »

The only option left to you I think is to follow the rather a tedious process to fetch the missing data from the station history and manually combine it with the current data.
  1. Stop Cumulus and make TWO backups of the /Data folder somewhere safe.
  2. Delete all files in the /Data folder except today.ini
  3. Edit today.ini and delete all the content leaving the following lines...

    Code: Select all

    [General]
    Date=10/04/2012
    Timestamp=10/04/2012 10:00:00
    CurrentYear=2012
    CurrentMonth=4
    CurrentDay=10
    Where you the set the date/time you want to recover from - I suggest starting at least the day before.
  4. Start Cumulus, it should download all the data from the date you entered above until present.
  5. Stop Cumulus again
  6. Make a THIRD backup copy of the /data folder
  7. To ONE of your original /data backups made at the start...
    1. Edit the newly created dayfile.txt and extract the day(s) you want to recover
    2. Paste those days into the backup dayfile.txt, overwriting any entries already there
    3. Edit the new Jan24log.txt, extract the lines for the periods you are missing
    4. Paste those lines into the backup Jan24log.txt, overwriting any that are there
  8. Copy the updated backup folder that you just updated back into your Cumulus installation folder.
  9. Start Cumulus, it should resume from the point where you stopped it at 1. above
  10. Your missing data should now be visible in the select-a-period etc
  11. Finally use all the records editors to check if the previously missing data exceeded any records
Phew, I think that's it, if it all goes wrong you can restore from the second (unedited) backup you created at the start and be back where you were.
Just take your time, think about what you are doing and don't leave blank lines it files etc.
Post Reply