Welcome to the Cumulus Support forum.

Latest Cumulus MX V4 release 4.4.2 (build 4085) - 12 March 2025

Latest Cumulus MX V3 release 3.28.6 (build 3283) - 21 March 2024

Legacy Cumulus 1 release 1.9.4 (build 1099) - 28 November 2014
(a patch is available for 1.9.4 build 1099 that extends the date range of drop-down menus to 2030)

Download the Software (Cumulus MX / Cumulus 1 and other related items) from the Wiki

If you are posting a new Topic about an error or if you need help PLEASE read this first viewtopic.php?p=164080#p164080

Historic data import

From build 3044 the development baton passed to Mark Crossley. Mark has been responsible for all the Builds since. He has made the code available on GitHub. It is Mark's hope that others will join in this development, but at the very least he welcomes your ideas for future developments (see Cumulus MX Development suggestions).

Moderator: mcrossley

User avatar
mcrossley
Posts: 14384
Joined: Thu 07 Jan 2010 9:44 pm
Weather Station: Davis VP2/WLL
Operating System: Bullseye Lite rPi
Location: Wilmslow, Cheshire, UK
Contact:

Re: Historic data import

Post by mcrossley »

You do not need to make the 23:50 entry the total for day, IF you increment the counter at 00:00 to account for any rainfall between 23:50->00:00. CreateMissing will then add that bit on to the day total for you.
packman2008
Posts: 178
Joined: Fri 30 Dec 2022 5:33 pm
Weather Station: Davis VP2 + WLL
Operating System: Windows 11
Location: Blackpool, UK
Contact:

Re: Historic data import

Post by packman2008 »

I've tried to replicate what is expected to be seen but I'm still getting something wrong. On a few random days where there has been rain (from monthly log) the dayfile total rain is showing zero. My monthly log files have the following...

1) Rainfall Counter - Grows by any rain in any hour (including 00:00)
2) Rainfall rate - reflects the mm/hour for the previous hour. Always fixed at zero in the 00:00 records.
3) Rain so far and 24 hour rain - Grows within a day based on the rain rate in any hour. Always fixed at zero in the 00:00 records.

On a day that has a rain so far and 24 hour rain value > 0 at 23:00 (my last record of the day) the total rain for the day is still showing as zero in the dayfile.

:bash: :D
Chris

https://blackpool.weather-watch.com/
CMX 4.3.2b4067 ● CU 7.3.0b6 ● Davis VP2+WLL & Ecowitt GW1100 ● Core i5 Mini PC ● Windows 11 ● .Net 8.0.3
User avatar
mcrossley
Posts: 14384
Joined: Thu 07 Jan 2010 9:44 pm
Weather Station: Davis VP2/WLL
Operating System: Bullseye Lite rPi
Location: Wilmslow, Cheshire, UK
Contact:

Re: Historic data import

Post by mcrossley »

Do you want to send me a log file and I can step through CreateMissing and see if I can spot the issue?

It may take a day or so though to find the time.
packman2008
Posts: 178
Joined: Fri 30 Dec 2022 5:33 pm
Weather Station: Davis VP2 + WLL
Operating System: Windows 11
Location: Blackpool, UK
Contact:

Re: Historic data import

Post by packman2008 »

I'll have a little dig myself first. I've managed to compile and run CreateMissing so I'm at the point of figuring out enough C# to produce some debug output to try to track what's going on. I'll try to educate myself to keep some load off you.
Chris

https://blackpool.weather-watch.com/
CMX 4.3.2b4067 ● CU 7.3.0b6 ● Davis VP2+WLL & Ecowitt GW1100 ● Core i5 Mini PC ● Windows 11 ● .Net 8.0.3
metofficemk
Posts: 11
Joined: Thu 10 Jan 2013 5:09 pm
Weather Station: Davis Vantage PRO 2
Operating System: Windows 11
Location: Milton Keynes UK

Manually add missing Rainfall data

Post by metofficemk »

Hi, I am missing a few days worth of rainfall data for January 2023.
How do I add the missing rainfall amounts for the first 9 days of Jan 2023?
Jan 01 - 2.6mm
Jan 02 - 0.0mm
Jan 03 - 4.6mm
Jan 04 - 2.2mm
Jan 05 - 0.2mm
Jan 06 - 2.8mm
Jan 07 - 7.4mm
Jan 08 - 1.8mm
Jan 09 - 0.2mm

Thanks
User avatar
mcrossley
Posts: 14384
Joined: Thu 07 Jan 2010 9:44 pm
Weather Station: Davis VP2/WLL
Operating System: Bullseye Lite rPi
Location: Wilmslow, Cheshire, UK
Contact:

Re: Historic data import

Post by mcrossley »

You can just amend the annual total in the Station Settings under Annual Rainfall.

Otherwise, you would have to create valid dayfile entries for those days - along with all the other data for each day.
bumpy
Posts: 106
Joined: Fri 24 Sep 2010 12:27 pm
Weather Station: Davis Vantage Vue
Operating System: Windows 10
Location: Tiverton, Devon

Re: Historic data import

Post by bumpy »

Good morning
Advice please.
I have two websites running: www.farleighmeadows.co.uk running on one server and https://www.tivertonnorthwest.co.uk/las ... esktop.php running on another server using Meteotemplate.
When I recently set up Meteotemplate I discovered that because I am a dinosaur and turn off my PC at night, the Meteotemplate website does not upload data stored by CumulusMX overnight. I assume that this is because Meteotemplate uses the Cumulus realtime.txt process. Consequently although farleighmeadows updates the overnight data, tivertonnorthwest doesn't and obviously I now have about 8hrs missing data each day which is not ideal. Is there a way to circumvent this problem or am I stuck with it?

Additionally the Meteotemplate historic data is incomplete simply because I lost many Cumulus log.txt files due to a computer glitch and these were unrecoverable. Consequently although I have a complete dayfile dating back to 22/09/2010, very few log.txt files remain and the earliest of these is Nov18. Is there a way on converting the dayfile data to make it accceptable as historic data to Meteotemplate? I don't fancy the task to trying to produce monthly log.txt files manually.

I would ask the Meteotemplate forum for advice but I am still awaiting approval access after sometime and several reminders.

Any comments would be much appreciated.

Tony
User avatar
mcrossley
Posts: 14384
Joined: Thu 07 Jan 2010 9:44 pm
Weather Station: Davis VP2/WLL
Operating System: Bullseye Lite rPi
Location: Wilmslow, Cheshire, UK
Contact:

Re: Historic data import

Post by mcrossley »

It sounds like you are bit stuck to be honest.

I'm not familiar with the Meteotemplate and how it stores data. You are saying it uses the monthly log files rather than the day file?

There is no way of creating missing monthly log files from the day file. You can do it the other way around, but to create a monthly log file you would have to invent 99.9% of the data.
Post Reply