Welcome to the Cumulus Support forum.

Latest Cumulus MX V3 release 3.28.6 (build 3283) - 21 March 2024

Cumulus MX V4 beta test release 4.0.0 (build 4018) - 28 March 2024

Legacy Cumulus 1 release v1.9.4 (build 1099) - 28 November 2014 (a patch is available for 1.9.4 build 1099 that extends the date range of drop-down menus to 2030)

Download the Software (Cumulus MX / Cumulus 1 and other related items) from the Wiki

Missed end and Start Of Year

From build 3044 the development baton passed to Mark Crossley. Mark has been responsible for all the Builds since. He has made the code available on GitHub. It is Mark's hope that others will join in this development, but at the very least he welcomes your ideas for future developments (see Cumulus MX Development suggestions).

Moderator: mcrossley

Post Reply
User avatar
SJG1976
Posts: 365
Joined: Wed 21 Dec 2011 11:04 am
Weather Station: Davis WLL, with Airlink
Operating System: Raspberry Pi3 MX on USB Drive
Location: Glemsford, Suffolk
Contact:

Missed end and Start Of Year

Post by SJG1976 »

As I had a bit of an issue with a USB Drive.
I've managed to miss data from the 31st December to the 7th Jan.

I have no way of getting these back now.

As the re-instalk of CumulusMX Now has these dates missing.

(MyBad)

How can I now roll the year over, so when I look at records so far this year/month. They will show January Data and not data for December.

Is there a way I can force and update.

Or.shpuld I just wait until Feb, and hope it sorts itself out?
Last edited by freddie on Thu 20 Jan 2022 2:28 pm, edited 1 time in total.
Reason: Spelling mistake in title
User avatar
PaulMy
Posts: 3777
Joined: Sun 28 Sep 2008 11:54 pm
Weather Station: Davis VP2 Plus 24-Hour FARS
Operating System: Windows8 and Windows10
Location: Komoka, ON Canada
Contact:

Re: Missed end and Start Of Ywar

Post by PaulMy »

You have a VP2... with data logger? What is your logger interval? If 10 minutes then you have 17 days in the logger.

Enjoy,
Paul
Davis Vantage Pro2+
C1 www.komokaweather.com/komokaweather-ca
MX www.komokaweather.com/cumulusmx/index.htm /index.html /index.php
MX www.komokaweather.com/cumulusmxwll/index.htm /index.html /index.php
MX www. komokaweather.com/cumulusmx4/index.htm

Image
User avatar
SJG1976
Posts: 365
Joined: Wed 21 Dec 2011 11:04 am
Weather Station: Davis WLL, with Airlink
Operating System: Raspberry Pi3 MX on USB Drive
Location: Glemsford, Suffolk
Contact:

Re: Missed end and Start Of Ywar

Post by SJG1976 »

Hi Paul,

I was in a State of Transition at the time, so I now am using a Weather Link Live.

However I have the data missing for that period.

Im not too bothered about missing a few days Data bit just how to resolve the rollover part.

I can then start to edit data from my Dayfile or data on my website SQL database.
(or Hope I can anyway)

Hope that makes sense.

The actual data missing should only be 1 day but as the backup I restored was 30th December, I missed a week or so so the next block started about 6th Jan.

Oh and I need to update my profile to reflect the new hardware.
User avatar
SJG1976
Posts: 365
Joined: Wed 21 Dec 2011 11:04 am
Weather Station: Davis WLL, with Airlink
Operating System: Raspberry Pi3 MX on USB Drive
Location: Glemsford, Suffolk
Contact:

Re: Missed end and Start Of Ywar

Post by SJG1976 »

I've just looked on my SQL Data (which is generated from the (DAYFILE.TXT)

All the data is there.

Do I therefore need to just download the missing dates from the Dayfile on the SQL Copy on my webseevwr and add these to the XumulusMX Dayfile and process.

31-12-2021 to 05-01-2022. Are the data missing from my Raspberry Pi DAYFILE.txt

But the data is on the SqL database on the Website.

However the Dayfile on my Website is also missing the data hope that make sense..
User avatar
PaulMy
Posts: 3777
Joined: Sun 28 Sep 2008 11:54 pm
Weather Station: Davis VP2 Plus 24-Hour FARS
Operating System: Windows8 and Windows10
Location: Komoka, ON Canada
Contact:

Re: Missed end and Start Of Ywar

Post by PaulMy »

If you have Weatherlink Live and Weatherlink.com Pro subscription then you can go back quite a ways for catch up data.

Others may know better, but if you were to use a backup from before the failure and copy that in your current \data folder and then restart CumulusMX it should catch up from that backup date. I know the usual catch up that overlaps more than one day does the usual end-of-day processes and presume the same for year end rollover, but not sure on that...

If that catch up doesn't work for you, then you could add the missing data to your dayfile.txt but very important that it is in the correct format for dayfile.
However the Dayfile on my Website is also missing the data hope that make sense..
Once you dayfile.txt is up to date in your local \data folder then that updated file will be FTP at end-of-day if that is how you have CumulusMX set and your website data will then be complete.

Enjoy,
Paul
Davis Vantage Pro2+
C1 www.komokaweather.com/komokaweather-ca
MX www.komokaweather.com/cumulusmx/index.htm /index.html /index.php
MX www.komokaweather.com/cumulusmxwll/index.htm /index.html /index.php
MX www. komokaweather.com/cumulusmx4/index.htm

Image
User avatar
SJG1976
Posts: 365
Joined: Wed 21 Dec 2011 11:04 am
Weather Station: Davis WLL, with Airlink
Operating System: Raspberry Pi3 MX on USB Drive
Location: Glemsford, Suffolk
Contact:

Re: Missed end and Start Of Ywar

Post by SJG1976 »

Thanks Paul,

Looks like it's a lost cause
On a test Install I can put back the Dayfile Data it is all in the correct format.

But it hasn't resolved the end of year rollerober.

Looks like I may just have to see what happens at the end of the month.

I hthwr end of month processes do something different.
.either that or change the date and fool it too roll over itself then add the missing Dayfile data.

Thoughts welcome.
User avatar
PaulMy
Posts: 3777
Joined: Sun 28 Sep 2008 11:54 pm
Weather Station: Davis VP2 Plus 24-Hour FARS
Operating System: Windows8 and Windows10
Location: Komoka, ON Canada
Contact:

Re: Missed end and Start Of Ywar

Post by PaulMy »

Did you try by replacing your \data with ALL the files of a good backup from before year end, and starting CumulusMX? That should catch up with whatever data that is in the logger (and presume also does the year end rollover), including dayfile, log files, and the various .ini files. Updating the dayfile.txt by itself will not do anything about catching up previous data.

Enjoy,
Paul
Davis Vantage Pro2+
C1 www.komokaweather.com/komokaweather-ca
MX www.komokaweather.com/cumulusmx/index.htm /index.html /index.php
MX www.komokaweather.com/cumulusmxwll/index.htm /index.html /index.php
MX www. komokaweather.com/cumulusmx4/index.htm

Image
User avatar
SJG1976
Posts: 365
Joined: Wed 21 Dec 2011 11:04 am
Weather Station: Davis WLL, with Airlink
Operating System: Raspberry Pi3 MX on USB Drive
Location: Glemsford, Suffolk
Contact:

Re: Missed end and Start Of Ywar

Post by SJG1976 »

Hi Paul,

Yes the Good Backup I had only went up to the 30th Dec.

MX was running after this time, but when I went to make the change to WLL the USB I was running off was Corrupt. (6th Jan)

So I only had the backup from the 30th so missed the days

I rebuilt my install and copied my data back so had a

30th Dec then the next full data was from 7th Jan.

The bits in-between were missing.

Only noticed it the other day when I went to look a year Low Temp and it was a December reading.

I think I'm stuffed....
User avatar
mcrossley
Posts: 12695
Joined: Thu 07 Jan 2010 9:44 pm
Weather Station: Davis VP2/WLL
Operating System: Bullseye Lite rPi
Location: Wilmslow, Cheshire, UK
Contact:

Re: Missed end and Start Of Ywar

Post by mcrossley »

What Paul is saying, is restore all your data from the backup on the 30th. Then start CMX, it will download all the data from that point until now from the WeatherLink cloud.
User avatar
SJG1976
Posts: 365
Joined: Wed 21 Dec 2011 11:04 am
Weather Station: Davis WLL, with Airlink
Operating System: Raspberry Pi3 MX on USB Drive
Location: Glemsford, Suffolk
Contact:

Re: Missed end and Start Of Year

Post by SJG1976 »

Thanks both.

That is part of the issue.
I didn't have a Weatherlink Cloud Account then.

I only got the weather link cloud account setup about the 7th I think.

So the data will be missing.

I guess I can try...

Restore Data from 30th on that backup.
Run CumulusMX with VP2 Plugged in.

Let.it Dow load all the data it can find.

Then stop.mx
Set station back up to the WLL

Start again?

Or could I set up the VP2 on a PC.
Download the WeatherView Software to upload the data to Davis.

Let that sync.

Then restore backup to 30th Dec.

Then let it all roll and download again.

I just got stuck between a rock and a hardplace I think.

Last backup on one system (VP2 with Logger)
New data running on WLL, and the failure in the middle.
User avatar
mcrossley
Posts: 12695
Joined: Thu 07 Jan 2010 9:44 pm
Weather Station: Davis VP2/WLL
Operating System: Bullseye Lite rPi
Location: Wilmslow, Cheshire, UK
Contact:

Re: Missed end and Start Of Year

Post by mcrossley »

Sounds like you are right, no easy solution
User avatar
SJG1976
Posts: 365
Joined: Wed 21 Dec 2011 11:04 am
Weather Station: Davis WLL, with Airlink
Operating System: Raspberry Pi3 MX on USB Drive
Location: Glemsford, Suffolk
Contact:

Re: Missed end and Start Of Year

Post by SJG1976 »

Really Appreciate both your help.

Have Restored to the 30th as you both suggested.
And let Cumulus do it's thing.

It's now knows that the year is the correct year, and this months records are only showing the records for 2022 on the Edit Records Page.
On the first Colum it's still showing Values and Timestamps for 2021

I guess that's about as good as I can get without going though each file line by line.

But it is 100% better than it was so once again thank you both very much!!
User avatar
SJG1976
Posts: 365
Joined: Wed 21 Dec 2011 11:04 am
Weather Station: Davis WLL, with Airlink
Operating System: Raspberry Pi3 MX on USB Drive
Location: Glemsford, Suffolk
Contact:

Re: Missed end and Start Of Year

Post by SJG1976 »

Oh...
ANd going Forward.

What is the best way to keep the backups?

Is it just copy the Backup folder to somewhere safe?
At the moment I have a weekly copy of the all the folders.

I'm guessing that's overkill and it's not as easy to Automate!
User avatar
mcrossley
Posts: 12695
Joined: Thu 07 Jan 2010 9:44 pm
Weather Station: Davis VP2/WLL
Operating System: Bullseye Lite rPi
Location: Wilmslow, Cheshire, UK
Contact:

Re: Missed end and Start Of Year

Post by mcrossley »

I would take a one time copy* of your /data folder, then backup the /backup folder and your reports folders daily.

*The /backup only contains the current months log file, so this copies any older files.
User avatar
SJG1976
Posts: 365
Joined: Wed 21 Dec 2011 11:04 am
Weather Station: Davis WLL, with Airlink
Operating System: Raspberry Pi3 MX on USB Drive
Location: Glemsford, Suffolk
Contact:

Re: Missed end and Start Of Year

Post by SJG1976 »

Perfect.

Thanks Mark.

Now to try and find a way to push the backup off somewhere are it's zipped up.
Post Reply