Welcome to the Cumulus Support forum.

Latest Cumulus MX V4 release 4.4.2 (build 4085) - 12 March 2025

Latest Cumulus MX V3 release 3.28.6 (build 3283) - 21 March 2024

Legacy Cumulus 1 release 1.9.4 (build 1099) - 28 November 2014
(a patch is available for 1.9.4 build 1099 that extends the date range of drop-down menus to 2030)

Download the Software (Cumulus MX / Cumulus 1 and other related items) from the Wiki

If you are posting a new Topic about an error or if you need help PLEASE read this first viewtopic.php?p=164080#p164080

Ecowitt Api Historic Data

From build 3044 the development baton passed to Mark Crossley. Mark has been responsible for all the Builds since. He has made the code available on GitHub. It is Mark's hope that others will join in this development, but at the very least he welcomes your ideas for future developments (see Cumulus MX Development suggestions).

Moderator: mcrossley

Box
Posts: 53
Joined: Sun 15 Nov 2020 8:57 am
Weather Station: FineOffset Gw1002
Operating System: Win10

Re: Ecowitt Api Historic Data

Post by Box »

mcrossley wrote: Wed 16 Mar 2022 5:26 pm You would need to go back to a backup from before "the gap". The logs you posted were from after.
The screen shot showed going back to 22 Feb which was before, but there were no logs from that run.
ok

Strange, I thought I had done that

Maybe I misread the folder

I will try again
Phil23
Posts: 888
Joined: Sat 16 Jul 2016 11:59 pm
Weather Station: Davis VP2+ & GW1000 (Standalone)
Operating System: Win10 Pro / rPi Buster
Location: Australia

Re: Ecowitt Api Historic Data

Post by Phil23 »

mcrossley wrote: Wed 16 Mar 2022 2:48 pm You have the same error as @box was getting "API.GetHistoricData: Exception:"
I have a new build to fix this.
So I assume I can just keep letting things run for the time being & then when the next build is relaeased,
revert to my 9:05am 15/03 data & then restart & let it all process.

Will make sure I have the most relevant level of debugging on when I get to that point.
:Now: :Today/Yesterday:

Image

Main Station Davis VP2+ Running Via Win10 Pro.
Secondary Stations, Ecowitt HP2551/GW1000 Via rPi 3 & 4 Running Buster GUI.
:Local Inverell Ecowitt Station: :Remote Ashford Ecowitt Station:
Box
Posts: 53
Joined: Sun 15 Nov 2020 8:57 am
Weather Station: FineOffset Gw1002
Operating System: Win10

Re: Ecowitt Api Historic Data

Post by Box »

Box wrote: Wed 16 Mar 2022 7:46 pm
mcrossley wrote: Wed 16 Mar 2022 5:26 pm You would need to go back to a backup from before "the gap". The logs you posted were from after.
The screen shot showed going back to 22 Feb which was before, but there were no logs from that run.
ok

Strange, I thought I had done that

Maybe I misread the folder

I will try again
Success!!!

I used a backup from before 'the gap' AND deleted my Mar22log.txt file (backed up first of course 8-)), then ran CMX 3172 and the whole mar22log.txt file was reconstructed with 'the gap' filled in

:clap: :clap: :clap:


Many thanks for your help
Phil23
Posts: 888
Joined: Sat 16 Jul 2016 11:59 pm
Weather Station: Davis VP2+ & GW1000 (Standalone)
Operating System: Win10 Pro / rPi Buster
Location: Australia

Re: Ecowitt Api Historic Data

Post by Phil23 »

mcrossley wrote: Wed 16 Mar 2022 5:26 pm You would need to go back to a backup from before "the gap".
I "Thought" I tried my midnight one before the 9:00 last update issue, but maybe the Linux archiver didn't overwrite as expected.
Box wrote: Wed 16 Mar 2022 10:53 pm Success!!!

I used a backup from before 'the gap' AND deleted my Mar22log.txt file (backed up first of course 8-)), then ran CMX 3172 and the whole mar22log.txt file was reconstructed with 'the gap' filled in

:clap: :clap: :clap:
I may not have that option now due to my backup rotation.
Only have the March 15th 9:05am backup preserved.
Would be no data prior to the above date if I deleted Mar2log.txt

Presently when I restore that I end up with a gap from 9:00am 15th up to the time I start MX after the restore.

Phil.
:Now: :Today/Yesterday:

Image

Main Station Davis VP2+ Running Via Win10 Pro.
Secondary Stations, Ecowitt HP2551/GW1000 Via rPi 3 & 4 Running Buster GUI.
:Local Inverell Ecowitt Station: :Remote Ashford Ecowitt Station:
Box
Posts: 53
Joined: Sun 15 Nov 2020 8:57 am
Weather Station: FineOffset Gw1002
Operating System: Win10

Re: Ecowitt Api Historic Data

Post by Box »

Phil23 wrote: Thu 17 Mar 2022 1:41 am
mcrossley wrote: Wed 16 Mar 2022 5:26 pm You would need to go back to a backup from before "the gap".
I "Thought" I tried my midnight one before the 9:00 last update issue, but maybe the Linux archiver didn't overwrite as expected.
Box wrote: Wed 16 Mar 2022 10:53 pm Success!!!

I used a backup from before 'the gap' AND deleted my Mar22log.txt file (backed up first of course 8-)), then ran CMX 3172 and the whole mar22log.txt file was reconstructed with 'the gap' filled in

:clap: :clap: :clap:
I may not have that option now due to my backup rotation.
Only have the March 15th 9:05am backup preserved.
Would be no data prior to the above date if I deleted Mar2log.txt

Presently when I restore that I end up with a gap from 9:00am 15th up to the time I start MX after the restore.

Phil.
If you backed up previous installs before upgrades you should have some older backups squirrelled away if you dig

The one I used was from three version ago

I never delete anything, just bung it in an Old Cumulus folder
Check your recycle bin?

Good luck!
User avatar
PaulMy
Posts: 4355
Joined: Sun 28 Sep 2008 11:54 pm
Weather Station: Davis VP2 Plus 24-Hour FARS
Operating System: Windows8 and Windows10
Location: Komoka, ON Canada
Contact:

Re: Ecowitt Api Historic Data

Post by PaulMy »

The issue with going back too far for historical backup data is that it may miss some of the extremes that are logged with live data. Logger data is recorded at what it is at the logging interval time. While running, Cumulus saves highs and lows from ongoing live data from the station. But at start up Cumulus gets the data provided from the logger, which may have missed some highs and lows between logging times. So in restoring from backup I try to find the latest prior to a data loss/corruption issue - check dayfile and month log files, and also keep in mind how far back the Davis logger has data. This past logged data may not be an issue if Ecowitt data access is unlimited.

Enjoy,
Paul
VP2+
C1 www.komokaweather.com/komokaweather-ca
MX https://komokaweather.com/cumulusmx/index.htm /index.html /index.php
MX https://komokaweather.com/cumulusmxwll/index.htm /index.html /index.php
MX https:// komokaweather.com/cumulusmx4/index.htm
Image
Box
Posts: 53
Joined: Sun 15 Nov 2020 8:57 am
Weather Station: FineOffset Gw1002
Operating System: Win10

Re: Ecowitt Api Historic Data

Post by Box »

PaulMy wrote: Thu 17 Mar 2022 2:58 pm The issue with going back too far for historical backup data is that it may miss some of the extremes that are logged with live data. Logger data is recorded at what it is at the logging interval time. While running, Cumulus saves highs and lows from ongoing live data from the station. But at start up Cumulus gets the data provided from the logger, which may have missed some highs and lows between logging times. So in restoring from backup I try to find the latest prior to a data loss/corruption issue - check dayfile and month log files, and also keep in mind how far back the Davis logger has data. This past logged data may not be an issue if Ecowitt data access is unlimited.

Enjoy,
Paul
Good point

My backup was about 3 weeks old. I guess it might be a good idea to stop/start CMX regularly, say every few days, to generate more backups?
freddie
Posts: 2870
Joined: Wed 08 Jun 2011 11:19 am
Weather Station: Davis Vantage Pro 2 + Ecowitt
Operating System: GNU/Linux Ubuntu 24.04 LXC
Location: Alcaston, Shropshire, UK
Contact:

Re: Ecowitt Api Historic Data

Post by freddie »

Box wrote: Thu 17 Mar 2022 5:38 pm
PaulMy wrote: Thu 17 Mar 2022 2:58 pm The issue with going back too far for historical backup data is that it may miss some of the extremes that are logged with live data. Logger data is recorded at what it is at the logging interval time. While running, Cumulus saves highs and lows from ongoing live data from the station. But at start up Cumulus gets the data provided from the logger, which may have missed some highs and lows between logging times. So in restoring from backup I try to find the latest prior to a data loss/corruption issue - check dayfile and month log files, and also keep in mind how far back the Davis logger has data. This past logged data may not be an issue if Ecowitt data access is unlimited.

Enjoy,
Paul
Good point

My backup was about 3 weeks old. I guess it might be a good idea to stop/start CMX regularly, say every few days, to generate more backups?
Backups are performed daily as routine. Do you need more frequent than that?
Freddie
Image
Box
Posts: 53
Joined: Sun 15 Nov 2020 8:57 am
Weather Station: FineOffset Gw1002
Operating System: Win10

Re: Ecowitt Api Historic Data

Post by Box »

freddie wrote: Thu 17 Mar 2022 6:39 pm
Box wrote: Thu 17 Mar 2022 5:38 pm
PaulMy wrote: Thu 17 Mar 2022 2:58 pm The issue with going back too far for historical backup data is that it may miss some of the extremes that are logged with live data. Logger data is recorded at what it is at the logging interval time. While running, Cumulus saves highs and lows from ongoing live data from the station. But at start up Cumulus gets the data provided from the logger, which may have missed some highs and lows between logging times. So in restoring from backup I try to find the latest prior to a data loss/corruption issue - check dayfile and month log files, and also keep in mind how far back the Davis logger has data. This past logged data may not be an issue if Ecowitt data access is unlimited.

Enjoy,
Paul
Good point

My backup was about 3 weeks old. I guess it might be a good idea to stop/start CMX regularly, say every few days, to generate more backups?
Backups are performed daily as routine. Do you need more frequent than that?
Not sure how the backup system works, the named folders are not 24 hours apart but 24 hours is more than enough
Box
Posts: 53
Joined: Sun 15 Nov 2020 8:57 am
Weather Station: FineOffset Gw1002
Operating System: Win10

Re: Ecowitt Api Historic Data

Post by Box »

Box wrote: Thu 17 Mar 2022 9:36 pm
freddie wrote: Thu 17 Mar 2022 6:39 pm
Box wrote: Thu 17 Mar 2022 5:38 pm

Good point

My backup was about 3 weeks old. I guess it might be a good idea to stop/start CMX regularly, say every few days, to generate more backups?
Backups are performed daily as routine. Do you need more frequent than that?
Not sure how the backup system works, the named folders are not 24 hours apart but 24 hours is more than enough
Since found the daily backup folders👍
User avatar
mcrossley
Posts: 14388
Joined: Thu 07 Jan 2010 9:44 pm
Weather Station: Davis VP2/WLL
Operating System: Bullseye Lite rPi
Location: Wilmslow, Cheshire, UK
Contact:

Re: Ecowitt Api Historic Data

Post by mcrossley »

The patched release 3.15.3 is now available.
Box
Posts: 53
Joined: Sun 15 Nov 2020 8:57 am
Weather Station: FineOffset Gw1002
Operating System: Win10

Re: Ecowitt Api Historic Data

Post by Box »

mcrossley wrote: Sun 20 Mar 2022 5:41 pm The patched release 3.15.3 is now available.
Many thanks for your help
Post Reply