Welcome to the Cumulus Support forum.

Latest Cumulus MX V3 release 3.28.6 (build 3283) - 21 March 2024

Cumulus MX V4 beta test release 4.0.0 (build 4017) - 17 March 2024

Legacy Cumulus 1 release v1.9.4 (build 1099) - 28 November 2014 (a patch is available for 1.9.4 build 1099 that extends the date range of drop-down menus to 2030)

Download the Software (Cumulus MX / Cumulus 1 and other related items) from the Wiki

Too many logs for New monthly record

Please DO NOT use this to publish your entire wish. This Forum is for specific suggestions to enhance the usability of Cumulus MX for all users, NOT your personal requirements. Please check this forum and the rejected forum to make sure you are NOT posting a DUPLICATE suggestion. It will be heavily monitored by Admin and Mark Crossley to determine the feasibility and the difficulty of the suggestion. Those Topics that are deemed inadmissible will moved to the rejected Forum. The remaining Topics will be the Accepted list of future developments, and when our voluntary development group adds it to a build, the build number will be added to the Topic title.
Post Reply
User avatar
HansR
Posts: 5870
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: GW1100 (WS80/WH40)
Operating System: Raspberry OS/Bullseye
Location: Wagenborgen (NL)
Contact:

Too many logs for New monthly record

Post by HansR »

I found this in the MXdiags:

Code: Select all

2022-02-17 16:40:23.280 SFTP[Int]: Uploading daily graph data files
2022-02-17 16:40:23.280 SFTP[Int]: Done uploading daily graph data files
2022-02-17 16:41:00.429 New monthly record: month = 02: New time = 2022-02-17 16:41, new value = 619,259 "High daily windrun" prev time = 2022-02-17 16:40, prev value = 618,568
2022-02-17 16:42:00.439 New monthly record: month = 02: New time = 2022-02-17 16:42, new value = 619,952 "High daily windrun" prev time = 2022-02-17 16:41, prev value = 619,259
2022-02-17 16:43:00.440 New monthly record: month = 02: New time = 2022-02-17 16:43, new value = 620,634 "High daily windrun" prev time = 2022-02-17 16:42, prev value = 619,952
2022-02-17 16:44:00.450 New monthly record: month = 02: New time = 2022-02-17 16:44, new value = 621,277 "High daily windrun" prev time = 2022-02-17 16:43, prev value = 620,634
2022-02-17 16:45:00.462 New monthly record: month = 02: New time = 2022-02-17 16:45, new value = 621,908 "High daily windrun" prev time = 2022-02-17 16:44, prev value = 621,277
2022-02-17 16:45:01.849 DoLogFile: Writing log entry for 17-2-2022 16:45:00
2022-02-17 16:45:01.850 DoLogFile: log entry for 17-2-2022 16:45:00 written
2022-02-17 16:45:01.852 Writing today.ini, LastUpdateTime = 17-2-2022 16:45:00 raindaystart = 152,0952 rain counter = 152,1968
2022-02-17 16:45:01.961 Windy: ERROR - The SSL connection could not be established, see inner exception.
2022-02-17 16:46:00.475 New monthly record: month = 02: New time = 2022-02-17 16:46, new value = 622,490 "High daily windrun" prev time = 2022-02-17 16:45, prev value = 621,908
2022-02-17 16:47:00.476 New monthly record: month = 02: New time = 2022-02-17 16:47, new value = 623,067 "High daily windrun" prev time = 2022-02-17 16:46, prev value = 622,490
2022-02-17 16:48:00.492 New monthly record: month = 02: New time = 2022-02-17 16:48, new value = 623,630 "High daily windrun" prev time = 2022-02-17 16:47, prev value = 623,067
2022-02-17 16:49:00.500 New monthly record: month = 02: New time = 2022-02-17 16:49, new value = 624,174 "High daily windrun" prev time = 2022-02-17 16:48, prev value = 623,630
2022-02-17 16:50:00.477 New monthly record: month = 02: New time = 2022-02-17 16:50, new value = 624,715 "High daily windrun" prev time = 2022-02-17 16:49, prev value = 624,174
2022-02-17 16:50:01.947 DoLogFile: Writing log entry for 17-2-2022 16:50:00
2022-02-17 16:50:01.948 DoLogFile: log entry for 17-2-2022 16:50:00 written
2022-02-17 16:50:01.950 Writing today.ini, LastUpdateTime = 17-2-2022 16:50:00 raindaystart = 152,0952 rain counter = 152,1968
This influences the size of the alltime log files.

Wouldn't it be a good idea to log these (type of) records on a less high frequency (once per day just before rollover).
There are probably more records which could be logged less. I just see my alltime logs grow to over 10 Mb in under 3 years.
Maybe it could even be a log which could deleted?
Anybody using it?
Hans

https://meteo-wagenborgen.nl
CMX build 4017+ ● RPi 3B+ ● Raspbian Linux 6.1.21-v7+ armv7l ● dotnet 8.0.3
User avatar
PaulMy
Posts: 3775
Joined: Sun 28 Sep 2008 11:54 pm
Weather Station: Davis VP2 Plus 24-Hour FARS
Operating System: Windows8 and Windows10
Location: Komoka, ON Canada
Contact:

Re: Too many logs for New monthly record

Post by PaulMy »

My alltimelog goes back to 2011-03-03 (not sure the first two and a half years before went?) and it is 241 kb.
That seems quite small compared to the other logs: monthly alltime = 876 kb, monthly logs (5-min interval) 1200 kb and Airlink about the same, Extra log monthly 2700 kb.
Now grant it, the alltimelog entry description was much smaller up until 2020-07-28, and now more items added. So far I've only got 11 entries in 2022 all on the same day for lowfeelslike.

The consecutive repeat in alltime shows the period when the record was set - i.e. Lowfeelslike from 5:33 to 07:39 on 2021-02-17 for a total of 57 logs and 2022-01-29 7:16 to 7:29 for 11 entries, and is quite interesting. Now I admit I don't look at it often but still interesting. No need to change it!

Enjoy,
Paul
Davis Vantage Pro2+
C1 www.komokaweather.com/komokaweather-ca
MX www.komokaweather.com/cumulusmx/index.htm /index.html /index.php
MX www.komokaweather.com/cumulusmxwll/index.htm /index.html /index.php
MX www. komokaweather.com/cumulusmx4/index.htm

Image
User avatar
mcrossley
Posts: 12689
Joined: Thu 07 Jan 2010 9:44 pm
Weather Station: Davis VP2/WLL
Operating System: Bullseye Lite rPi
Location: Wilmslow, Cheshire, UK
Contact:

Re: Too many logs for New monthly record

Post by mcrossley »

You can always delete the log files periodically if you feel the need to free up the disk space, but 10 MB is equivalent of what, a few photographs?
They are useful when you get a data spike affecting your records, you can retrieve the exact previous value and time rather than getting the values from the logs.
And of course the rate of writing to them drops off with time, mine barely get written to from month to month now.
User avatar
HansR
Posts: 5870
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: GW1100 (WS80/WH40)
Operating System: Raspberry OS/Bullseye
Location: Wagenborgen (NL)
Contact:

Re: Too many logs for New monthly record

Post by HansR »

Yes, you all are right of course, and i can throw it away etc.
But i was mainly triggered by the fact that this record is written every minute which seems superfluous.
But anyway i dumped the idea in the suggestions because i know it is not hot, not a bug and not a real issue.
But i do think it could use a review per type of record to add some 'intelligence' .
Maybe when the dust settles and things slow down i'll take a look myself
Hans

https://meteo-wagenborgen.nl
CMX build 4017+ ● RPi 3B+ ● Raspbian Linux 6.1.21-v7+ armv7l ● dotnet 8.0.3
freddie
Posts: 2434
Joined: Wed 08 Jun 2011 11:19 am
Weather Station: Davis Vantage Pro 2 + Ecowitt
Operating System: GNU/Linux Ubuntu 22.04 LXC
Location: Alcaston, Shropshire, UK
Contact:

Re: Too many logs for New monthly record

Post by freddie »

In my opinion I think it is done correctly as it stands. Whenever a record is broken, the event is logged. True it does seem like overkill when your site is quite young, but as @mcrossley states the writes to this file get much less as a site matures.
Freddie
Image
User avatar
HansR
Posts: 5870
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: GW1100 (WS80/WH40)
Operating System: Raspberry OS/Bullseye
Location: Wagenborgen (NL)
Contact:

Re: Too many logs for New monthly record

Post by HansR »

It can be both correct and at the same time superfluous and useless.
Hans

https://meteo-wagenborgen.nl
CMX build 4017+ ● RPi 3B+ ● Raspbian Linux 6.1.21-v7+ armv7l ● dotnet 8.0.3
Post Reply