Page 1 of 1

Too many logs for New monthly record

Posted: Thu 17 Feb 2022 3:57 pm
by HansR
I found this in the MXdiags:

Code: Select all

2022-02-17 16:40:23.280 SFTP[Int]: Uploading daily graph data files
2022-02-17 16:40:23.280 SFTP[Int]: Done uploading daily graph data files
2022-02-17 16:41:00.429 New monthly record: month = 02: New time = 2022-02-17 16:41, new value = 619,259 "High daily windrun" prev time = 2022-02-17 16:40, prev value = 618,568
2022-02-17 16:42:00.439 New monthly record: month = 02: New time = 2022-02-17 16:42, new value = 619,952 "High daily windrun" prev time = 2022-02-17 16:41, prev value = 619,259
2022-02-17 16:43:00.440 New monthly record: month = 02: New time = 2022-02-17 16:43, new value = 620,634 "High daily windrun" prev time = 2022-02-17 16:42, prev value = 619,952
2022-02-17 16:44:00.450 New monthly record: month = 02: New time = 2022-02-17 16:44, new value = 621,277 "High daily windrun" prev time = 2022-02-17 16:43, prev value = 620,634
2022-02-17 16:45:00.462 New monthly record: month = 02: New time = 2022-02-17 16:45, new value = 621,908 "High daily windrun" prev time = 2022-02-17 16:44, prev value = 621,277
2022-02-17 16:45:01.849 DoLogFile: Writing log entry for 17-2-2022 16:45:00
2022-02-17 16:45:01.850 DoLogFile: log entry for 17-2-2022 16:45:00 written
2022-02-17 16:45:01.852 Writing today.ini, LastUpdateTime = 17-2-2022 16:45:00 raindaystart = 152,0952 rain counter = 152,1968
2022-02-17 16:45:01.961 Windy: ERROR - The SSL connection could not be established, see inner exception.
2022-02-17 16:46:00.475 New monthly record: month = 02: New time = 2022-02-17 16:46, new value = 622,490 "High daily windrun" prev time = 2022-02-17 16:45, prev value = 621,908
2022-02-17 16:47:00.476 New monthly record: month = 02: New time = 2022-02-17 16:47, new value = 623,067 "High daily windrun" prev time = 2022-02-17 16:46, prev value = 622,490
2022-02-17 16:48:00.492 New monthly record: month = 02: New time = 2022-02-17 16:48, new value = 623,630 "High daily windrun" prev time = 2022-02-17 16:47, prev value = 623,067
2022-02-17 16:49:00.500 New monthly record: month = 02: New time = 2022-02-17 16:49, new value = 624,174 "High daily windrun" prev time = 2022-02-17 16:48, prev value = 623,630
2022-02-17 16:50:00.477 New monthly record: month = 02: New time = 2022-02-17 16:50, new value = 624,715 "High daily windrun" prev time = 2022-02-17 16:49, prev value = 624,174
2022-02-17 16:50:01.947 DoLogFile: Writing log entry for 17-2-2022 16:50:00
2022-02-17 16:50:01.948 DoLogFile: log entry for 17-2-2022 16:50:00 written
2022-02-17 16:50:01.950 Writing today.ini, LastUpdateTime = 17-2-2022 16:50:00 raindaystart = 152,0952 rain counter = 152,1968
This influences the size of the alltime log files.

Wouldn't it be a good idea to log these (type of) records on a less high frequency (once per day just before rollover).
There are probably more records which could be logged less. I just see my alltime logs grow to over 10 Mb in under 3 years.
Maybe it could even be a log which could deleted?
Anybody using it?

Re: Too many logs for New monthly record

Posted: Thu 17 Feb 2022 5:13 pm
by PaulMy
My alltimelog goes back to 2011-03-03 (not sure the first two and a half years before went?) and it is 241 kb.
That seems quite small compared to the other logs: monthly alltime = 876 kb, monthly logs (5-min interval) 1200 kb and Airlink about the same, Extra log monthly 2700 kb.
Now grant it, the alltimelog entry description was much smaller up until 2020-07-28, and now more items added. So far I've only got 11 entries in 2022 all on the same day for lowfeelslike.

The consecutive repeat in alltime shows the period when the record was set - i.e. Lowfeelslike from 5:33 to 07:39 on 2021-02-17 for a total of 57 logs and 2022-01-29 7:16 to 7:29 for 11 entries, and is quite interesting. Now I admit I don't look at it often but still interesting. No need to change it!

Enjoy,
Paul

Re: Too many logs for New monthly record

Posted: Thu 17 Feb 2022 5:17 pm
by mcrossley
You can always delete the log files periodically if you feel the need to free up the disk space, but 10 MB is equivalent of what, a few photographs?
They are useful when you get a data spike affecting your records, you can retrieve the exact previous value and time rather than getting the values from the logs.
And of course the rate of writing to them drops off with time, mine barely get written to from month to month now.

Re: Too many logs for New monthly record

Posted: Thu 17 Feb 2022 5:58 pm
by HansR
Yes, you all are right of course, and i can throw it away etc.
But i was mainly triggered by the fact that this record is written every minute which seems superfluous.
But anyway i dumped the idea in the suggestions because i know it is not hot, not a bug and not a real issue.
But i do think it could use a review per type of record to add some 'intelligence' .
Maybe when the dust settles and things slow down i'll take a look myself

Re: Too many logs for New monthly record

Posted: Thu 17 Feb 2022 6:30 pm
by freddie
In my opinion I think it is done correctly as it stands. Whenever a record is broken, the event is logged. True it does seem like overkill when your site is quite young, but as @mcrossley states the writes to this file get much less as a site matures.

Re: Too many logs for New monthly record

Posted: Thu 17 Feb 2022 8:10 pm
by HansR
It can be both correct and at the same time superfluous and useless.