CUtils 6.21 3

[AndyKF650]

Hi Hans

This new update installed correctly and works just fine.

I like the treatment of the realtime values on the LHS of the CustomLogs screen and have set up some additional charts for the average weather stats and year to date rain, solar and ET, these will hopefully show up in the morning and provide an interesting long term chart of this information.

One thing I would rather have is a freeform chart title rather than the proscribed "Trend Chart of Custom Log" which then adds the name of the customlog to the title. I know it can be changed in the CUtilsCharts.def file but hey I can ask.

[HansR]

Hi Andy,

Thanks.

One thing I would rather have is a freeform chart title rather than the proscribed "Trend Chart of Custom Log" which then adds the name of the customlog to the title. I know it can be changed in the CUtilsCharts.def file but hey I can ask.

Yes, you can ask

1. The fixed part in the title is the name of the CustomList i.e. it is the same as the dropdown menu item.
2. The Trend chart etc... part can be changed in the language file section [CustomLogs] and even emptied.
3. The title can be changed in the CutilsCharts.def, true. But only of you set the user modification parameter (e.g. UserModificationCustomLogsCharts for the CustomLogs) to true. If you don't, the chart will be overwritten every generation cycle. I find it easier to have these charts always generated automatically and have the definition of the CustomLogs play the rol of chartdesigner: the order of the webtags, the name of the CustomLog, the amount of tags already define the chart to a high degree. You can then copy the indivdual PLOT line(s) to another self defined chart in the first section of the CutilsCharts.def file for combination with the sensor charts and/or copy it to another output where you can give it your specific titles. At the moment the CustomLog charts are recognisable for everybody.

In short, atm I don't think having the title completely free format is a good idea (and apart from the CutomLog name it already is free format )

[AndyKF650]

Hi Hans

Thanks for that, I really should read to the bottom of the language file where I would have seen the solution to my problem.

I understand and agree with your reticence in changing the titles to free form text, now I have to rethink my way forward.

[HansR]

Thanks for that, I really should read to the bottom of the language file where I would have seen the solution to my problem.

I understand and agree with your reticence in changing the titles to free form text, now I have to rethink my way forward.

One thing to add: if you change the name of a CustomLog, you effectively create a new log and with that you may lose your data. You may copy the data to the new log and as such you do not have to all start over. Happy rethinking

[AndyKF650]

Hi Hans

Following on from this update I have rearranged my custom log charts and set up new titles for the recent data. Now I am getting no information on the Recent charts but the Daily charts seem to be working fine. The realtime panel is working as expected.

Looking at the RecentData.json there is no information on that and when I run the usual 15min update cmd it says that that the log files need a

Error CustomLogs ReadRecentCustomLog: Require data/TemperatureCL-202312.txt to continue but it does not exist, continuing with next CustomsLog

This I assume is the problem but why since we are still in November month 11.

The log file is attached and I would appeciate your input.

[HansR]

Hi Andy,

My analysis is as follows:

If we look at this fragment of the logfile:

Code: Select all

2023-11-08 08:15:06.898 Information CustomLogs ReadRecentCustomLog: TemperatureCL
2023-11-08 08:15:06.899 Information CustomLogs ReadRecentCustomLog: data/TemperatureCL-202311.txt - Start: 08/11/2023 08:01:00 ; End: 08/11/2023 08:15:00 ;
2023-11-08 08:15:06.914 Information CustomLogs ReadRecentCustomLog: Deciding: tmp.Date: 08/11/2023 08:14:00 ; End: 08/11/2023 08:15:00 ; thisList.Last: 08/11/2023 08:14:00
2023-11-08 08:15:06.914 Information CustomLogs ReadRecentCustomLog: Require the  next logfile: data/TemperatureCL-202312.txt
2023-11-08 08:15:06.915 Error CustomLogs ReadRecentCustomLog: Require data/TemperatureCL-202312.txt to continue but it does not exist, continuing with next CustomsLog

We see that the last value read from the logfile is of 08/11/2023 08:14:00 while the run for the JSON creation is already running at 08/11/2023 08:15:00 (the end datetime for the 15 minute logging). As a result it decides the last value read is not the end date and CUtils wants to read the next logfile hoping for more values. The logic of the algorithm is that UserAskedData is run when the EndDate logging has been made.

It is a situation which should not occur but apparently the UserAskedData run starts on another clock - crontab? - than the logging of CMX (it starts at 8:15:06 but before the logging of the 8:15 data is finished / present by CMX - maybe the logging data is not flushed).

If this keeps happening then:

1. Check your clocks of the different devices (but CUtils runs on the same machine as CMX so...???)
2. Check with Mark the timing of the CustomLogs registration - NOTE: apparently you have several CustomLogs and you are logging quite some webtags. It may be that this is taking a bit more time than expected and maybe that is why CMX gets off course. But a minute for the logging seems a lot to me.
3. As a workaround, could you try running UserAskedData one or two minutes later? So far I do not see it as a true bug in CUtils.

I'll likely am busy doing other things this morning, I'll check back this afternoon.

[HansR]

I suddenly realise that CMX is apparently logging from minutes 00 - 14, 15 - 29, 30 - 44 etc... and for 5 minute logging probably from 00 - 04, 05 - 09 etc... If that is so (@Mark to confirm), I may have to adjust the timing of the logging / UserAskedData reading.

[HansR]

On the other hand: I use a five minute logging and that does not lead to similar issues (i.e. logging is from 01 - 05, 06 - 10 etc...)

[mcrossley]

MX definitely logs on the interval multiples starting at zero

[mcrossley]

Let's see the MX log I think

[AndyKF650]

For me the strange thing was that before I changed the custom log chart titles, I simplified them to remove "CustomLog" it all worked with no issues and then after the change I am left with the problems as seen.

The MX Diags log shows no errors but let me know if you want me to turn on the additional logging.

[HansR]

OK, you have the MXdiags from Andy, find attached a 5 minutes log from me. You will see it logs every five minutes so the period is from 01 - 05 and that is what I read. For 15 minutes I do similar from 01 - 15 etc... Let's see a 15 minute CustomLog from Andy.

[mcrossley]

The custom log entry creation entries are at debug level, so not in Andy's log file. Andy, could you turn on debug logging then post an updated log file after half an hour or so.

[AndyKF650]

Hi Mark

As requested here is the MXDiags log with debug logging on for 3/4hr.

[HansR]

Could you add one 15 minute log for me Andy? Thanks.