CUtils v7.3.0 beta

[PaulMy]

Hi Hans,
Beta 6 seems good here. However, I'd like to revisit the snow page Diary Report https://www.komokaweather.com/cumulusmx ... iaryReport
1. The measured snow in TableView is in 2 decimals but diary entries for mm is limited to 1 decimal. Can the display be changed? The ChartView correctly shows the values to 1 decimal when hovering on a date bar.
2. The dashes --- for both 0 (zero) diary entries and blank dates or future dates in the TableView don't 'look' accurate. Showing different for 0 entry and blank would be preferred. I know you had commented on this before but observing it in more I wanted to mention it.

p.s. I've lost the Diary option on the Reports tab so need to do some digging

Enjoy,
Paul

[HansR]

Hi Paul,

I'll use single digits for cm and double digits for in.
We'll get back on the dashes later.
For now I would like to have stable CMX and CUtils situation.
Too many changes recently

We'll go for the release now and fine tune later.
Hope you understand.

[PaulMy]

Hi Hans,
Yes that would be great to have a look. I thought I'd mention it now while CMX and CUtils are still in bata.

I am not there yet on the moon image, and the modified About and Menu is coming along.

Enjoy,
Paul

[HansR]

I am not there yet on the moon image, and the modified About and Menu is coming along.

Don't get this but we'll find out after the releases

[PaulMy]

Hi Hans,

Don't get this but we'll find out after the releases

No worries... I have found my problem and fixed the menu and About pages so that is all good. Only thing is that the moon image is not displaying in the home page. And the same for v7.2.0 site so I must have something wrong but haven't found it yet.

Enjoy,
Paul

[HansR]

2. The dashes --- for both 0 (zero) diary entries and blank dates or future dates in the TableView don't 'look' accurate. Showing different for 0 entry and blank would be preferred. I know you had commented on this before but observing it in more I wanted to mention it.

Hi Paul,

Just changed the unit (now correct) and thought to have a look at the dashes too.

There are three different possibilities:

1. there is no record for the date at all => one set of dashes in the middle of the columns 24 hrs and Snow
2. both columns 24 hrs and Snow have a value on a date => that value is shown in the respective columns (note that the value can be 0)
3. If one of the columns has no value at all (IsDBnull == true) that is shown as 0

Note that in all cases an entry of 0 is seen as a value.

This is how the value will be shown in the final release, in the beta's if the value was 0, there were also dashes. That will change.
(check my beta site)

[PaulMy]

Hi Hans,
Thanks, that looks great on your site.

However, I am at a bit of delay of doing any updates and uploading. Yesterday both my WiFiLogger and Weatherlink Live stopped connecting to my network within a few hours of each other and nothing I could do to make them work so had to shutdown both CumulusMXs. I couldn't reach Davis on the WLL so waiting to call them in a couple of hours. I also emailed Wojtek on the WiFiLogger issue. I heard back from Wojtek this morning, but lo and behold, the WiFiLogger had come back to life sometime after midnight. beta 6 is on my WLL test system so don't have this running yet (WLL allows more than 1 CMX at the same time but WiFiLogger only 1).

Enjoy,
Paul

[AndyKF650]

Hi Hans

The Beta 6 looks ok on my site now.

I had been having issues with my site provider blocking my attempts to update information. This has been sorted now.

[sutne]

Beta 6 is ok on my site.
I am not sure of the use of Diary. CMX is presenting snowdepth as a graf. I think that will be a more standarized way to do it. I have ordered a LDS01, so we will see when this can be automized.

[HansR]

@Paul, @Andy, @Steinar: thanks for responding.

And good luck with the tech issues

@Steinar: if the CMX snowchart is enough for you: fine. The report - the numbers - are the db output similar to NOAA, YADR and alike. The chart is like similar to what CMX has to offer as are all charts (the CUtils chart is actually similar to the CMX snowchart). So I do not really understand what you are saying here.

All kind of reports are made by the CMX dashboard. But this is for a website and so far I have not really seen any snow reporting. This report was made after what Paul uses for his reporting and what had been attempted before by somebody else. Hope this explains.

And yes, I will look ate the laser too: although I have hardly any snow I am going to try to use it for groundwater level or water level in the ditch.

[sutne]

Hans,
I know Diary is a historical thing from when we did not have any sensor that could measure sbowdepth the same way we measure anything else. It was manually recorded in a diary.
When we hopefully will have this automated, the presentation should be like everything else, in Reports and Charts.
Then I also have a question about Airquality, why is it treated different than the others, why is it not one of the charts?

[HansR]

I know Diary is a historical thing from when we did not have any sensor that could measure sbowdepth the same way we measure anything else. It was manually recorded in a diary.
When we hopefully will have this automated, the presentation should be like everything else, in Reports and Charts.

As far as I can see the automated laser/snow will register snow in the diary db. So that leaves things pretty much the same.
But yes, when used as an extra sensor they will likely be reported like an extra sensor too.

Then I also have a question about Airquality, why is it treated different than the others, why is it not one of the charts?

AirQuality like the AirLink is a very different sensor (within CMX see AirLink vs Extra Sensors). When introduced some years ago the AirLink fell out of the regular handling of the sensors and - most important - it has its own datafile. So in CUtils that had consequences as well: too many possibilities to chart to handle it the regular way. Note that the Ecowitt particulate matter sensors are handled as Extra Sensors and not similar to AirLink. It all may seem as inconsistency, I don't think it is. It all is a consequence of choices made within CMX, mostly as a consequence of the ascii database.

And having said that on the AirLink, with respect to snow you must realise that snow is registered in a SQLite database which is also a different datafile (compared to the ascii database) which leads to different reporting. You can get snow data in webtags but to report on the historical data you need to read all data.

And reading and using all data is in general the distinction between CUtils and other reporting tools. Although the standard CMX website did catch up with the RECENT and DAILY data, there still is no statistical charting module nor is there a possibility to create charts where data, webtags and calculations can be combined. CUtils can do that.


In general there is data for

1. The normal weatherstation sensors are stored in dayfile.txt and e.g. 202411.txt
2. Extra sensors are stored in e.g. Extralog202411 (note pm sensors Ecowitt are stored here)
3. AirLink (Davis) is stored in e.g. AirLink202411log.txt
4. Snow is stored in diary.db
5. CustomLogs are stored in e.g. <CustomLogName>-202411.txt
6. All max/mins and records are stored in the ini-files

Reporting current data is usually done through webtags or the websitedate.json, series are shown with the help of JSON datafiles (created by CMX and sent to the website). Where CMX did/does not create JSONs CUtils makes its own (and sends to the site).
NOAA, Snow data are reported through dedicated textfiles and full database report for the sensor - and derived - data is done through YADR, either the beteljuice version or CUtils version which is limited to basic sensors.

Finally: when I started CUtils as a reporting tool, CMX was not yet developed to the level where it is today.

If CMX would do the statistics charts I would simply stop developing CUtils (so @Mark: idea? You could take the charts and code for the compiler if you wish, small mods required to make them to your standard )

Hope the above explains a bit the what, how and why of reporting and CUtils.

[AndyKF650]

Hi Hans

Thanks for the explanation, CUtils and CMX really have developed enormously over the years in response to changing hardware and reporting requirements.

Personally, I like the CUtils web environment over the CMX version and look forward to a long lifetime of CUtils. With of course your skilled hand in meeting any development changes along the way.

Keep up the great work

[HansR]

thanks Andy!

[PaulMy]

@Andy,
Nice history on your About!

Enjoy,
Paul