Welcome to the Cumulus Support forum.

Latest Cumulus MX V3 release 3.28.6 (build 3283) - 21 March 2024

Cumulus MX V4 beta test release 4.0.0 (build 4019) - 03 April 2024

Legacy Cumulus 1 release 1.9.4 (build 1099) - 28 November 2014
(a patch is available for 1.9.4 build 1099 that extends the date range of drop-down menus to 2030)

Download the Software (Cumulus MX / Cumulus 1 and other related items) from the Wiki

CumulusUtils - Release Topic

Discussion of the Cumulusutils tool and website generator.

Moderator: HansR

User avatar
HansR
Posts: 5969
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: GW1100 (WS80/WH40)
Operating System: Raspberry OS/Bookworm
Location: Wagenborgen (NL)
Contact:

Re: CumulusUtils

Post by HansR »

Version 6.18.3 is online
See release notes.
  1. Forecasts: Text around the Yourweather forecast table is now translatable (section: Forecasts)
  2. Forecasts: Default ForecastSystem is reset to YourWeather because SpotWX has an issue with cookies. If you have set SpotWX and want to change, please modify parameter ForecastSystem to YourWeather.
  3. Top10: Long Dry/Wet periods. Make sure the current period is taken into account when the period is not yet finished.
  4. Parameters: CMXport has been moved to section General. UseSpecificHighchartsVersion has been added to section General to facilitate the user who wishes to use a specific Highcharts version. If empty automaticly the last published version is used. If a specific version (e.g. 10.3.2) is entered then that one is used. No slashes, no spaces just <number>dot<number>dot<number>
  5. General: Some minor formatting changes for imperial units, this includes an axis boundaries change for the heatmap.
Hans

https://meteo-wagenborgen.nl
CMX build 4017+ ● RPi 3B+ ● Raspbian Linux 6.1.21-v7+ armv7l ● dotnet 8.0.3
User avatar
HansR
Posts: 5969
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: GW1100 (WS80/WH40)
Operating System: Raspberry OS/Bookworm
Location: Wagenborgen (NL)
Contact:

Re: CumulusUtils

Post by HansR »

Please note that a project has been started for the use of the locale in the display of date/time wherever in the display. This to satisfy notably users of imperial unit countries (the US) and some European countries with deviating formats.

A beta for 6.19.0 has been made available. Please see this post 6.19.0 beta - Locale and Date display for the beta 1 and subsequent betas.
Hans

https://meteo-wagenborgen.nl
CMX build 4017+ ● RPi 3B+ ● Raspbian Linux 6.1.21-v7+ armv7l ● dotnet 8.0.3
User avatar
HansR
Posts: 5969
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: GW1100 (WS80/WH40)
Operating System: Raspberry OS/Bookworm
Location: Wagenborgen (NL)
Contact:

Re: CumulusUtils

Post by HansR »

Version 6.19.0 is online
See release notes
  1. General: some minor formatting corrections for use of imperial units
  2. General: Error correction and handling improved in case of an erroneous locale (in cumulusutils.ini)
  3. General: All dates displayed in the modules and website are now shown according to the locale, defined in the language setting in cumulusutils.ini:
    • Records: The Records, DayRecords and Top10 pages have been reworked to display the date/time in the local format used.
    • pwsFWI: Adjusted for date formatting
    • Graphs: Date in clock pane now follows local format.
    • Gauges: Corrected the Danish language code to da i.s.o. DK and did that also for the gauges, this should be transparent for the user (Note the Danish locale is: da-DK).
    • General: With this version, the use of the locale has been formalised. Please make sure you use the locale for your language/country as defined in this Microsoft document. If it is an illegal locale, CUtils will fall back to en-GB.
  4. HighCharts: All charts in CUtils will now display short dates (i.e. dd/mm/yyyy) according to the locale. This only is seen in the tooltips (e.g. the heatmap and Temperature Sum)
  5. Charts Compiler: To accommodate the mix of scatter with other plots, only the main y-axis (the first in the definition) now generates its gridlines, and the ticks for the different y-axis are no longer aligned. This will give a slightly different experience for the charts.
  6. General: Correction for the distance unit: meters is now possible (btw: not accessible for the user)
  7. Charts Compiler: The Distance Axis now works (Note: unit has to be reworked)
NOTE: It is understood that Norwegian, Danish and probably Swedish show different output for the C# compile time or for the javascript runtime.
Hans

https://meteo-wagenborgen.nl
CMX build 4017+ ● RPi 3B+ ● Raspbian Linux 6.1.21-v7+ armv7l ● dotnet 8.0.3
User avatar
HansR
Posts: 5969
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: GW1100 (WS80/WH40)
Operating System: Raspberry OS/Bookworm
Location: Wagenborgen (NL)
Contact:

Re: CumulusUtils

Post by HansR »

Version 6.20.0 is online
See release notes
  1. Website: IMPORTANT => Files borrowed from CMX and (possibly) modified - notably: gauges.js, gauges-ss.css, language.js, RGraph.common.core.js, RGraph.rose.js, steelseries.min.js, tween.min.js - have been prefixed with CU. You need to do a full update i.e. with one run without thrifty. The reason for this is that some users started using the libraries from the CMX release and use all websites from the same directory. You should not do that and it will fail the system (For CumulusUtils or for your alternative website depending which is last placed in that location).
  2. Website: Please note that the CMX Default Website Development is developing fast and the new Alternate Default Website changed its index filename to index.html (it always was index.htm). index.html is the same name as for the CumulusUtils website so you can no longer have those two websites in the same directory! The advised setup is always to create separate directories on the server for any website you create (which btw most of you, but not all, do). The data access is relative through the parameter CumulusRealTimeLocation and the Alternate Default Website will have a similar feature as promised by Neil.
  3. Heatmap: The heatmap colour axis now has a range from 0 - 100 for the Fahrenheit scale for better resolution
Hans

https://meteo-wagenborgen.nl
CMX build 4017+ ● RPi 3B+ ● Raspbian Linux 6.1.21-v7+ armv7l ● dotnet 8.0.3
User avatar
HansR
Posts: 5969
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: GW1100 (WS80/WH40)
Operating System: Raspberry OS/Bookworm
Location: Wagenborgen (NL)
Contact:

Re: CumulusUtils

Post by HansR »

Version 6.21.0 beta 1 is online
See release notes
  1. SysInfo: A distinction can be made for various Linux dialects when required. If needed contact me and we'll work it out.
  2. Sysinfo: openSUSE (Tumbleweed) has been implemented as Linux dialect.
  3. Forecast: SpotWx has been reinstated as default to prevent a crash while doing a new install.
  4. Units: When using m/s for speed, distance will be expressed in Km (distance in m is never used by CUtils).
  5. Graphs: Fixed the conversion of X-axis day number to date in the tooltip when applicable, when graphs used as module (not sure what happened here so report if not working!).
  6. General: Added the device types according to CMX v3.27.0 - b3250
  7. Gauges: Modified CUgauges.js to sync with gauges.js 2.7.7 of CMX 3.27.0 b3250
  8. CustomLogs: A first beta for a CustomLogs module. See the Wiki page and the forum post specifically for this beta.
Hans

https://meteo-wagenborgen.nl
CMX build 4017+ ● RPi 3B+ ● Raspbian Linux 6.1.21-v7+ armv7l ● dotnet 8.0.3
User avatar
HansR
Posts: 5969
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: GW1100 (WS80/WH40)
Operating System: Raspberry OS/Bookworm
Location: Wagenborgen (NL)
Contact:

Re: CumulusUtils

Post by HansR »

Version 6.21.0 is online
See release notes.

All functionalities of the previous beta's

Main addition is the implementation of the CustomLogs module.

CustomLogs will:
  1. Make it easy to chart Lightning with the Ecowitt Lightning sensors (see below)
  2. Makes it possible to plot previously unavailable values (E.g. the Wet Bulb Temperature or 24 hour rain)
  3. ... and whatever users may come up with - all webtags producing a value are available for plotting
The CustomLogs module is also accessible as a module for displaying the charts in other websites. The realtime table is generated but not compulsory to use (using it in an other website requires additional handling and its use becomes more complex). Data will be supplied by the ''CUtils USerAskedData'' call.

If a you create a CustomLog with the webtag <#LightningStrikesToday> - the Daily frequency is best as it is a daily total - a chart with the daily number of strikes will be automatically created when the module is activated.

Default the CustomLogs are under the menu ''Extra''. If the user chooses eventually a manual handling of those charts he can use the charts anywhere.

Once configured, CustomLogs are a very powerful tool to chart any value available in CMX in any combination. E.g. as an example In my overview chart I combined sensor values with the webtag value giving the rain for the past 24 hrs.

Checkout the [[Release_Notes#Version_6.22.0_(xx/xx/23)|ToDo list for version 6.22.0]] and possibly propose a suggestion.

Additional modifications since last beta:
  1. No more crashes when adding a webtag to an existing log
  2. All file copies created while running the module are now correctly removed
  3. Incremental now works only for a ''UserAskedData'' run
  4. For an Ecowitt device added the firmware version in SysInfo (when available)
  5. Webtag #CPUTemp is added to the list
  6. Webtag name comparison to the reference list is now case dependent (as it should be). So a case spelling error now correctly fails the webtag!
Note: it is released now because as the new CMX is coming up soon, but I'll be out until the end of the month so you're on your own 8-)
Note2: it does run with previous versions of CMX except you will encounter some errors and some non-working webtags.
Note3: If you think the logfile gets to large and incomprehensible set logging to Warning, it makes it easier to spot serious issues. If the logfile is still too large let me know and I'll see what I can do.
Note4: If you only modify CustomLogs you can use the commandline argument CustomLog. It goes way faster than Website.
Hans

https://meteo-wagenborgen.nl
CMX build 4017+ ● RPi 3B+ ● Raspbian Linux 6.1.21-v7+ armv7l ● dotnet 8.0.3
User avatar
HansR
Posts: 5969
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: GW1100 (WS80/WH40)
Operating System: Raspberry OS/Bookworm
Location: Wagenborgen (NL)
Contact:

Re: CumulusUtils

Post by HansR »

Version 6.21.1 is online
See release notes.
  • CustomLogs: Fixed - When using CumulusRealTimeLocation the customlogs JSON's were not correctly located.
Hans

https://meteo-wagenborgen.nl
CMX build 4017+ ● RPi 3B+ ● Raspbian Linux 6.1.21-v7+ armv7l ● dotnet 8.0.3
User avatar
HansR
Posts: 5969
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: GW1100 (WS80/WH40)
Operating System: Raspberry OS/Bookworm
Location: Wagenborgen (NL)
Contact:

Re: CumulusUtils

Post by HansR »

Version 6.21.2 is online
See release notes.
  1. CustomLogs: Fixed - When reading the logfiles over a month boundary the transition to the next month was incorrect Thus the charts were missing the days in the new month.
  2. CustomLogs: Modified the CustomLogs - using the units and charts axis.
  3. Chartscompiler: solved a few bugs while implementing the CustomLogs Units and chart Axis. Non-critical in pre-6.21 versions
Hans

https://meteo-wagenborgen.nl
CMX build 4017+ ● RPi 3B+ ● Raspbian Linux 6.1.21-v7+ armv7l ● dotnet 8.0.3
User avatar
HansR
Posts: 5969
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: GW1100 (WS80/WH40)
Operating System: Raspberry OS/Bookworm
Location: Wagenborgen (NL)
Contact:

Re: CumulusUtils

Post by HansR »

Version 6.21.3 is online
See release notes.
  1. CustomLogs: Fixed: The Ecowitt CO2 sensor has also an AirQuality sensor with four values which need an AQ axis.
  2. Website: Modification of website statistics parameters adding Matomo for a choice between Google and Matomo. Parameters have changed, see wiki. If you already use Google statistics, you will need to set the new parameter StatisticsType to the value Google (the default for this new parameter is empty).
  3. CustomLogs: Modified the layout and behaviour of the realtime values table in the left pane in relation to the chart chosen (length of table with overflow and a slideDown when change from RECENT to DAILY and vice versa.
This is the last release for the time being in the context of the CustomLogs module.

If there is a need for an explanation of how to best use CustomLogs, both in the CUtils website and as an independent module for any website, I will write a page in the wiki about how I think the module could be used.

In any case, a number of graphs are visible on my site. Both the CustomLogs menu choice and e.g. the graph 'Year Rain versus Evapotranspiration' (YearRegenvsET) in the Daily Charts menu option, provide nice examples of the possibilities.

The combination of Webtag charting with Sensors is especially nice.
Let me know how you are using the module and if you need additional features.
Hans

https://meteo-wagenborgen.nl
CMX build 4017+ ● RPi 3B+ ● Raspbian Linux 6.1.21-v7+ armv7l ● dotnet 8.0.3
User avatar
HansR
Posts: 5969
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: GW1100 (WS80/WH40)
Operating System: Raspberry OS/Bookworm
Location: Wagenborgen (NL)
Contact:

Re: CumulusUtils

Post by HansR »

And please pay attention to this post.
Apparently the browsers are updating and several sites stopped working properly because of the mixed content issue.

Also some sites have other issues. As there is no contact info related to the sites, please post the issue for support: a non-functioning site is not good for anybody. If you do not wish to write a post on the forum, you can PM me.
Hans

https://meteo-wagenborgen.nl
CMX build 4017+ ● RPi 3B+ ● Raspbian Linux 6.1.21-v7+ armv7l ● dotnet 8.0.3
User avatar
HansR
Posts: 5969
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: GW1100 (WS80/WH40)
Operating System: Raspberry OS/Bookworm
Location: Wagenborgen (NL)
Contact:

Re: CumulusUtils

Post by HansR »

Version 6.21.4 is online
See release notes.
  1. General: Fixed: Improved logging info when asking webtag values
  2. CustomLogs: made the realtime table animation slow
  3. ExtraSensors: Changed the realtime table height to 70vh
  4. Uploading file: Fixed: The CMX Host parameter is only for FTP protocols. When using PHP upload PHP-URL needs to checked for not empty
  5. CustomLogs: If the CustomLog Frequency in minutes modulo the Internet Interval in minutes has a value other than 0 a warning is logged when the end of the log is reached and the last record time does not match the endTime.
  6. ChartsCompiler: Introduction for a specific path on the website when making modular use of CUtils and wanting to separate CUtils from the webroot files. Introduction of the parameters DoModular (cannot be combined with the Website command) and ModularPath which contains the path to the CUtils modules, relative to Webroot e.g. CUtils/ (the closing slash is required as it is with CumulusRealtimeLocation). NOTE: Module and ModularPath does not hold for the AirLink module which is on the ToDo-list for Modular handling.
  7. CustomLogs: Added THWindex and THSWindex to the list of allowed webtags
Hans

https://meteo-wagenborgen.nl
CMX build 4017+ ● RPi 3B+ ● Raspbian Linux 6.1.21-v7+ armv7l ● dotnet 8.0.3
User avatar
HansR
Posts: 5969
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: GW1100 (WS80/WH40)
Operating System: Raspberry OS/Bookworm
Location: Wagenborgen (NL)
Contact:

Re: CumulusUtils

Post by HansR »

Version 6.21.5 is online
See release notes.
  1. Sysinfo: Added reception status for Ecowitt devices
  2. Airlink and ChartsCompiler: WindBarbs is now a translatable word
  3. ChartsCompiler: added an Axis Height (ToDo: Wiki compiler spec.)
  4. Customlogs: Changed permitted webtag cloudbase to cloudbasevalue and attached axis Height
  5. Website: The pwsFWI button which in the past had been moved from the navbar to the header, has now been made configurable. If you add PwsfwiButtonInHeader=false to your [Website] section of cumulusutils.ini it will configure in the navbar just before the system led. The default for this parameter is true (placing the button in the header). Editing cumulusutils.ini yourself saves the labour of a second website run.
  6. CustomLogs: added the following webtags to the allowed webtag list: "windrunmonth", "StormRain", "RecentOutsideTemp", "RecentWindChill", "RecentDewPoint", "RecentHeatIndex", "RecentHumidity", "RecentWindSpeed", "RecentWindGust", "RecentWindLatest", "RecentWindDir", "RecentWindAvgDir", "RecentPressure", "RecentRainToday", "RecentSolarRad", "RecentUV", "RecentWindChill", "RecentFeelsLike", "RecentHumidex", "snowdepth", "snowlying", "snowfalling", "Tbeaufortnumber".
  7. Customlogs: webtags in the realtime table in the left pane are now displayed including the brackets and the hash (<# >) to facilitate the showing of possible modifying parameters.
Hans

https://meteo-wagenborgen.nl
CMX build 4017+ ● RPi 3B+ ● Raspbian Linux 6.1.21-v7+ armv7l ● dotnet 8.0.3
User avatar
HansR
Posts: 5969
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: GW1100 (WS80/WH40)
Operating System: Raspberry OS/Bookworm
Location: Wagenborgen (NL)
Contact:

Re: CumulusUtils

Post by HansR »

Version 6.22.0 is online
See release notes.
  1. Units: fix for Distance as that was always km and should be corresponding the windspeed (mph => mi, m/s => km etc...)
  2. CustomLogs: addition of the following webtags: RecentApparent, RecentIndoorTemp, RecentIndoorHumidity.
  3. Graphs: addition of Rain versus EVT graph (in the Rain section)
Hans

https://meteo-wagenborgen.nl
CMX build 4017+ ● RPi 3B+ ● Raspbian Linux 6.1.21-v7+ armv7l ● dotnet 8.0.3
User avatar
HansR
Posts: 5969
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: GW1100 (WS80/WH40)
Operating System: Raspberry OS/Bookworm
Location: Wagenborgen (NL)
Contact:

Re: CumulusUtils

Post by HansR »

I created version 6.23.0 beta 1 which has some interesting modifications (see release notes) and is attached to the release post:
  1. Technical: A cleanup of the code wrt the JSON creation. Though this is not visible for the user it has impact and will require (international) regression testing.
  2. Technical: Redo the logfile reading along the line of the CustomLogs. This reduces complexity and unifies the method. Not visible for the user and will require (international) regression testing.
  3. Technical: Performance gain while reading the monthly logs as a result of the previous action because all paranoia checks have been removed.
  4. MeteoCam: Addition of EcowittHP10 as CamType (the original being the default CamType Manual)
  5. Language: parameters NormalYearlyRainfall, StationYearlyRainfall, DailyRain, DailyEVT have been added.
  6. Graphs: In Rain vs EVT chart the plotline Normal Yearly Rainfall has been moved to he front and colour set to blue. The default title has the addition "Cumulative". The user who already has this title in the language file will need to change it manually or remove the parameter.
  7. Technical: Deprecated the use of MySQL (i.e. the parameter UseSQL is no longer used and can be removed)
  8. CustomLogs: Webtag wchillH has been renamed wchillL from CMX b3264 and up.
In addition you need to be aware of the following:
  • The simplification of the logfile reading code is not visible for the user but has major impact if there is a bug in it so please check carefully the results of all CUtils output. There should not be any difference between this version and the previous one. Especially where older series are in play (Yes Paul :!: ;) ) this may have an effect. The separators are checked only once for each logfile type. So any change of locale over the years may have some unwanted effects.
  • For the use of the Ecowitt HP10 camera you need to set the parameter

    Code: Select all

    [MeteoCam]
    CamType=EcowittHP10
    
    NOTE: the only other CamType possible at the moment is Manual.
    NOTE: All other parameters are irrelevant for this camera.
    NOTE: There is no possibility to see the timelapses (only the past 7 days are on the server) because we have no method to get the URLs This may be added in future.

    Other info:
    1. The image is read directly by the client so the webserver of the user does not come in play here.
    2. You need to enter utils/meteocamrealtime.txt as Extra Webfile in CMX.
    3. This file must be processed and is best done so on the Interval frequency.
    4. The user optimises the whole process by setting the camera frequency equal to the interval frequency.
    5. CMX does the fetching of the image URL which avoids the exposure of your Ecowitt API credentials. The URL is communicated to CUtils via the small Extra Webfile
An entry in the Wiki will be made on the Meteo Cam page. You will be informed via the release notes at the actual release.
Hans

https://meteo-wagenborgen.nl
CMX build 4017+ ● RPi 3B+ ● Raspbian Linux 6.1.21-v7+ armv7l ● dotnet 8.0.3
User avatar
HansR
Posts: 5969
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: GW1100 (WS80/WH40)
Operating System: Raspberry OS/Bookworm
Location: Wagenborgen (NL)
Contact:

Re: CumulusUtils

Post by HansR »

Version 6.23.0 is online
See release notes.

See previous post.
The delay for the HP10 meteo cam first image loading has been resolved.
Hans

https://meteo-wagenborgen.nl
CMX build 4017+ ● RPi 3B+ ● Raspbian Linux 6.1.21-v7+ armv7l ● dotnet 8.0.3
Locked