CumulusUtils - Release Topic

[HansR]

Version 5.0.2 is online

version 5.0.2 (04/03/2021)

1. WindGraphs: Acceleration of the WindRose creation by 35%
2. WindGraphs: For 8 sector wind direction stations (e.g. Fine Offset) this is now also reflected in the WindRose.
3. HTML: Added deblocking and deferring actions to speed up index.HTML (it will load differently).
4. Charts: bug fix for the Home charts: the default chart and the fall back every 10 minutes are now correct.
5. Charts: Click events defined in the user definitions of the charts are now handled correctly

[HansR]

Version 5.0.3 is online

version 5.0.3 (07/03/2021)

• AirQuality: bug fix concerning the windbarbs in relation to the renewed unit handling (as introduced in 4.10.5).
• Graphs: Fixed a bug in the heatmap where a zigzag blue line was visible (sometimes in front, sometimes in back).
• Graphs: Added the HighchartsDefaults and HighchartsLanguage as the includes when graphs used as modules.
  NOTE: this will modify the look and feel of the graphs slightly, especially the axis.
• Internal: Review of all ajax calls.
• NOTE: when using graphs as a module, users can modify the height of the Graphs container by specifying in a style section of their template:

  Code: Select all

  #chartcontainer {min-height: 620px;}

  (and yes, you can specify more of course e..g. width)

[HansR]

Version 5.0.4 is online (exe only).

No functional difference with 5.0.3
This is actually a patch release, required if you use it with an Airlink.

[HansR]

Version 5.1.0 is online

version 5.1.0 (22/03/2021)

1. Heatmap: Added two more colours for a more dynamic display.
2. Heatmap: For long series the display is split in pages of 10 years (default but configurable) with buttons Prev/Next and All to walk through the pages.
3. ChartsCompiler: The Solar axis when used for only the radiation now has a scale fixed to the current theoretical solar maximum. The image therefore does not easily change.
4. ChartsCompiler: added RECENT and ALL qualifiers for the Plot variables. Updated the definition specification. Option for the legacy DAILY charts is available but not now implemented.
5. ChartsCompiler: Added HeatingDegreeDays, CoolingDegreeDays and EvapoTranspiration as Plot variables.
6. ChartsCompiler: Added yAxis for DegreeDays and Evapotranspiration.
7. ChartsCompiler: Added the infrastructure to add JSON data if CMX does not provide (like e.g. the Evapotranspiration).
8. UserAskedData: Commandline parameter UserAskedData provides the JSONs for non provided data and encompasses missing weather data and AQ data (the old AirQuality Thrifty handling is now obsolete).
9. Dayfile: Modified for additional parameters and global handling of the list.
10. Monthfiles: Modified to read only one or two files to create a list for the subselection for the RECENT graphs (evapotranspiration and maybe other possibilities).
11. Monthfiles: Addition of inifile parameter MonthsOfMiracleAndWonder. If CumulusUtils uses a Locale other than that of CMX the filenames for the monthly logfiles are formed differently. In case of trouble edit this string to create CMX matching filenames.
12. Website: Moved to jQuery 3.6.0

NOTE:
The ChartsCompiler has a document itself which is much smaller than the manual (only 7 pages) and is required to be read before use. If the user does not wish to make use of the Charts Compiler, just do nothing and make sure CutilsCharts.def does not exist. When using the website generator the default charts will then be available. The CutilsCharts.def in the distribution and in this document are meant as an example. You are invited to create your own charts definitions, maybe on the basis of these examples.
You should be able to use the output of the ChartsCompiler in other websites (include the file just as you would otherwise).

[HansR]

Version 5.1.1 is online

version 5.1.1 (23/03/2021)

1. Website: Fixed a bug for double loading of the first chart
2. Website: Finished the optimisation of library loading (defer)
3. Heatmap: Fixed a bug with the All button for larger series

Especially the issue of double loading of the first graph makes it worthwhile to use this release.
Sometimes I feel like a diamond cutter

[HansR]

Version 5.1.2 is online

version 5.1.2 (31/03/2021)

1. Website: UserAskedData did not serve the AirQuality data under certain conditions
2. Errorhandling: Added InnerException info in Map for the Upload of the signaturefile
3. Website: Determine Daylights Saving Time for the station clock no longer requires a non-thrifty run of CumulusUtils.
4. Map: FTP connection now uses Automatic passive mode (Extended or Standard depending on the server)

NOTE: two new dll's have been added to the bin directory in preparation of future modifications. Be sure you update all.
Question: Could you check your logfile once in a while for an error during the ftp send operation of the map signature file (search for 'mapson'). Please let me know if an exception occurs.

[HansR]

Version 5.2.0 is online

version 5.2.0 (08/04/2021)

1. Added two growing season graphs (specific for Agriculture): Temperature Sum and Growing Degree Days in the miscellaneous graphs menu. Translations as usual. (suggestion h/t : @Pes)
2. Unification of the maximum number of visible series when year-series are in a chart (e.g. Monthly Rain). Inifile parameter MaxNrOfSeriesVisibileInGraph is now valid for all charts of this type.
3. FTPS now uses automatic choosing between Passive and Extended Passive (default when available) mode.
4. FTPS protocol now accepts SSL 3.0 and TLS 1.0 as well. If any problems arise please let me know.
5. Some minor bugs and typos.

[HansR]

Version 5.3.0 is online

version 5.3.0 (17/04/2021)

1. Manual: Replaced the README with the Wiki (https://cumuluswiki.org/a/Category:CumulusUtils). All articles are in place. In some foreseeable future the README will get different contents, this is the last release of the manual.
2. Several review quality modifications as a result of the writing of the Wiki.
3. Infile parameters: added DoLibraryIncludes to have an unambiguous parameter to determine whether or not to include the highcharts libraries and/or Leaflet library when using e.g. Graphs, Maps and the compiler as a module outside the Website Generator. NOTE: for module users this may have effect on you: CHECK!
4. ChartsCompiler: Corrected an error in the document load of the compiler output for modular use.
5. Inet: Changed logging around the FTP connection for all protocols
6. Enabled the Thrifty qualifier for individual module runs.
7. AirQuality: removed the helpbutton text when used as a module.
8. Removed the use of Thrifty for the Map module. Parameter MapsPeriod has no more use (can be removed).

[HansR]

Version 5.3.3 is online

Version 5.3.3 (27/04/2021)

1. Charts: added the third Agricultural chart showing the proportional distribution of the thermal seasons over the year (H/T @Pes for the idea).
2. Website: Added the Wiki-link to the About menu
3. pwsFWII: Changed the reference for the scientific background to the Wiki
4. FTP issue: ''lack of TLS session resumption support in FluenFTP''.
5. The previous point led to a major overhaul of the FTP / Map situation:
6. => no more regular FTP in the Map module, use is made of a HTTP POST / CGI handling of the ''signature file''
7. => everybody wanting to use the map can download https://meteo-wagenborgen.nl/maps.txt and include that the normal way in their website (it is done automatically through the software)
8. => For the normal internal FTP usage, FTP and FTPS protocols remain supported but in case of server issues the only option is to go to SFTP
9. => Unfortunately the logfile does not accept UTF8 characters so you may get confused, but be assured they are handled well in the Map context

Please note that the Wiki now replaces the manual. Also for pwsFWI the reference to the scientific background has been changed to the Wiki. I would really appreciate if users still on an old version (sometimes even displaying the test situation) would upgrade to this version. Users who had problems in the past with the FTP on Windows 7 (or 8), might retry and find the problems have disappeared (please notify if they have not).

[HansR]

Version 5.3.5 is online - See Release Notes.

Version 5.3.5 (02/05/2021)

1. Charts: bug fix: Agricultural charts now handle few data and no start on January (or July first) correctly
2. Charts: Agricultural/Seasonal charts now start correctly on July 1 in the southern hemisphere (H/T @mcrossley)
3. Charts: graphs which are switched off now not only won't be present in the menu but they won't be generated either (reduction of size of the output, time gain)
4. ChartsCompiler: Output can be defined separately for each chart. See Charts Definition Language. (bêta for the OUTPUT specifier only)

For the ChartsCompiler please read the Wiki on the Charts Definition Language (CDL) and the ChartsCompiler.
With the OUTPUT specifier in the ChartsCompiler, the first phase of the compiler is complete. It has a bêta signature as it is the first release with the OUTPUT specifier. Nevertheless, I have good faith.

I assume that, with the OUTPUT specifier, the charts can be used by anybody, for any website in any menu to be loaded either by PHP or by javascript (ajax) or - as some Australians do at the moment - use the Cutils runtime system in a non-Cutils website to have LoadUtilsReport available .

I would appreciate some feedback on its use.

There is a flaw in the OUTPUT specifier in combination with the click events. So usage of OUTPUT is not advised.
For the follow up of the ChartsCompiler beta , see the Compiler beta thread.

[HansR]

Version 5.3.6 is online - See Release Notes.

Problems relating to the ChartsCompiler are solved and it is now out of beta.
See previous release notes for the must reads on the compiler and the CDL.

Unknown issue: the NOAA reports are not shown on a Samsung tablet but do work elsewhere. Other observations are welcome. An unknown additional click event is generated. Currently looking into.

[HansR]

NOTE:
The following note was omitted from the release post:

Version 5.3.6 has quite some modifications in the javascript runtime system for the website.
To make sure that is all well installed you need to full run it once, so without thrifty:

Code: Select all

utils/bin/cumulusutils.exe website

[HansR]

Version 5.3.7 is online - See Release Notes.

Version 5.3.7 (15/5/2021)

1. Misc Charts: Fixed a bug in the titles for the agricultural charts, where the parameters data in the Title were showing fixed values
2. Maps: Send signature file only once per day (parameter [Maps] DoneToday added)
3. ChartsCompiler: Added DAILY range specifier (See CDL)
4. ChartsCompiler: DAILY or ALL charts now have different initial rangeselector: DAILY has 1 month, ALL has 1 year
5. ChartsCompiler: added columnrange as type for variables which have max and min values (see CDL Graph Types for some implicit semantics)
6. Added MySQL as a data source alternative to the original datafiles (usage: disadvised and undocumented)

NOTE: To make sure that all is well installed you need to full run it once, so without thrifty.

NOTE: In the search for performance improvement and efficiency the MySQL usage has been implemented and experimented with. The conclusion was that MySQL will not serve a better performance in the context of CumulusUtils. I decided to take another route to stay within the the design goals of CumulusUtils.

NOTE: The ColumnRange type specifier was already on the roll and was implemented in the compiler after an idea by @buffaloseven and a technical hint by @beteljuice: H/T!

Example code for the ColumnRange :

Code: Select all

CHART DailyTemp TITLE Daily Temperature with ColumnRange
 PLOT DAILY AverageTemp colour green As ColumnRange
 PLOT DAILY AverageTemp colour black As spline
EndChart OUTPUT ColumnRange.txt

Schermafbeelding 2021-05-15 102706.jpg

[HansR]

version 5.3.8 is online - See release notes.

1. Fix : A fix in errorhandling for a condition which occurs only on Win7 and has been introduced in 5.3.0 or a bit later.

Update is advised!

[HansR]

Version 5.4.0 is online - See release notes.

1. Language: Create a distinguishable legend in the chart for the columnrange variable (section [Compiler] in CUstringsXX).
2. Compiler: Implementation of keyword EVAL(uation) of an expression for a PLOT with any weather variable.
3. Compiler: Implementation of the STATS keyword which will plot a statistic on any weather variable
4. Compiler: Implementation of the SUM function for the EVAL keyword
5. Compiler: Implementation of the SMA (Simple Moving Average) statistic as first statistic function.
6. Compiler: Elaboration of Error messages.

Schermafbeelding 2021-05-21 154949.jpg