Welcome to the Cumulus Support forum.

Latest Cumulus MX release v3.0.2 build 3052 - 13 September 2019.
Legacy Cumulus 1 release v1.9.4 (build 1099) - 28 November 2014

See the Wiki for downloading either version.

Cumulusutils

Other discussion about creating web sites for Cumulus that doesn't have a specific subforum

Moderator: daj

User avatar
HansR
Posts: 276
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: Davis Vantage Pro 2+
Operating System: Raspbian GNU/Linux 9 (stretch)
Location: Wagenborgen (NL)
Contact:

Re: Cumulusutils

Post by HansR » Wed 09 Oct 2019 8:29 pm

Ah, only in the beteljuice format. Forgot the Standard :oops:
Will squeeze it in there ... but that may take a few days
https://meteo-wagenborgen.nl / Cumulus MX 3.0.2 b3052
Davis Vantage Pro 2+ / Raspberry Pi 3 Model B Plus Rev 1.3
Raspbian GNU/Linux 9 (stretch) / Linux 4.19.58-v7+
Mono JIT compiler version 4.6.2 (Debian 4.6.2.7+dfsg-1)

Phil23
Posts: 273
Joined: Sat 16 Jul 2016 11:59 pm
Weather Station: Davis Vantage Pro2 Plus
Operating System: Win7 Pro
Location: Australia

Re: Cumulusutils

Post by Phil23 » Wed 09 Oct 2019 8:35 pm

Ah,

Just switched formats & reprocessed.

Edit.

Definitely makes it easier to identify that be are well into the Extreme range.

Probably why over 30 houses were lost in fires yesterday.

http://weather.inverellit.com/fwi.php
Image

User avatar
beteljuice
Posts: 2751
Joined: Tue 09 Dec 2008 1:37 pm
Weather Station: None !
Operating System: ex XP SP3 - now W10 laptop grr
Location: Dudley, West Midlands, UK

Re: Cumulusutils

Post by beteljuice » Wed 09 Oct 2019 9:46 pm

... and lectures of Beteljuice.
What Hans really means dear readers, is that I didn't shout too loudly when he 'broke' or changed things !
Image
......................Imagine, what you will KNOW tomorrow !

User avatar
HansR
Posts: 276
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: Davis Vantage Pro 2+
Operating System: Raspbian GNU/Linux 9 (stretch)
Location: Wagenborgen (NL)
Contact:

Re: Cumulusutils

Post by HansR » Sat 12 Oct 2019 6:37 am

@Phil23: Good. And no, the danger value can never be the cause why houses were lost to the fire. It's just what it is: a warning level. Most of the time fire is caused by man, sometimes by natural causes. But anyway, say you finally had some serious rain over there. Good for you!

@Beteljuice:
beteljuice wrote:
Wed 09 Oct 2019 9:46 pm
when he 'broke' or changed things !
It was the editor... :roll:

Anyway, installed base of 6 is not really great. How to expand?
https://meteo-wagenborgen.nl / Cumulus MX 3.0.2 b3052
Davis Vantage Pro 2+ / Raspberry Pi 3 Model B Plus Rev 1.3
Raspbian GNU/Linux 9 (stretch) / Linux 4.19.58-v7+
Mono JIT compiler version 4.6.2 (Debian 4.6.2.7+dfsg-1)

User avatar
HansR
Posts: 276
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: Davis Vantage Pro 2+
Operating System: Raspbian GNU/Linux 9 (stretch)
Location: Wagenborgen (NL)
Contact:

Re: Cumulusutils

Post by HansR » Sat 12 Oct 2019 10:30 am

Version 1.5.1 is now online.

This is a very minor update, almost irrelevant.

But it also contains a very rough sketch of what I am working on now: graphing. As many Cumulus users already have roughly 10 years - or more - of data, it becomes interesting to look at it: what is constant, what is changing, what is worrying etc... As an example I looked at the daily rainfall for a station and put a moving average in the same graph. No comment, but I am looking for graphs like this: data and then work it into some statistic. Records, trends etc... how do they develop in the course of the life of a Cumulus station. Well, it is a rough sketch, there is a lot to think about: what is variable by the user and what is not, how to set up the user interface. As usual, I think of generating graphs once a day but who knows. Maybe just on request. If you don't want to try it yourself you can check out here (static data from Phil's Backyard).

You can try it yourself with commandline parameter : graphs; watch the utils directory for the output.
It may contain bugs and you need at least 180 days of data. The period for moving average is 180 days.

Ideas and comments are welcome (no guarantee I will implement or do something with it).

And don't expect anything official too soon :lol:
https://meteo-wagenborgen.nl / Cumulus MX 3.0.2 b3052
Davis Vantage Pro 2+ / Raspberry Pi 3 Model B Plus Rev 1.3
Raspbian GNU/Linux 9 (stretch) / Linux 4.19.58-v7+
Mono JIT compiler version 4.6.2 (Debian 4.6.2.7+dfsg-1)

User avatar
pdw112
Posts: 21
Joined: Sat 11 Feb 2012 11:52 am
Weather Station: La crosse ws2800
Operating System: windows 7
Location: netherlands
Contact:

Re: Cumulusutils

Post by pdw112 » Sun 13 Oct 2019 8:58 am

I have a problem with V1.50 and higher.
The pwsFWI.txt file will not updated anymore.
Attached the culumusutils.log from V1.01 and V1.50
You do not have the required permissions to view the files attached to this post.

User avatar
HansR
Posts: 276
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: Davis Vantage Pro 2+
Operating System: Raspbian GNU/Linux 9 (stretch)
Location: Wagenborgen (NL)
Contact:

Re: Cumulusutils

Post by HansR » Sun 13 Oct 2019 9:37 am

Both show a perfect run so you probably missed the change in output directory. A new directory 'utils' exists now under the Cumulus directory where cumulusutils.exe runs. All output is created in that utils directory (to prevent eventual pollution of the Cumulus directory).

Let me know if this solves the problem and also when you enter pwsFWI in the menu of your new site!
https://meteo-wagenborgen.nl / Cumulus MX 3.0.2 b3052
Davis Vantage Pro 2+ / Raspberry Pi 3 Model B Plus Rev 1.3
Raspbian GNU/Linux 9 (stretch) / Linux 4.19.58-v7+
Mono JIT compiler version 4.6.2 (Debian 4.6.2.7+dfsg-1)

User avatar
pdw112
Posts: 21
Joined: Sat 11 Feb 2012 11:52 am
Weather Station: La crosse ws2800
Operating System: windows 7
Location: netherlands
Contact:

Re: Cumulusutils

Post by pdw112 » Sun 13 Oct 2019 7:09 pm

Yes now I see the utils map with the up to date data.
And I test it and it works fine.

The link to the FWI is:
http://weerstationtilburgreeshof.nl/wxfwitest.php

User avatar
HansR
Posts: 276
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: Davis Vantage Pro 2+
Operating System: Raspbian GNU/Linux 9 (stretch)
Location: Wagenborgen (NL)
Contact:

Re: Cumulusutils

Post by HansR » Sun 13 Oct 2019 7:58 pm

Thanks, I'll put your link in the list.

Remarkable change over the years btw. Significant yellow warning level only in 2018/19. Before it was mainly green.
Interesting!
https://meteo-wagenborgen.nl / Cumulus MX 3.0.2 b3052
Davis Vantage Pro 2+ / Raspberry Pi 3 Model B Plus Rev 1.3
Raspbian GNU/Linux 9 (stretch) / Linux 4.19.58-v7+
Mono JIT compiler version 4.6.2 (Debian 4.6.2.7+dfsg-1)

User avatar
beteljuice
Posts: 2751
Joined: Tue 09 Dec 2008 1:37 pm
Weather Station: None !
Operating System: ex XP SP3 - now W10 laptop grr
Location: Dudley, West Midlands, UK

Re: Cumulusutils

Post by beteljuice » Sun 13 Oct 2019 8:32 pm

@pdw112

I don't know why you've put it in an <IFRAME> ? (perhaps for a set depth and then scroll ?)
... but it's wider than your your page layout ! - The pwsFWI is self adjusting in width.
So just put your IFRAME width to 100% ;)
Image
......................Imagine, what you will KNOW tomorrow !

User avatar
HansR
Posts: 276
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: Davis Vantage Pro 2+
Operating System: Raspbian GNU/Linux 9 (stretch)
Location: Wagenborgen (NL)
Contact:

Re: Cumulusutils

Post by HansR » Mon 14 Oct 2019 6:46 pm

Version 1.6.0 is online.

This is primarily an adaptation of the Beteljuice format to the action by some of you to place all their data online (somewhere between 3 and 4000 lines). That was kind of unforeseen and a scrollbar has been implemented on a window of some 22 lines. The use of an iframe is disadvised. As for the graphs module which is under development, two graphs have now been implemented. Comments and suggestions are welcome.

NOTE: if you are unhappy with the Beteljuice layout or wish to comment on it, please do so in this thread.
https://meteo-wagenborgen.nl / Cumulus MX 3.0.2 b3052
Davis Vantage Pro 2+ / Raspberry Pi 3 Model B Plus Rev 1.3
Raspbian GNU/Linux 9 (stretch) / Linux 4.19.58-v7+
Mono JIT compiler version 4.6.2 (Debian 4.6.2.7+dfsg-1)

Phil23
Posts: 273
Joined: Sat 16 Jul 2016 11:59 pm
Weather Station: Davis Vantage Pro2 Plus
Operating System: Win7 Pro
Location: Australia

Re: Cumulusutils

Post by Phil23 » Mon 14 Oct 2019 8:15 pm

Not seeing a graph at this stage.

Just the option & a Go button.

Also notice in the Standard layout that the credits are now far to the left.
Could just be my holding page though.
Image

User avatar
HansR
Posts: 276
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: Davis Vantage Pro 2+
Operating System: Raspbian GNU/Linux 9 (stretch)
Location: Wagenborgen (NL)
Contact:

Re: Cumulusutils

Post by HansR » Mon 14 Oct 2019 8:54 pm

Strange, I put the credits in a div with text-align=center. Could be your template indeed. Credits are the same code for Standard and Beteljuice formats.
Also no graphs if you press the go-button?
https://meteo-wagenborgen.nl / Cumulus MX 3.0.2 b3052
Davis Vantage Pro 2+ / Raspberry Pi 3 Model B Plus Rev 1.3
Raspbian GNU/Linux 9 (stretch) / Linux 4.19.58-v7+
Mono JIT compiler version 4.6.2 (Debian 4.6.2.7+dfsg-1)

Phil23
Posts: 273
Joined: Sat 16 Jul 2016 11:59 pm
Weather Station: Davis Vantage Pro2 Plus
Operating System: Win7 Pro
Location: Australia

Re: Cumulusutils

Post by Phil23 » Mon 14 Oct 2019 10:08 pm

HansR wrote:
Mon 14 Oct 2019 8:54 pm
Also no graphs if you press the go-button?
No,

Did try changing my ini file back to 30 days from 365, but still the same.

There seems to be a lot of data in the graphs.txt.

Attached.
Image

User avatar
HansR
Posts: 276
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: Davis Vantage Pro 2+
Operating System: Raspbian GNU/Linux 9 (stretch)
Location: Wagenborgen (NL)
Contact:

Re: Cumulusutils

Post by HansR » Tue 15 Oct 2019 3:36 am

@Phil: That image does not give me any info. Can you send the graphs output?

Below I will give an explanation of the graph module which will also be included in the ReadMe.

Short explanation of the Graph module in CumulusUtils

How does the graph module works? (if you can see the graphs, I guess it would be kind of self-explanatory, if you don't the text below may explain)

First of all: there is no relation between the pwsFWI analysis mode and the graphs module. In fact, all modules work independently and you can run cumulusutils separately with any of the commandline parameters to create the specific wanted output. So if you only would like to use the top10, you would issue "cumulusutils.exe top10" and noting more. The parameters as specified in the inifile are specified per module and have no relation with the other modules. So, if two modules would require or need an analysis mode, there would be an Analysis parameter in each section.

The graph module is - at this moment - above all meant to show long term effects, inspired by the fact, that many Cumulus users are getting into the phase of long term use of Cumulus and therefore own interesting datasets. To this end, I use dayfile.txt to generate the specific datasets I need for a specific graph. Sometimes I will display all datapoints in a time series, sometimes an aggregate graph will be made (like the Warm Days graph) with a lot less data.

In one case, the first graph of daily rain data, would be about 8 years so 8*365 equals roughly 3000 datapoints. For the moving average that would be an additional 3000 - 180 datapoints. A modest 6000 datapoints should be no problem for HighCharts as I checked a chart with 15.000 datapoints. The only drawback is the size of the resulting HTML. I might address that problem in a later stage, but if compression is on between client and server that should already be not too big a problem (the file is some 150k).

NOTE: The graphing of cumulus itself is done through a JSON data request (already present in JSON files and transferred by Cumulus every ftp cycle), but if you display eg 2 days (as I do) on a minute interval is 2880 datapoints per line. For 6 lines that means 17.280 datapoints and it displays quickly. So the nr of points is not a problem for HighCharts. I chose not to use a separate datafile.

NOTE: When first used, take into account that the highcharts libraries must be downloaded before any graphing can be done. They will be stored in the cache so the initial delay will only take place at a complete refresh.

The container which contains the graph, has a minimum-width of 450px and a height of 400px. To view a graph, at least this space should be available. An example of how this should/could look is shown on my own site (somebody else data, because I have only 4 month of data). The HTML code looks like this:

Code: Select all

<div id = "container" style="min-width: 450px; height: 400px; margin-left: 0%; margin-right: 0%"></div>
Take this into account when you create a page to include the graphs.txt output of the graphs-module.

The first graph is 'Daily Rain' with a moving average (period 180 days). It should be visible at page load. Then, with the little drop-down menu under the title, you should be able to choose the other graph(s), pressing the go button should make the chosen graph visible or reload. Of course there is no direct connection between the website and the Cumulus device. Although with some users that may be one machine, I do not make that assumption.

Creating the graphs is done when cumulusutils is run with the commandline parameter 'graphs'. When you look at the graphs, you will see it is not necessary to run it daily so maybe simply run manually when wanted or weekly/monthly even would be good enough (for now).

I hope this helps, please let me know if there are any other questions/issues

Hans
Last edited by HansR on Tue 15 Oct 2019 6:56 am, edited 2 times in total.
https://meteo-wagenborgen.nl / Cumulus MX 3.0.2 b3052
Davis Vantage Pro 2+ / Raspberry Pi 3 Model B Plus Rev 1.3
Raspbian GNU/Linux 9 (stretch) / Linux 4.19.58-v7+
Mono JIT compiler version 4.6.2 (Debian 4.6.2.7+dfsg-1)

Post Reply