Welcome to the Cumulus Support forum.

Latest Cumulus MX release v3.1.2 build 3055 - 4 November 2019.
Legacy Cumulus 1 release v1.9.4 (build 1099) - 28 November 2014

See the Wiki for downloading either version.

Rainfall graph displays incorrectly

Discussion of version 3 of Cumulus, which runs on Windows, Linux, and OS X. All Cumulus MX queries in here, please.

Moderator: mcrossley

Post Reply
Big Daddy
Posts: 84
Joined: Tue 10 Sep 2013 8:40 pm
Weather Station: Maplin N96FY
Operating System: Windows 8
Location: Freiston, Lincolnshire, UK

Rainfall graph displays incorrectly

Post by Big Daddy » Mon 16 Sep 2019 11:31 pm

Hi All,
Need a bit of help please.

I noticed my rainfall graph wasnt displaying correctly on my website and then also my brothers website that I manage for him. I didnt remember making any changes to the actual websites but then when I looked at the Cumulus dashboards on both Raspberry Pi's I noticed it was exactly the same so potentially an issue here. The only thing I have done recently is upgrade them both to b3050 and can honestly say before this (running b3047, possibly b3045) I think they were ok. Please see the attached images. The weather stations are in 2 different locations about 100 miles apart so totally independant and hence the difference in images.

I did try to revert one Pi back to b3045 but it didnt change. Was something possibly added between these versions that may have caused it. I didnt delete my complete Cumulus MX installation when I reverted back to b3045, that may be my next step, so possibly a "new" file between these 2 versions.

Thanks for any advice.

Andy
You do not have the required permissions to view the files attached to this post.

User avatar
HansR
Posts: 364
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: Davis Vantage Pro 2+
Operating System: Raspbian GNU/Linux 9 (stretch)
Location: Wagenborgen (NL)
Contact:

Re: Rainfall graph displays incorrectly

Post by HansR » Tue 17 Sep 2019 3:50 am

What is the corresponding rainfall from dayfile.txt, for both sites, in numbers.
What is actually wrong with the graphs? What are the units you use?
https://meteo-wagenborgen.nl / Cumulus MX 3.1.0-b3053
Davis Vantage Pro 2+ / Raspberry Pi 3 Model B Plus Rev 1.3
Raspbian GNU/Linux 10 (buster) / Linux 4.19.75-v7+ armv7l
Mono JIT compiler version 6.4.0.198 (tarball Tue Sep 24 01:45:47 UTC 2019)

Big Daddy
Posts: 84
Joined: Tue 10 Sep 2013 8:40 pm
Weather Station: Maplin N96FY
Operating System: Windows 8
Location: Freiston, Lincolnshire, UK

Re: Rainfall graph displays incorrectly

Post by Big Daddy » Tue 17 Sep 2019 7:59 am

Hi Hans,
Thanks for replying.

The graphs are the standard Cumulus graphs for Rainfall which are derived for the raindata.json file generated by Cumulus. I have attached the latest json file from one of the Cumulus setups. I am using mm for both rainrate and rainfall. Previously the graphs showed a 7-day view as below, so as rain is recorded it includes the rain rate and the amount of rain as it happens throughout the day and then resets at midnight. Unfortunately I dont have a graph that corresponds to the attached json file apart from those above. The image below is from an old instance of one of the websites which I had on my test server just to show what it looked like previously. The dayfile values look ok and the file does not look corrupt in anyway and shows the total rain and max rainrate for the day.

Andy
You do not have the required permissions to view the files attached to this post.

User avatar
HansR
Posts: 364
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: Davis Vantage Pro 2+
Operating System: Raspbian GNU/Linux 9 (stretch)
Location: Wagenborgen (NL)
Contact:

Re: Rainfall graph displays incorrectly

Post by HansR » Tue 17 Sep 2019 9:59 am

To be honest, I still do not understand what is wrong with the 'new' graph it looks fine to me assuming the displayed data is correct (which you actually seem to confirm with your remark about the dayfile). I understand from your description that the data in dayfile is correct. If it is the data, you need to check whether the daily registration record (in e.g. sep19log.txt), is the same as what you see in the chart.

I notice the colour diff between the old and new situation is very different. Is that what you see as the problem or is it the data?

Could you elaborate on rainfall graph wasnt displaying correctly on my website , what exactly isn't displaying correct?
https://meteo-wagenborgen.nl / Cumulus MX 3.1.0-b3053
Davis Vantage Pro 2+ / Raspberry Pi 3 Model B Plus Rev 1.3
Raspbian GNU/Linux 10 (buster) / Linux 4.19.75-v7+ armv7l
Mono JIT compiler version 6.4.0.198 (tarball Tue Sep 24 01:45:47 UTC 2019)

Big Daddy
Posts: 84
Joined: Tue 10 Sep 2013 8:40 pm
Weather Station: Maplin N96FY
Operating System: Windows 8
Location: Freiston, Lincolnshire, UK

Re: Rainfall graph displays incorrectly

Post by Big Daddy » Tue 17 Sep 2019 11:29 am

Sorry if this is a little confusing.

The 2 "blue" graphs are from my 2 x current live instances of Cumulus and are taken from the Cumukus dashboard (seperate weather stations, seperate Pi's about 100 miles apart).
The "brown" graph is taken from an old instance of my website which is running on my test sever, its not taken from Cumulus. Its not updated, its just old. Its the only example I could find of what I believe is an "ok" graph. The colours are different as I modified the Highstock files so they fitted with my website colour scheme. This was done years ago and nothing has changed. I apologise, we are comparing apples with bananas but they are there purely to indicate the differences in the graphs.

The first "blue" graph is not a good example as there hasnt been much rain. It shows 0.3mm rain on 15th September. When I look in the log I can see this is registered at 21:50 and it shows 0.3mm but the rain rate is 0mm/hr.

On the second "blue" graph I looked specifically at the date of 13th September and in the log at 16: 10 there is suddenly a rainfall of 3.9mm but the rainrate shows 0mm / hr. The next rainfall is recorded 19:40. The log file shows rainfall now of 4.2mm (so an additional .3mm) and a rainrate of 3.6mm / hr. Next rainfall is at 19:50. Log file shows 4.5mm (so another .3mm) and a rainrate of 3.6mm / hr. At 20:10 another .3mm is added to the rainfall to make it 4.8mm but the rainfall rate is 0mm / hour.

Now to the "brown" graph for 9th Feb. This is actually showing a similar trend in that the rainfall rate does not alway seem to be captured. 03:30 .3mm rain, rainfall rate 0mm / hour. 03:50 a further .3mm of rain, rainfall rate 3.6mm / hr, 04:20, .3mm rain rainfall rate 3.6mm / hr, 05:00 .3mm rain rainfall rate 0 mm / hr, 05:20 .3mm rain rainfall rate 0mm / hr 05:30 .3mm rain rainfall rate 3.6mm / hr. Every time after that until 09:00 wherever rainfall is recorded then there is a rainfall rate.

This is causing missing rate fall rate indications on the graph before the shaded rainfall amount.

So now I am thinking its not the graphs element, more logs being captured incorrectly / missing information. Maybe I just never looked close enough.

Any ideas?

Andy

Andy

User avatar
HansR
Posts: 364
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: Davis Vantage Pro 2+
Operating System: Raspbian GNU/Linux 9 (stretch)
Location: Wagenborgen (NL)
Contact:

Re: Rainfall graph displays incorrectly

Post by HansR » Tue 17 Sep 2019 11:59 am

Thanks for taking the trouble explaining. I think now I understand. It is not the amount of rain which is wrong, but the corresponding rain rate. To be honest, at my installation I think it is correct. The trouble is that in both graphs you do not have much rainfall to show.

Maybe it has to do with the following: the first rain rate estimate can only occur when the bucket has tipped twice within the period Cumulus regards as one. So, if you have .2 mm within an hour, there is a rain rate of .2 mm/hr. If the same amount falls in 1 minutes, there is a rain rate of 12 mm/hr. For 3 mm in a minute you have 180 mm/hr.

If rain is very short and not much and produces only one spike for the rain rate (if any) you will hardly (if at all) see it because it falls on the same spot in the graph as the amount of rain. Only if the rain has a bit longer duration the rate graph shows some width and will stand out in the amount.

To make sure there is a problem (if any), I would set the timescale of the graph to one day (or at most two). The scale becomes such that it is easier to see the difference between the rate and the amount. If it still is wrong, it will necessary to analyse further, but I would start with a single day graph and wait for a day with some good showers.

That would be my explanation for the time being: not enough rain to distinguish well between the two lines in the graph.
Not sure, but that would be my guess.
https://meteo-wagenborgen.nl / Cumulus MX 3.1.0-b3053
Davis Vantage Pro 2+ / Raspberry Pi 3 Model B Plus Rev 1.3
Raspbian GNU/Linux 10 (buster) / Linux 4.19.75-v7+ armv7l
Mono JIT compiler version 6.4.0.198 (tarball Tue Sep 24 01:45:47 UTC 2019)

Big Daddy
Posts: 84
Joined: Tue 10 Sep 2013 8:40 pm
Weather Station: Maplin N96FY
Operating System: Windows 8
Location: Freiston, Lincolnshire, UK

Re: Rainfall graph displays incorrectly

Post by Big Daddy » Tue 17 Sep 2019 12:08 pm

Thanks Hans, good plan.
I will make the change on my installation and pray for rain but I see very little forecast for the next 10 days.
Typically, I dont normally wish for rain but now I want some there isnt any on the way.

Appreciate your assistance.

Andy

Big Daddy
Posts: 84
Joined: Tue 10 Sep 2013 8:40 pm
Weather Station: Maplin N96FY
Operating System: Windows 8
Location: Freiston, Lincolnshire, UK

Re: Rainfall graph displays incorrectly

Post by Big Daddy » Tue 17 Sep 2019 5:27 pm

Maybe I need to get the hosepipe out and generate a bit of light rain. :lol:

User avatar
HansR
Posts: 364
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: Davis Vantage Pro 2+
Operating System: Raspbian GNU/Linux 9 (stretch)
Location: Wagenborgen (NL)
Contact:

Re: Rainfall graph displays incorrectly

Post by HansR » Tue 17 Sep 2019 5:33 pm

It would ruin your historical data set, but anything for a good test ;)
https://meteo-wagenborgen.nl / Cumulus MX 3.1.0-b3053
Davis Vantage Pro 2+ / Raspberry Pi 3 Model B Plus Rev 1.3
Raspbian GNU/Linux 10 (buster) / Linux 4.19.75-v7+ armv7l
Mono JIT compiler version 6.4.0.198 (tarball Tue Sep 24 01:45:47 UTC 2019)

Big Daddy
Posts: 84
Joined: Tue 10 Sep 2013 8:40 pm
Weather Station: Maplin N96FY
Operating System: Windows 8
Location: Freiston, Lincolnshire, UK

Re: Rainfall graph displays incorrectly

Post by Big Daddy » Mon 23 Sep 2019 5:35 pm

Hans,
We have had some rain :clap:

At the weekend I decided to check my rain gauge as well. The tipping the bucket was a bit stiff and had some dirt in there so I gave it a good clean and bit of lubrication. So far it now seems to woking better.

I take back that I though this was a Cumulus issue.

Will wait and see if it records properly.

Many Thanks
Andy

User avatar
HansR
Posts: 364
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: Davis Vantage Pro 2+
Operating System: Raspbian GNU/Linux 9 (stretch)
Location: Wagenborgen (NL)
Contact:

Re: Rainfall graph displays incorrectly

Post by HansR » Mon 23 Sep 2019 6:41 pm

Ok, will see. Report here if everything is ok.
https://meteo-wagenborgen.nl / Cumulus MX 3.1.0-b3053
Davis Vantage Pro 2+ / Raspberry Pi 3 Model B Plus Rev 1.3
Raspbian GNU/Linux 10 (buster) / Linux 4.19.75-v7+ armv7l
Mono JIT compiler version 6.4.0.198 (tarball Tue Sep 24 01:45:47 UTC 2019)

ExperiMentor
Posts: 124
Joined: Tue 24 Nov 2015 11:30 pm
Weather Station: Fine Offset & Davis Vantage Vue
Operating System: Windows 10; Raspbian Buster
Location: Switzerland

Re: Rainfall graph displays incorrectly

Post by ExperiMentor » Mon 23 Sep 2019 10:15 pm

I come late to this.

I agree with the conclusion you came to - graph is too compressed and with too little rain to be able to distinguish rain rate from the upspike of daily rain.

But instead of a hosepipe, you can dynamically amend the plot on screen either using the 12h and 6h buttons at top left (instead of the present 'All' that you have set to 7 days). But those only give the last few hours.
Alternatively, use the sliders in the bottom part of the window to expand any part of the 7-day plot by as much as you wnat/need

One of those is probably enough to make it more visible?

Big Daddy
Posts: 84
Joined: Tue 10 Sep 2013 8:40 pm
Weather Station: Maplin N96FY
Operating System: Windows 8
Location: Freiston, Lincolnshire, UK

Re: Rainfall graph displays incorrectly

Post by Big Daddy » Tue 01 Oct 2019 5:11 pm

We have had a lot of rain and this looks much better.

I also reduced my logging interval in Cumulus from 10 minutes to 1 minute and can see now that every time it records a rain rate the amount of rainfall is increasing, whereas before, the amount of rainfall was increasing and a rate rate of 0.0mm/hr was showing.

Thanks for your responses

User avatar
HansR
Posts: 364
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: Davis Vantage Pro 2+
Operating System: Raspbian GNU/Linux 9 (stretch)
Location: Wagenborgen (NL)
Contact:

Re: Rainfall graph displays incorrectly

Post by HansR » Tue 01 Oct 2019 6:19 pm

All is well that ends well.
https://meteo-wagenborgen.nl / Cumulus MX 3.1.0-b3053
Davis Vantage Pro 2+ / Raspberry Pi 3 Model B Plus Rev 1.3
Raspbian GNU/Linux 10 (buster) / Linux 4.19.75-v7+ armv7l
Mono JIT compiler version 6.4.0.198 (tarball Tue Sep 24 01:45:47 UTC 2019)

Post Reply