Welcome to the Cumulus Support forum.

Latest Cumulus MX release 3.9.1 (build 3096) - 31 October 2020 (please see announcement regarding releases since 3.5.0)
Legacy Cumulus 1 release v1.9.4 (build 1099) - 28 November 2014 (a patch is available for 1.9.4 build 1099 that extends the date range of the NOAA report and Snow Index drop-down menus to 2030)

Use this Wiki link to Download the Software (Cumulus MX / Cumulus 1 and other related items).

v.4.5.0.0 Solar

Discussion of the Cumulusutils tool and website generator.

Moderator: HansR

User avatar
PaulMy
Posts: 2291
Joined: Sun 28 Sep 2008 11:54 pm
Weather Station: Davis VP2+ Cumulus1 / CummulusMX
Operating System: Windows8 / Windows10
Location: Komoka, ON Canada
Contact:

v.4.5.0.0 Solar

Post by PaulMy »

Hi Hans,
I've updated... and looks fine. Well done :clap:

I admit I haven't read the ReadMe in detail on this, sorry but little time, and have quickly compared the graphs http://www.komokaweather.com/cumulusutils/index.html to my MXUIwebsite charts http://komokaweather.com/cumulusmx/charts.php?lang=en
There is a slight difference in the solar graphs and likely due to different interval in the 5-min logging interval CumulusMX-MXUIwebsite, and the 15 min in the CumulusMXutils which does not run fulltime.

Enjoy,
Paul

User avatar
HansR
Posts: 1536
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: Davis Vantage Pro 2+
Operating System: Raspbian GNU/Linux 10 (Buster)
Location: Wagenborgen (NL)
Contact:

Re: v.4.5.0.0 Solar

Post by HansR »

Hi Paul,

Thanks for installing, but I am afraid you missed the point on this one.
The solar graphs which appear in CumulusMX and which BCJkiwi reproduces just as I do, were not touched.
In the graphs entry of the menu, there should be a new entry 'Solar Graphs' below the wind graphs which is totally new.

Apparently they don't appear in your installation , I'll think about it and come back to you.
You have solar installed and activated so I don't really understand.

Did you run a full install - no use of thrifty - it needs to to generate the new graphs for the first time?

Regards, Hans
https://meteo-wagenborgen.nl / Cumulus 3.9.1 (build: 3096)
Davis Vantage Pro 2+ / Raspberry Pi 3 Model B Plus Rev 1.3
Raspbian Buster / 5.4.51-v7+ armv7l
Mono JIT compiler version 6.12.0.90 (tarball Fri Sep 4 14:21:54 UTC 2020)

User avatar
HansR
Posts: 1536
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: Davis Vantage Pro 2+
Operating System: Raspbian GNU/Linux 10 (Buster)
Location: Wagenborgen (NL)
Contact:

Re: v.4.5.0.0 Solar

Post by HansR »

And Paul, looking closer, I see you have still version 4.3.1 activated (generated 20/09/2020 09:38) so I think something is mixed up... :o
https://meteo-wagenborgen.nl / Cumulus 3.9.1 (build: 3096)
Davis Vantage Pro 2+ / Raspberry Pi 3 Model B Plus Rev 1.3
Raspbian Buster / 5.4.51-v7+ armv7l
Mono JIT compiler version 6.12.0.90 (tarball Fri Sep 4 14:21:54 UTC 2020)

User avatar
PaulMy
Posts: 2291
Joined: Sun 28 Sep 2008 11:54 pm
Weather Station: Davis VP2+ Cumulus1 / CummulusMX
Operating System: Windows8 / Windows10
Location: Komoka, ON Canada
Contact:

Re: v.4.5.0.0 Solar

Post by PaulMy »

Hi Hans,
I ran 4.3.1 earlier in the morning, then updated to 4.5 and ran that a little later, definitely cumul;usutils.exe 4.5.0.0 installed 20/09/20 9:37 Have ran it again at 12:37, with website parameter and files in my CumulusMXutils\utils are at 12:37. I've not run Thrifty at all. Yadr, graphssolar, etc are at 12:37 -12:38 in my CumulusMXutils\utils folder

Site still shows as 9:37 in FF, Chrome, and Edge and can't seem to get it refreshed on my computer #$%^%^ caching

I will look at it later.

Regards,
Paul

User avatar
kocher
Posts: 211
Joined: Sat 19 Apr 2014 7:57 pm
Weather Station: Davis Vantage Pro2+
Operating System: Windows 10
Location: San Sebastian - Spain
Contact:

Re: v.4.5.0.0 Solar

Post by kocher »

Greetings to all
Greetings Hans

I have downloaded what I think is the latest version: cumulusutils v450beta.zip

I ran it today as usual at the start of the day.

I don't see the solar charts and the version that appears is:

CumulusUtils Version 4.4.1

I'm sure I've done something wrong, but I'm very interested in your solar charts.

Thank you very much for your great work

Saludos desde San Sebastián
Image

User avatar
HansR
Posts: 1536
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: Davis Vantage Pro 2+
Operating System: Raspbian GNU/Linux 10 (Buster)
Location: Wagenborgen (NL)
Contact:

Re: v.4.5.0.0 Solar

Post by HansR »

Hi Javier,

Thanks for trying the 4.5.0 version and it really is strange you have the same behaviour as Paul: no show up of version 4.5.0. I am very sure it has nothing to do with caching because I can't see an installed version 4.5.0 beta on my machine. So it simply is not there. Just use ctrl-F5 is you are not sure.

It does work, looking at my own installation and at that one of Patrick (Segur-Le-Chateau). Just run copy all files to the utils directory, copy cumulusutils.exe to the CumulusMX directory and run "cumulusutils website". So could you both send me the logfile of the failing run? Thanks.

Edit: And btw it also works fine on the site of roger: Sandhem/Trollhättan.

Regards, Hans
https://meteo-wagenborgen.nl / Cumulus 3.9.1 (build: 3096)
Davis Vantage Pro 2+ / Raspberry Pi 3 Model B Plus Rev 1.3
Raspbian Buster / 5.4.51-v7+ armv7l
Mono JIT compiler version 6.12.0.90 (tarball Fri Sep 4 14:21:54 UTC 2020)

User avatar
HansR
Posts: 1536
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: Davis Vantage Pro 2+
Operating System: Raspbian GNU/Linux 10 (Buster)
Location: Wagenborgen (NL)
Contact:

Re: v.4.5.0.0 Solar

Post by HansR »

@all:

Having seen the results on Patricks page it is clear that there is something wrong there. After a first analysis I pointed to the data and the parameter settings. So I am currently analysing to see if there is a flaw in the algorithm (specifically concerning changes in the DataLogInterval).

I will keep you posted.
https://meteo-wagenborgen.nl / Cumulus 3.9.1 (build: 3096)
Davis Vantage Pro 2+ / Raspberry Pi 3 Model B Plus Rev 1.3
Raspbian Buster / 5.4.51-v7+ armv7l
Mono JIT compiler version 6.12.0.90 (tarball Fri Sep 4 14:21:54 UTC 2020)

User avatar
HansR
Posts: 1536
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: Davis Vantage Pro 2+
Operating System: Raspbian GNU/Linux 10 (Buster)
Location: Wagenborgen (NL)
Contact:

Re: v.4.5.0.0 Solar

Post by HansR »

I analysed the problem with the solar information as found in the datafiles of Segur-Le-Chateau and I must conclude that several switches of the DataLogInterval have been made over the years. This leads to an interesting effect on the data where I assumed a fixed step for the integration process but apparently it is a variable step.

I thought I was safe by taking the value of that parameter from the Cumulus.ini file, but that is clearly a wrong assumption. One can not assume anything about the sampling frequency as it can be changed, so it will be changed (any CMX user will do that one time or more - except me ;) ). The basic reason probably will be checking the effect on file size but that why is unimportant.

Anyway, I will adjust the algorithm to a dynamic determination of the sampling frequency to use a variable step, even if it will be fixed most of the time. :groan:
This adjustment will also account for data gaps (which occur while in maintenance or hardware failure). If any gap larger than 30 minutes occurs (the max sampling frequency one can choose) the data is skipped until sampling restarts (with whatever frequency has been chosen). If a shorter gap exists the data is extrapolated.
I will release a beta2 when ready.

The above may also have an effect on the wind sampling used for the WindRose btw, if so I'll get back on that one.

NB: Interesting effect of the way the user can influence the data. I wonder how this effects the results in the SQL database and the calculations done with those numbers. Anybody can shed a light on that one? Post here or send me a PM please! All data and graphs look great but that does not mean they are valid 8-)
https://meteo-wagenborgen.nl / Cumulus 3.9.1 (build: 3096)
Davis Vantage Pro 2+ / Raspberry Pi 3 Model B Plus Rev 1.3
Raspbian Buster / 5.4.51-v7+ armv7l
Mono JIT compiler version 6.12.0.90 (tarball Fri Sep 4 14:21:54 UTC 2020)

User avatar
HansR
Posts: 1536
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: Davis Vantage Pro 2+
Operating System: Raspbian GNU/Linux 10 (Buster)
Location: Wagenborgen (NL)
Contact:

Re: v.4.5.0.0 Solar

Post by HansR »

Additional issues has come up with the old datafiles (from @PaulMy, maybe that is also @kocher issue):
  1. the very old datafiles (before 1.8.5) do not contain solar data (field 19).
  2. the datafiles before 1.9.1 does not contain the theoretical max solar radiation (field 23, required to calculate the hours of sunshine).
The reading of the file is OK but because there no data at generation time cutils crashes.
That needs to be improved :mrgreen:

Will be handled in beta2.
https://meteo-wagenborgen.nl / Cumulus 3.9.1 (build: 3096)
Davis Vantage Pro 2+ / Raspberry Pi 3 Model B Plus Rev 1.3
Raspbian Buster / 5.4.51-v7+ armv7l
Mono JIT compiler version 6.12.0.90 (tarball Fri Sep 4 14:21:54 UTC 2020)

User avatar
PaulMy
Posts: 2291
Joined: Sun 28 Sep 2008 11:54 pm
Weather Station: Davis VP2+ Cumulus1 / CummulusMX
Operating System: Windows8 / Windows10
Location: Komoka, ON Canada
Contact:

Re: v.4.5.0.0 Solar

Post by PaulMy »

Thanks Hans,
My data is from 2008, with sunshine since 2012 with the B-L Sunrecorder, and UV/Solar with the Vp2Plus since may 2018.

Back to v.4.4.1.0 and working fine.

Enjoy,
Paul

User avatar
kocher
Posts: 211
Joined: Sat 19 Apr 2014 7:57 pm
Weather Station: Davis Vantage Pro2+
Operating System: Windows 10
Location: San Sebastian - Spain
Contact:

Re: v.4.5.0.0 Solar

Post by kocher »

Good afternoon Hans

Yesterday I did everything you indicate; I do it whenever I run an update.

I have also cleared the browser cache without noticing any change.

I attach the corresponding log file
You do not have the required permissions to view the files attached to this post.
Image

User avatar
HansR
Posts: 1536
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: Davis Vantage Pro 2+
Operating System: Raspbian GNU/Linux 10 (Buster)
Location: Wagenborgen (NL)
Contact:

Re: v.4.5.0.0 Solar

Post by HansR »

kocher wrote:
Mon 21 Sep 2020 4:43 pm
I attach the corresponding log file
Thanks Javier, I checked the log, there is apparently an issue with your 2012 monthly log. Did you have solar then?
Anyway, can you send me your data files (by mail or PM) so that I can analyse/debug? Thanks.
https://meteo-wagenborgen.nl / Cumulus 3.9.1 (build: 3096)
Davis Vantage Pro 2+ / Raspberry Pi 3 Model B Plus Rev 1.3
Raspbian Buster / 5.4.51-v7+ armv7l
Mono JIT compiler version 6.12.0.90 (tarball Fri Sep 4 14:21:54 UTC 2020)

User avatar
kocher
Posts: 211
Joined: Sat 19 Apr 2014 7:57 pm
Weather Station: Davis Vantage Pro2+
Operating System: Windows 10
Location: San Sebastian - Spain
Contact:

Re: v.4.5.0.0 Solar

Post by kocher »

I have always had a solar and UV sensor; What happens is that the start of the measurements started on 03/10/2012; that is, the year 2012 is not complete. I'm going to find the files to send them to you by email.
Image

User avatar
kocher
Posts: 211
Joined: Sat 19 Apr 2014 7:57 pm
Weather Station: Davis Vantage Pro2+
Operating System: Windows 10
Location: San Sebastian - Spain
Contact:

Re: v.4.5.0.0 Solar

Post by kocher »

You can look at the "solar" and "UV" values in the direction:

http://kocher.es/cumulusMX/basic.php?lang=en
Image

User avatar
HansR
Posts: 1536
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: Davis Vantage Pro 2+
Operating System: Raspbian GNU/Linux 10 (Buster)
Location: Wagenborgen (NL)
Contact:

Re: v.4.5.0.0 Solar

Post by HansR »

PaulMy wrote:
Mon 21 Sep 2020 4:08 pm
My data is from 2008, with sunshine since 2012 with the B-L Sunrecorder, and UV/Solar with the Vp2Plus since may 2018.
Apparently the data from the B-L Sunrecorder has not been stored in the field 19 of the standard logfiles.
I have no idea where to find those data and how to detect you were using another solar sensor and for which period. For the time being, the graphs only use the data stored in field nr 19 so only from may 2018 solar data will be available for @PaulMy.

Anyway, as there can be more than one solar sensor, it is CMX which must decide which sensor is leading and if only one is used, e.g. the B-L iso the Davis sensor, then that data should/must be stored in the solar radiation field 19. That apparently does not happen and it is probably stored as extra sensor data somewhere. Cutils so far does not handle extra sensors.

Anybody comment on this?
https://meteo-wagenborgen.nl / Cumulus 3.9.1 (build: 3096)
Davis Vantage Pro 2+ / Raspberry Pi 3 Model B Plus Rev 1.3
Raspbian Buster / 5.4.51-v7+ armv7l
Mono JIT compiler version 6.12.0.90 (tarball Fri Sep 4 14:21:54 UTC 2020)

Post Reply