v.4.5.0.0 Solar

[PaulMy]

Hi Hans,
I've updated... and looks fine. Well done

I admit I haven't read the ReadMe in detail on this, sorry but little time, and have quickly compared the graphs http://www.komokaweather.com/cumulusutils/index.html to my MXUIwebsite charts http://komokaweather.com/cumulusmx/charts.php?lang=en
There is a slight difference in the solar graphs and likely due to different interval in the 5-min logging interval CumulusMX-MXUIwebsite, and the 15 min in the CumulusMXutils which does not run fulltime.

Enjoy,
Paul

[HansR]

Hi Paul,

Thanks for installing, but I am afraid you missed the point on this one.
The solar graphs which appear in CumulusMX and which BCJkiwi reproduces just as I do, were not touched.
In the graphs entry of the menu, there should be a new entry 'Solar Graphs' below the wind graphs which is totally new.

Apparently they don't appear in your installation , I'll think about it and come back to you.
You have solar installed and activated so I don't really understand.

Did you run a full install - no use of thrifty - it needs to to generate the new graphs for the first time?

Regards, Hans

[HansR]

And Paul, looking closer, I see you have still version 4.3.1 activated (generated 20/09/2020 09:38) so I think something is mixed up...

[PaulMy]

Hi Hans,
I ran 4.3.1 earlier in the morning, then updated to 4.5 and ran that a little later, definitely cumul;usutils.exe 4.5.0.0 installed 20/09/20 9:37 Have ran it again at 12:37, with website parameter and files in my CumulusMXutils\utils are at 12:37. I've not run Thrifty at all. Yadr, graphssolar, etc are at 12:37 -12:38 in my CumulusMXutils\utils folder

Site still shows as 9:37 in FF, Chrome, and Edge and can't seem to get it refreshed on my computer #$%^%^ caching

I will look at it later.

Regards,
Paul

[kocher]

Greetings to all
Greetings Hans

I have downloaded what I think is the latest version: cumulusutils v450beta.zip

I ran it today as usual at the start of the day.

I don't see the solar charts and the version that appears is:

CumulusUtils Version 4.4.1

I'm sure I've done something wrong, but I'm very interested in your solar charts.

Thank you very much for your great work

Saludos desde San Sebastián

[HansR]

Hi Javier,

Thanks for trying the 4.5.0 version and it really is strange you have the same behaviour as Paul: no show up of version 4.5.0. I am very sure it has nothing to do with caching because I can't see an installed version 4.5.0 beta on my machine. So it simply is not there. Just use ctrl-F5 is you are not sure.

It does work, looking at my own installation and at that one of Patrick (Segur-Le-Chateau). Just run copy all files to the utils directory, copy cumulusutils.exe to the CumulusMX directory and run "cumulusutils website". So could you both send me the logfile of the failing run? Thanks.

Edit: And btw it also works fine on the site of roger: Sandhem/Trollhättan.

Regards, Hans

[HansR]

@all:

Having seen the results on Patricks page it is clear that there is something wrong there. After a first analysis I pointed to the data and the parameter settings. So I am currently analysing to see if there is a flaw in the algorithm (specifically concerning changes in the DataLogInterval).

I will keep you posted.

[HansR]

I analysed the problem with the solar information as found in the datafiles of Segur-Le-Chateau and I must conclude that several switches of the DataLogInterval have been made over the years. This leads to an interesting effect on the data where I assumed a fixed step for the integration process but apparently it is a variable step.

I thought I was safe by taking the value of that parameter from the Cumulus.ini file, but that is clearly a wrong assumption. One can not assume anything about the sampling frequency as it can be changed, so it will be changed (any CMX user will do that one time or more - except me ). The basic reason probably will be checking the effect on file size but that why is unimportant.

Anyway, I will adjust the algorithm to a dynamic determination of the sampling frequency to use a variable step, even if it will be fixed most of the time.
This adjustment will also account for data gaps (which occur while in maintenance or hardware failure). If any gap larger than 30 minutes occurs (the max sampling frequency one can choose) the data is skipped until sampling restarts (with whatever frequency has been chosen). If a shorter gap exists the data is extrapolated.
I will release a beta2 when ready.

The above may also have an effect on the wind sampling used for the WindRose btw, if so I'll get back on that one.

NB: Interesting effect of the way the user can influence the data. I wonder how this effects the results in the SQL database and the calculations done with those numbers. Anybody can shed a light on that one? Post here or send me a PM please! All data and graphs look great but that does not mean they are valid

[HansR]

Additional issues has come up with the old datafiles (from @PaulMy, maybe that is also @kocher issue):

1. the very old datafiles (before 1.8.5) do not contain solar data (field 19).
2. the datafiles before 1.9.1 does not contain the theoretical max solar radiation (field 23, required to calculate the hours of sunshine).

The reading of the file is OK but because there no data at generation time cutils crashes.
That needs to be improved

Will be handled in beta2.

[PaulMy]

Thanks Hans,
My data is from 2008, with sunshine since 2012 with the B-L Sunrecorder, and UV/Solar with the Vp2Plus since may 2018.

Back to v.4.4.1.0 and working fine.

Enjoy,
Paul

[kocher]

Good afternoon Hans

Yesterday I did everything you indicate; I do it whenever I run an update.

I have also cleared the browser cache without noticing any change.

I attach the corresponding log file

[HansR]

I attach the corresponding log file

Thanks Javier, I checked the log, there is apparently an issue with your 2012 monthly log. Did you have solar then?
Anyway, can you send me your data files (by mail or PM) so that I can analyse/debug? Thanks.

[kocher]

I have always had a solar and UV sensor; What happens is that the start of the measurements started on 03/10/2012; that is, the year 2012 is not complete. I'm going to find the files to send them to you by email.

[kocher]

You can look at the "solar" and "UV" values in the direction:

http://kocher.es/cumulusMX/basic.php?lang=en

[HansR]

My data is from 2008, with sunshine since 2012 with the B-L Sunrecorder, and UV/Solar with the Vp2Plus since may 2018.

Apparently the data from the B-L Sunrecorder has not been stored in the field 19 of the standard logfiles.
I have no idea where to find those data and how to detect you were using another solar sensor and for which period. For the time being, the graphs only use the data stored in field nr 19 so only from may 2018 solar data will be available for @PaulMy.

Anyway, as there can be more than one solar sensor, it is CMX which must decide which sensor is leading and if only one is used, e.g. the B-L iso the Davis sensor, then that data should/must be stored in the solar radiation field 19. That apparently does not happen and it is probably stored as extra sensor data somewhere. Cutils so far does not handle extra sensors.

Anybody comment on this?