Welcome to the Cumulus Support forum.

Latest Cumulus MX release 3.8.4 (build 3094) - 14 September 2020 (please see announcement regarding releases since 3.5.0)
Legacy Cumulus 1 release v1.9.4 (build 1099) - 28 November 2014 (a patch is available for 1.9.4 build 1099 that extends the date range of the NOAA report and Snow Index drop-down menus to 2030)

Use this Wiki link to Download the Software (Cumulus MX / Cumulus 1 and other related items).

The new 3.6.0 'WindRose' release

Discussion of the Cumulusutils tool and website generator.

Moderator: HansR

User avatar
HansR
Posts: 1378
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: Davis Vantage Pro 2+
Operating System: Raspbian GNU/Linux 10 (Buster)
Location: Wagenborgen (NL)
Contact:

The new 3.6.0 'WindRose' release

Post by HansR »

I had some message with problems with the WindRose release stating that:

1) There was a complaint about a logfile and therefore the run with windrose did not succeed. The file could not be read in the editor, but could be read with an iMac (I do not advice editing with an iMac and copying back btw!) . Files were received.

2) In a second run there was an issue with copy_monthlyalltimelog.txt

3) A third run did not complete either and I received the logfile indicating CumulusUtils had stopped because it could not download a file.

----------------

Replies:

1) If CumulusUtils stops with the message it has a probnlem with a logfile, please don't continue running several times, post the problem here with both the file and the logfile (make sure the logfile is from that specific run!)

2) The problem with the 'copy_monthlyalltimelog.txt', I had already expected not to occur but it existed because CU checks for *log.txt files to get the list of monthly logfiles (and bypassing the filenaming issues which differ per locale). Apparently the the release that went out still has the alltimelog files in the list. That will be fixed.

3) The third run dod not complete because CU could not download a file from the internet. That is a serious error in your connection and CU can't continue without internet.


Please report any problems with this beta release below, with cause and logfile and if necessary with datafile - zipped because they are large files.
Thank you, Hans
https://meteo-wagenborgen.nl / Cumulus 3.6.8 (build: 3084)
Davis Vantage Pro 2+ / Raspberry Pi 3 Model B Plus Rev 1.3
Raspbian Buster / 5.4.51-v7+ armv7l (before: 4.19.118)
Mono JIT compiler version 6.10.0.104 (before: 6.8.0.123)

sutne
Posts: 102
Joined: Sun 14 Oct 2012 4:23 pm
Weather Station: Oregon Scientific WMR100
Operating System: Raspbian Buster
Location: Rjoanddalen, Voss, Norway

Re: The new 3.6.0 'WindRose' release

Post by sutne »

1) There was a complaint about a logfile and therefore the run with windrose did not succeed. The file could not be read in the editor, but could be read with an iMac (I do not advice editing with an iMac and copying back btw!) . Files were received.
There is nothing wrong in editing files on a iMac.
Is this system only for people with Windows computers?

The RPI runs a version of Linux. iMac runs a version of Unix.

What makes Windows better?

The editor I am using (on the iMac) can handle all types of files, and verified that the corrupted file had been tagged as binary (on the RPI).

User avatar
HansR
Posts: 1378
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: Davis Vantage Pro 2+
Operating System: Raspbian GNU/Linux 10 (Buster)
Location: Wagenborgen (NL)
Contact:

Re: The new 3.6.0 'WindRose' release

Post by HansR »

sutne wrote:
Sun 17 May 2020 5:34 pm
1) There was a complaint about a logfile and therefore the run with windrose did not succeed. The file could not be read in the editor, but could be read with an iMac (I do not advice editing with an iMac and copying back btw!) . Files were received.
There is nothing wrong in editing files on a iMac.
Is this system only for people with Windows computers?

The RPI runs a version of Linux. iMac runs a version of Unix.

What makes Windows better?
It is not a matter of good or better. But if you have a problem, and edit a file on the mac and than send me the file, it becomes impossible for me to find the problem.
If you detect a problem with a datafile, please send that file as is to me, together with the log. That is the only way how I can find aberrations in the datafiles (which occur for historical reasons or locale deviations or whatever). I need to be able to reproduce the error.

So, Mac is very OK, Windows is very OK, RPi is very OK. But apparently somewhere something is not OK :D
sutne wrote:
Sun 17 May 2020 5:34 pm
The editor I am using (on the iMac) can handle all types of files, and verified that the corrupted file had been tagged as binary (on the RPI).
If tagged as binary on the RPi? Meaning what? The executable bit is/was set? Or was it downloaded as binary by the Mac?

Regards, Hans
https://meteo-wagenborgen.nl / Cumulus 3.6.8 (build: 3084)
Davis Vantage Pro 2+ / Raspberry Pi 3 Model B Plus Rev 1.3
Raspbian Buster / 5.4.51-v7+ armv7l (before: 4.19.118)
Mono JIT compiler version 6.10.0.104 (before: 6.8.0.123)

sutne
Posts: 102
Joined: Sun 14 Oct 2012 4:23 pm
Weather Station: Oregon Scientific WMR100
Operating System: Raspbian Buster
Location: Rjoanddalen, Voss, Norway

Re: The new 3.6.0 'WindRose' release

Post by sutne »

The files were corrupted on the RPI. The editor on RPI would not read them, but I could read them with an editor on the iMac. You had the original corrupted files.

User avatar
HansR
Posts: 1378
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: Davis Vantage Pro 2+
Operating System: Raspbian GNU/Linux 10 (Buster)
Location: Wagenborgen (NL)
Contact:

Re: The new 3.6.0 'WindRose' release

Post by HansR »

sutne wrote:
Sun 17 May 2020 8:15 pm
The files were corrupted on the RPI. The editor on RPI would not read them, but I could read them with an editor on the iMac. You had the original corrupted files.
OK. Thanks, interesting because I can read them just like that, so it was not corrupted on arrival. The question is then what makes the files different on your RPi system?
https://meteo-wagenborgen.nl / Cumulus 3.6.8 (build: 3084)
Davis Vantage Pro 2+ / Raspberry Pi 3 Model B Plus Rev 1.3
Raspbian Buster / 5.4.51-v7+ armv7l (before: 4.19.118)
Mono JIT compiler version 6.10.0.104 (before: 6.8.0.123)

User avatar
HansR
Posts: 1378
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: Davis Vantage Pro 2+
Operating System: Raspbian GNU/Linux 10 (Buster)
Location: Wagenborgen (NL)
Contact:

Re: The new 3.6.0 'WindRose' release

Post by HansR »

Fortunately 3.6.0 did work on the Segur-le-Chateau site....
So something is good ;)
https://meteo-wagenborgen.nl / Cumulus 3.6.8 (build: 3084)
Davis Vantage Pro 2+ / Raspberry Pi 3 Model B Plus Rev 1.3
Raspbian Buster / 5.4.51-v7+ armv7l (before: 4.19.118)
Mono JIT compiler version 6.10.0.104 (before: 6.8.0.123)

User avatar
HansR
Posts: 1378
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: Davis Vantage Pro 2+
Operating System: Raspbian GNU/Linux 10 (Buster)
Location: Wagenborgen (NL)
Contact:

Re: The new 3.6.0 'WindRose' release

Post by HansR »

The 3.6.1 release seems better but no!

My installation and Segur-Le-Chateau runs fine but in Norway and Canada there are problems reading the datafiles as if memory gets overwritten. As a result, the system want to write data for the WindRose (where the problem must be) from the year 0. That is pretty much without end. So, no, we're not there yet.
https://meteo-wagenborgen.nl / Cumulus 3.6.8 (build: 3084)
Davis Vantage Pro 2+ / Raspberry Pi 3 Model B Plus Rev 1.3
Raspbian Buster / 5.4.51-v7+ armv7l (before: 4.19.118)
Mono JIT compiler version 6.10.0.104 (before: 6.8.0.123)

User avatar
HansR
Posts: 1378
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: Davis Vantage Pro 2+
Operating System: Raspbian GNU/Linux 10 (Buster)
Location: Wagenborgen (NL)
Contact:

Re: The new 3.6.0 'WindRose' release

Post by HansR »

Problem seems to be solved: in the data directory was a file okt16log.txt beside Oct16log.txt. Of course both were taken up in the list of files to read. However, the first had completely different separators (.;.) than the rest of the files (/,.). And that is the problem: the software determines the separators in the first file and treat all files accordingly. It can't handle other combinations (quite rightly so), however it does not detect it encounters an erroneous situation either. That I will fix.

But @all users: screen you data directory for old garbage or switches in locale which are always - or most likely - at the origin of [these] data errors. Then you can safely use tools which make use of these files. Cumulus itself included probably.
https://meteo-wagenborgen.nl / Cumulus 3.6.8 (build: 3084)
Davis Vantage Pro 2+ / Raspberry Pi 3 Model B Plus Rev 1.3
Raspbian Buster / 5.4.51-v7+ armv7l (before: 4.19.118)
Mono JIT compiler version 6.10.0.104 (before: 6.8.0.123)

User avatar
PaulMy
Posts: 2219
Joined: Sun 28 Sep 2008 11:54 pm
Weather Station: Davis Vantage Pro 2+ w/Envoy USB
Operating System: Windows-8
Location: Komoka, ON Canada
Contact:

Re: The new 3.6.0 'WindRose' release

Post by PaulMy »

Cumulusutils v.3.6.1 wind rose is working nicely www.komokaweather.com/cumulusutils/index.html

Enjoy,
Paul

User avatar
HansR
Posts: 1378
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: Davis Vantage Pro 2+
Operating System: Raspbian GNU/Linux 10 (Buster)
Location: Wagenborgen (NL)
Contact:

Re: The new 3.6.0 'WindRose' release

Post by HansR »

Thanks Paul (though it seems that now you've got to fix the windmeter :lol: )
We're still working Norway though but getting closer.
https://meteo-wagenborgen.nl / Cumulus 3.6.8 (build: 3084)
Davis Vantage Pro 2+ / Raspberry Pi 3 Model B Plus Rev 1.3
Raspbian Buster / 5.4.51-v7+ armv7l (before: 4.19.118)
Mono JIT compiler version 6.10.0.104 (before: 6.8.0.123)

User avatar
HansR
Posts: 1378
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: Davis Vantage Pro 2+
Operating System: Raspbian GNU/Linux 10 (Buster)
Location: Wagenborgen (NL)
Contact:

Re: The new 3.6.0 'WindRose' release

Post by HansR »

We're now at a point where on some systems (RPi only?) the file 'monthlyalltimelog.txt' is not removed from the file list of monthly log files, but on most systems it is.

Anybody comment on this little piece of C# code?

Code: Select all

      for (int i=0; i<MonthfileList.Length; i++)
      {
        if (MonthfileList[i].Contains("alltimelog") )
        {
          Sup.LogDebugMessage(message: $"MonthfileList removing: {MonthfileList[i]}");
          var foos = new List<string>(MonthfileList);
          foos.RemoveAt(i);
          MonthfileList = foos.ToArray();
        }
      }

https://meteo-wagenborgen.nl / Cumulus 3.6.8 (build: 3084)
Davis Vantage Pro 2+ / Raspberry Pi 3 Model B Plus Rev 1.3
Raspbian Buster / 5.4.51-v7+ armv7l (before: 4.19.118)
Mono JIT compiler version 6.10.0.104 (before: 6.8.0.123)

User avatar
mcrossley
Posts: 6931
Joined: Thu 07 Jan 2010 9:44 pm
Weather Station: Davis VP2
Operating System: Buster Lite rPi
Location: Wilmslow, Cheshire, UK
Contact:

Re: The new 3.6.0 'WindRose' release

Post by mcrossley »

Not seeing the code, but wouldn't it be simpler to get a clean list of monthly log files using say a regex like \.*[0-9]{2}log.txt\

User avatar
HansR
Posts: 1378
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: Davis Vantage Pro 2+
Operating System: Raspbian GNU/Linux 10 (Buster)
Location: Wagenborgen (NL)
Contact:

Re: The new 3.6.0 'WindRose' release

Post by HansR »

Thought of that, but I ask for

Code: Select all

 MonthfileList = Directory.GetFiles("data/", "*log.txt");
Getfiles does not support regular expressions, any suggestion for an alternative? From what I can find that is not all that simple and besides there is the performance penalty for using regex although that is not too big in this relatively small array/list.

The only thing I need to do is remove the files containing "alltimelog" which I do.

And beside that, it seems to work everywhere, but not on a Norwegian RPi system with an en-GB locale.
https://meteo-wagenborgen.nl / Cumulus 3.6.8 (build: 3084)
Davis Vantage Pro 2+ / Raspberry Pi 3 Model B Plus Rev 1.3
Raspbian Buster / 5.4.51-v7+ armv7l (before: 4.19.118)
Mono JIT compiler version 6.10.0.104 (before: 6.8.0.123)

User avatar
HansR
Posts: 1378
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: Davis Vantage Pro 2+
Operating System: Raspbian GNU/Linux 10 (Buster)
Location: Wagenborgen (NL)
Contact:

Re: The new 3.6.0 'WindRose' release

Post by HansR »

Removing an entry moves up the list effectively skipping an entry if you don't adjust the index.

So, slight modification:

Code: Select all

foos.RemoveAt(i--);
Will prepare a version 3.6.5
https://meteo-wagenborgen.nl / Cumulus 3.6.8 (build: 3084)
Davis Vantage Pro 2+ / Raspberry Pi 3 Model B Plus Rev 1.3
Raspbian Buster / 5.4.51-v7+ armv7l (before: 4.19.118)
Mono JIT compiler version 6.10.0.104 (before: 6.8.0.123)

User avatar
mcrossley
Posts: 6931
Joined: Thu 07 Jan 2010 9:44 pm
Weather Station: Davis VP2
Operating System: Buster Lite rPi
Location: Wilmslow, Cheshire, UK
Contact:

Re: The new 3.6.0 'WindRose' release

Post by mcrossley »

HansR wrote:
Tue 19 May 2020 11:59 am
Thought of that, but I ask for

Code: Select all

 MonthfileList = Directory.GetFiles("data/", "*log.txt");
Getfiles does not support regular expressions, any suggestion for an alternative? From what I can find that is not all that simple and besides there is the performance penalty for using regex although that is not too big in this relatively small array/list.
Ah, yes, you'd have to use a ".Where(path => regex)" as well. Can't see it being much of a overhead though, especially weighed against creating a new list, removing items, converting to array, then saving again.

What's odd about Norwegian systems file naming then?

Post Reply