Page 23 of 41

Re: Cumulusutils

Posted: Fri 27 Dec 2019 3:15 pm
by HansR
@vpokroglo: An update on what I wrote above. I communicated with Mark Crossley about how to solve the issue with the locale / internal data relation. I wrote a short report with suggestion on how to solve the problem and make it possible, everybody could upgrade the OS and Mono without interference from the locale on Cumulus. However, that would mean all Cumulus users would have the same data format which would be different from the current situation. That would lead to a backward compatibility issue.
Though I have not heard from him since, I assume some comment will arrive soon. We will see how it goes forward. There appears to be also a Version 4 of Cumulus under development, not sure how far that is (if it still goes) it seems to have stopped. What I found is that V4 also would be very different so it seems a crossroad is approaching one way or another.

@all: I recently found that @MeteoSangonera has continued the analysis of pwsFWI (see attached file) versus the prediction over a period of a bit more than a month (1/11 - 5/12). I think I owe you all the presentation of those data in a graph. Note that the deviation of pwsFWI prediction stays normally within 20% of the observed value and rarely goes beyond 30% (pwsFWI values on left Y-axis, percentage on the right Y-axis). So, yes, it may occur that the observed value has a different warning level than the predicted one, but all in all, I think it is a worthwhile addition to the tool. I find myself to check the prediction first and then look at the actual value. That is interesting because in Inverell recently the deviation was such that it went to yellow but when the predicted rain did not fall it remained red and went back to purple. So there is the danger of falsely counting on prediction. But having said that, you are all warned, I may think of adding an automated analysis for the prediction to the analysis tool in future :). It really does add something. :!:

@MeteoSangonera: 1) Thanks for the continued analysis, sorry I am late with the presentation. 2) Could you set the URL for your website in the corresponding value in the inifile for the Map module? I use the map for easy access to all sites / pwsFWI pages, in the current situation I click on your link and get my own site :(

Re: Cumulusutils

Posted: Fri 27 Dec 2019 3:26 pm
by PaulMy
Hi Hans,
I had continued the daily 5-days predictions/previous day actual logging until the end of November and could share that if helpful.

However not much to analyze here with snow and below freezing temps...

Enjoy,
Paul

Re: Cumulusutils

Posted: Fri 27 Dec 2019 5:54 pm
by HansR
Hi Paul,
That should be an interesting series as well. Not sure I would get any interesting result from it because, as you say it's all snow around freezing point, so little chance for a wild fire. But even then it would be interesting to see how the system behaves. So yes, please share (mail, PM or post here).
Cheers, Hans

Re: Cumulusutils

Posted: Fri 27 Dec 2019 6:11 pm
by PaulMy
File attached

Enjoy,
Paul

Re: Cumulusutils

Posted: Fri 27 Dec 2019 8:16 pm
by HansR
@all / @PaulMy :
I reworked the data from Paul as well and that leads to the attached graph. As we had already concluded that there won't be many forest fires in Komoka this winter, it shows what could be expected: the prediction/observation ratio shows a higher volatility at low warning than can be expected at high warning levels. (Note the scale of the right Y-axis is different from the first graph).

Re: Cumulusutils

Posted: Sat 28 Dec 2019 1:01 am
by hills
Hi Hans, thanks for directing me to this, its going to be really useful where I live.

I haven't read through this whole thread, but can you tell me if the easiest way to just put the FWI on my index.htm screen, like this without the history?: http://members.iinet.net.au/~storerfami ... r/test.htm

As I'm using raspbian, I can use awk to cut just the lines I want from your pwsFWI.txt file and insert into my indexT.htm, but was wondering if you had already created an option for this?

Thanks again... this is an excellent utility!! :clap:

Re: Cumulusutils

Posted: Sat 28 Dec 2019 9:09 am
by HansR
hills wrote: Sat 28 Dec 2019 1:01 am I haven't read through this whole thread, but can you tell me if the easiest way to just put the FWI on my index.htm screen, like this without the history?: http://members.iinet.net.au/~storerfami ... r/test.htm
I create a small separate file pwsFWIcurrent.txt, which contains the current value of pwsFWI in a HTML span-tag. The idea was to put that on a front page in a link to the actual pwsFWI page containing the main pwsFWI.txt information, therefore there is no easy way to split the pwsFWI information. Although I leave it to the user how to implement it - so I won't complain or oblige you to use it one way or another - I would like to ask you, to keep it all together and at least keep the copyright and reference lines at the bottom in tact. You can check with the others (and ask them) on how they implemented it. I was surprised by the variety of usage. @Pernaczy did a nice job on a PHP script to get info on the frontpage. But it is just a question of how far you want to go with it.
hills wrote: Sat 28 Dec 2019 1:01 am As I'm using raspbian, I can use awk to cut just the lines I want from your pwsFWI.txt file and insert into my indexT.htm, but was wondering if you had already created an option for this?
I did not make an option as I described above, but yes, you could do this. Please note my remark on the copyright/reference notice (I will add this remark to the README as well).
hills wrote: Sat 28 Dec 2019 1:01 am Thanks again... this is an excellent utility!! :clap:
Thanks again :D
And don't forget the map (where it started ;) )

Re: Cumulusutils

Posted: Sat 28 Dec 2019 12:40 pm
by hills
map done! ;) I've added both to my links page as they are and will look at putting the pwsFWIcurrent.txt on my index page tomorrow. :)

Re: Cumulusutils

Posted: Sun 29 Dec 2019 12:56 pm
by HansR
@hills: OK thanks. I added your site to the list. Would be nice if you embed the pwsFWI in a template page (so with the same colouring and menu).
Cheers, Hans

Re: Cumulusutils

Posted: Mon 30 Dec 2019 12:31 am
by hills
Yep, that's work in progress :) I'm not an html expert by a long shot and when I add your screen to my header, it makes part of your copywrite invisible, even though it can still be selected. I'll get there though. :)

Re: Cumulusutils

Posted: Mon 30 Dec 2019 2:19 am
by beteljuice
@hills

Your closing </body> and </html> statements are in the wrong place, and I suspect your 'content' div isn't closed ...

Re: Cumulusutils

Posted: Mon 30 Dec 2019 6:06 am
by hills
beteljuice wrote: Mon 30 Dec 2019 2:19 am @hills

Your closing </body> and </html> statements are in the wrong place, and I suspect your 'content' div isn't closed ...
Thanks mate, for taking the time to look over this! :D

Yes you're correct. I missed closing the 'content' div. but I was also trying to be lazy and just append pwsFWI.txt to the end of my html page. I now insert a "</div>" into the newly created pwsFWI.txt, then insert that into my html page and upload that. I suspect there's a much easier way of doing it, but this seems to be working.

Re: Cumulusutils

Posted: Thu 02 Jan 2020 8:20 pm
by meteosangonera
Hello

Since I updated the cumulusMX version at the end of 2019, cumulusutils has stopped working.

Attached error log:

Code: Select all

2020-01-02 13:05:08.381 CumulusUtils : ----------------------------
2020-01-02 13:05:08.384 CumulusUtils : Entering Main
2020-01-02 13:05:08.426 CommandLineArgs : starting
2020-01-02 13:05:08.426  CommandLineArgs : handling arg: pwsFWI
2020-01-02 13:05:08.427  CommandLineArgs : handling arg: Top10
2020-01-02 13:05:08.427  CommandLineArgs : handling arg: Graphs
2020-01-02 13:05:08.427  CommandLineArgs : handling arg: MapsOn
2020-01-02 13:05:08.428 CommandLineArgs : End
2020-01-02 13:05:08.446 MapsOn: Start
2020-01-02 13:05:09.565  DownloadXml: ResponseHeaders for Download:
Keep-Alive: timeout=5, max=100
Connection: Keep-Alive
Accept-Ranges: bytes
Content-Length: 3419
Content-Type: text/xml
Date: Thu, 02 Jan 2020 12:05:09 GMT
ETag: "d5b-59af3ce804a57"
Last-Modified: Mon, 30 Dec 2019 23:00:15 GMT
Server: Apache/2.4.6 (CentOS) OpenSSL/1.0.2k-fips mod_fcgid/2.3.9 PHP/5.5.35 mod_python/3.5.0- Python/2.7.5


2020-01-02 13:05:09.567  DownloadXml: Done
2020-01-02 13:05:09.600 Exception Unknown : La etiqueta de apertura 'Station' en la línea 67 posición 4 no coincide con la etiqueta de cierre de 'Stat'. línea 74, posición 5.
2020-01-02 13:05:09.636 Data (cont): System.Xml
2020-01-02 13:05:09.650 Data:    en System.Xml.XmlTextReaderImpl.Throw(Exception e)
   en System.Xml.XmlTextReaderImpl.Throw(String res, String[] args)
   en System.Xml.XmlTextReaderImpl.ThrowTagMismatch(NodeData startTag)
   en System.Xml.XmlTextReaderImpl.ParseEndElement()
   en System.Xml.XmlTextReaderImpl.ParseElementContent()
   en System.Xml.XmlTextReaderImpl.Read()
   en System.Xml.Linq.XContainer.ReadContentFrom(XmlReader r)
   en System.Xml.Linq.XContainer.ReadContentFrom(XmlReader r, LoadOptions o)
   en System.Xml.Linq.XElement.ReadElementFrom(XmlReader r, LoadOptions o)
   en System.Xml.Linq.XElement.Load(XmlReader reader, LoadOptions options)
   en System.Xml.Linq.XElement.Load(String uri, LoadOptions options)
   en CumulusUtils.Maps.MapsOn()
   en CumulusUtils.CMXutils.RealMain(String[] args)
   en CumulusUtils.CMXutils.Main(String[] args)
2020-01-02 13:05:09.651 Exiting - check log file
I can't solve the problem. Does anyone know why it might be?

Re: Cumulusutils

Posted: Thu 02 Jan 2020 9:22 pm
by HansR
@Meteosangonera, thanks for the report. Apparently it is just the maps module (if any other module fails let me know).

I analysed the error and it seemed the XML file (which defines the map) had been corrupted with the addition of the new station. The crash which followed was therefore a legitimate crash and was handled OK.

What should be:

Code: Select all

 
  [...] 
  </Station>
  <Station>
    <Name>Crafers Weather Station</Name>
    [...]


Had become:

Code: Select all

  
  [...] 
  </Station>
  <Stat  
    <Name>Crafers Weather Station</Name>
    [...]


I corrected the error on the server and I think it is all right now, but I will check the next few days it will not occur again.
I don't know the cause. It will need some additional analysis if it happens again.
Please @all, keep running maps so I can check. Check for yourself once in a while any module runs OK, report any failures here.

@pernaczy: your maps has not reported in since 13 December! Could you check the running of the maps module for your station? Thanks.

Re: Cumulusutils

Posted: Fri 03 Jan 2020 2:34 am
by Phil23
Just realised mine has been failing since 30/12 as well.
Checked the log & seeing exactly the same error.

Code: Select all

2020-01-03 13:25:24.249 Exception Unknown : The 'Station' start tag on line 67 position 4 does not match the end tag of 'Stat'. Line 74, position 5.
2020-01-03 13:25:24.374 Data (cont): System.Xml
2020-01-03 13:25:24.374 Data:    at System.Xml.XmlTextReaderImpl.Throw(Exception e)
Remove the Maps option & it completed normally.

Phil.