Welcome to the Cumulus Support forum.

Latest Cumulus MX release v3.2.4 build 3060 - 10 December 2019.
    Legacy Cumulus 1 release v1.9.4 (build 1099) - 28 November 2014

    See the Wiki for downloading either version.

    alltime records editor

    Discussion of version 3 of Cumulus, which runs on Windows, Linux, and OS X. All Cumulus MX queries in here, please.

    Moderator: mcrossley

    Post Reply
    Dolmen
    Posts: 9
    Joined: Thu 23 Jan 2014 7:21 am
    Weather Station: Davis VP2
    Operating System: Windows 7
    Location: Genoa - Italy

    alltime records editor

    Post by Dolmen » Fri 29 Nov 2019 7:23 pm

    Hallo,
    I've just installed v3.2.0 build 3056, coming from v3.0.0. build 3048.
    I appreciate very much the new added features.

    My problem is in the alltime records editor section:
    the page shows only the list of my station's records, with value and timestamp (first three columns); the rest of the page is blank.
    At the bottom I can see the button "Fetch Monthly Log Data (caution, lenghty process)" (see attached pic n.1)
    pic1.png
    Clicking on the button, Cumulus correcly loads the records from Monthly Log data: after some minutes of work (I have 10 years of data, 1 minute interval) the loaded values and timestamps appears in their columns (pic. n. 2)
    Apparently, there's no way to make it extract data from dayfile
    pic2.png
    You do not have the required permissions to view the files attached to this post.

    Mapantz
    Posts: 640
    Joined: Sat 17 Dec 2011 11:55 am
    Weather Station: Davis Vantage Pro2
    Operating System: Windows 10 x64
    Location: Dorset - UK
    Contact:

    Re: alltime records editor

    Post by Mapantz » Fri 29 Nov 2019 9:23 pm

    I don't know for sure, but you may have an erroneous line somewhere in your dayfile?

    I only have just shy of 4 years worth, but both options are working ok for me.
    Image

    User avatar
    mcrossley
    Posts: 5817
    Joined: Thu 07 Jan 2010 9:44 pm
    Weather Station: Davis VP2
    Operating System: Stretch Lite rPi
    Location: Wilmslow, Cheshire, UK
    Contact:

    Re: alltime records editor

    Post by mcrossley » Sat 30 Nov 2019 4:29 pm

    Take a look in your MXdiags file and see if it is logging an error when reading the dayfile.

    Dolmen
    Posts: 9
    Joined: Thu 23 Jan 2014 7:21 am
    Weather Station: Davis VP2
    Operating System: Windows 7
    Location: Genoa - Italy

    Re: alltime records editor

    Post by Dolmen » Sun 01 Dec 2019 8:45 pm

    Thanks a lot for your answers :-)

    I've found the first 580 lines (almost two years of data!) in my dayfile.txt are written in hh.mm time format, the rest is in hh:mm format.
    I've deleted those "hh.mm" lines (I've made a backup copy first ;-)), and the editor now works!

    Question: is there a smart way to convert the old hh.mm lines into hh:mm?

    Thanks a lot,
    Alessandro

    User avatar
    mcrossley
    Posts: 5817
    Joined: Thu 07 Jan 2010 9:44 pm
    Weather Station: Davis VP2
    Operating System: Stretch Lite rPi
    Location: Wilmslow, Cheshire, UK
    Contact:

    Re: alltime records editor

    Post by mcrossley » Mon 02 Dec 2019 9:58 am

    Dolmen wrote:
    Sun 01 Dec 2019 8:45 pm
    Question: is there a smart way to convert the old hh.mm lines into hh:mm?
    Could be tricky or simple ;)

    Do you use a comma decimal?
    What is your list separator?

    If you use a comma decimal and say ";" as a separator then simple - can you not just replace all occurrences of "." with ":"?

    If the file uses a dot for other things in the first 580 lines then it is trickier.

    Dolmen
    Posts: 9
    Joined: Thu 23 Jan 2014 7:21 am
    Weather Station: Davis VP2
    Operating System: Windows 7
    Location: Genoa - Italy

    Re: alltime records editor

    Post by Dolmen » Mon 02 Dec 2019 6:14 pm

    mcrossley wrote:
    Mon 02 Dec 2019 9:58 am
    Dolmen wrote:
    Sun 01 Dec 2019 8:45 pm
    Question: is there a smart way to convert the old hh.mm lines into hh:mm?
    Could be tricky or simple ;)

    Do you use a comma decimal?
    What is your list separator?

    If you use a comma decimal and say ";" as a separator then simple - can you not just replace all occurrences of "." with ":"?

    If the file uses a dot for other things in the first 580 lines then it is trickier.
    I'm afraid we're on the trickier side: my file uses dot decimal :-/

    Weerhaas
    Posts: 7
    Joined: Mon 31 Aug 2015 6:31 am
    Weather Station: Vantage Pro 2 Plus
    Operating System: Windows Pro 10 32b
    Location: Zaandam, Nederland
    Contact:

    Re: alltime records editor

    Post by Weerhaas » Mon 02 Dec 2019 8:04 pm

    Maybe can you dayfile.txt export to Excel and split it in colums .
    Change the dot in the wrong columns to :

    rich27gc
    Posts: 74
    Joined: Thu 08 Jul 2010 3:15 pm
    Weather Station: WeatherDuino Pro2
    Operating System: Raspbian
    Location: Shap, Cumbria
    Contact:

    Re: alltime records editor

    Post by rich27gc » Mon 02 Dec 2019 8:26 pm

    I also have a problem with the dayfile in the All time records editor.
    When I open the editor an error is generated in the MXdiags folder : -

    2019-12-02 20:17:44.072 Error on line 1 of data/dayfile.txt: Invalid format.

    I've looked at the format of the dayfile and it looks fine the first few lines look like this : -

    13/01/10,6.0,315,21:20,-1.9,19:20,0.0,00:00,1000.0,00:00,1001.3,17:36,0.0,00:00,0.0,-1.3,2.9,2.2,21:50,,,,,,,,,,,,,,,,,,,,,,,,,,,
    14/01/10,6.9,90,16:36,-1.7,02:44,4.8,13:45,1000.4,01:34,1011.3,23:44,1.8,11:35,0.6,0.2,9.2,2.2,23:44,,,,,,,,,,,,,,,,,,,,,,,,,,,
    15/01/10,14.5,225,19:50,-1.3,00:14,4.6,19:57,1006.4,23:55,1011.4,00:14,3.6,20:02,4.5,2.4,34.0,6.0,19:30,,,,,,,,,,,,,,,,,,,,,,,,,,,

    The dayfile loads ok into the Data logs section on the CMX interface.

    I'm at a bit of a loss!! :?

    User avatar
    beteljuice
    Posts: 2792
    Joined: Tue 09 Dec 2008 1:37 pm
    Weather Station: None !
    Operating System: ex XP SP3 - now W10 laptop grr
    Location: Dudley, West Midlands, UK

    Re: alltime records editor

    Post by beteljuice » Mon 02 Dec 2019 9:50 pm

    You have lots of data missing ! (and the first couple of dozen lines are shorter than the rest)

    Here's all the fields you should have

    Also ... if this is your current dayfile.txt why does it end 21/05/(20)11 ?
    Image
    ......................Imagine, what you will KNOW tomorrow !

    User avatar
    mcrossley
    Posts: 5817
    Joined: Thu 07 Jan 2010 9:44 pm
    Weather Station: Davis VP2
    Operating System: Stretch Lite rPi
    Location: Wilmslow, Cheshire, UK
    Contact:

    Re: alltime records editor

    Post by mcrossley » Mon 02 Dec 2019 10:38 pm

    rich27gc wrote:
    Mon 02 Dec 2019 8:26 pm
    I also have a problem with the dayfile in the All time records editor.
    When I open the editor an error is generated in the MXdiags folder : -

    2019-12-02 20:17:44.072 Error on line 1 of data/dayfile.txt: Invalid format.

    I've looked at the format of the dayfile and it looks fine the first few lines look like this : -

    13/01/10,6.0,315,21:20,-1.9,19:20,0.0,00:00,1000.0,00:00,1001.3,17:36,0.0,00:00,0.0,-1.3,2.9,2.2,21:50,,,,,,,,,,,,,,,,,,,,,,,,,,,
    14/01/10,6.9,90,16:36,-1.7,02:44,4.8,13:45,1000.4,01:34,1011.3,23:44,1.8,11:35,0.6,0.2,9.2,2.2,23:44,,,,,,,,,,,,,,,,,,,,,,,,,,,
    15/01/10,14.5,225,19:50,-1.3,00:14,4.6,19:57,1006.4,23:55,1011.4,00:14,3.6,20:02,4.5,2.4,34.0,6.0,19:30,,,,,,,,,,,,,,,,,,,,,,,,,,,

    The dayfile loads ok into the Data logs section on the CMX interface.

    I'm at a bit of a loss!! :?
    I see the problem, the entries created with very old versions of Cumulus did not have as many records as later versions - they also predate the Wiki information.

    Another problem is the appended empty fields -was this file edited in Excel or similar at some point? They are not taken into account in my code as I just count the number of fields and assumed they would have data in them - lazy coding, I'll fix it.

    Weerhaas
    Posts: 7
    Joined: Mon 31 Aug 2015 6:31 am
    Weather Station: Vantage Pro 2 Plus
    Operating System: Windows Pro 10 32b
    Location: Zaandam, Nederland
    Contact:

    Re: alltime records editor

    Post by Weerhaas » Mon 02 Dec 2019 10:58 pm

    Maybe you can use something like this?

    Put the php file and dayfile.txt in the same folder.

    <!DOCTYPE HTML>
    <html>
    <head>
    <title>convert hh:mm naar hh.mm</title>
    </head>
    <body>

    <?php
    $path_to_file = 'dayfile.txt';
    $file_contents = file_get_contents($path_to_file);
    $file_contents = str_replace("00.00","00:00",$file_contents);
    $file_contents = str_replace("00.01","00:01",$file_contents);
    $file_contents = str_replace("00.02","00:02",$file_contents);
    $file_contents = str_replace("00.03","00:03",$file_contents);
    $file_contents = str_replace("00.04","00:04",$file_contents);

    file_put_contents($path_to_file,$file_contents);
    echo "FINISHED";

    ?>
    </body>
    </html>

    rich27gc
    Posts: 74
    Joined: Thu 08 Jul 2010 3:15 pm
    Weather Station: WeatherDuino Pro2
    Operating System: Raspbian
    Location: Shap, Cumbria
    Contact:

    Re: alltime records editor

    Post by rich27gc » Tue 03 Dec 2019 4:57 pm

    mcrossley wrote:
    Mon 02 Dec 2019 10:38 pm
    rich27gc wrote:
    Mon 02 Dec 2019 8:26 pm
    I also have a problem with the dayfile in the All time records editor.
    When I open the editor an error is generated in the MXdiags folder : -

    2019-12-02 20:17:44.072 Error on line 1 of data/dayfile.txt: Invalid format.

    I've looked at the format of the dayfile and it looks fine the first few lines look like this : -

    13/01/10,6.0,315,21:20,-1.9,19:20,0.0,00:00,1000.0,00:00,1001.3,17:36,0.0,00:00,0.0,-1.3,2.9,2.2,21:50,,,,,,,,,,,,,,,,,,,,,,,,,,,
    14/01/10,6.9,90,16:36,-1.7,02:44,4.8,13:45,1000.4,01:34,1011.3,23:44,1.8,11:35,0.6,0.2,9.2,2.2,23:44,,,,,,,,,,,,,,,,,,,,,,,,,,,
    15/01/10,14.5,225,19:50,-1.3,00:14,4.6,19:57,1006.4,23:55,1011.4,00:14,3.6,20:02,4.5,2.4,34.0,6.0,19:30,,,,,,,,,,,,,,,,,,,,,,,,,,,

    The dayfile loads ok into the Data logs section on the CMX interface.

    I'm at a bit of a loss!! :?
    I see the problem, the entries created with very old versions of Cumulus did not have as many records as later versions - they also predate the Wiki information.

    Another problem is the appended empty fields -was this file edited in Excel or similar at some point? They are not taken into account in my code as I just count the number of fields and assumed they would have data in them - lazy coding, I'll fix it.
    The new update B3058 has fixed the problem.
    Thanks Mark :clap:

    User avatar
    mcrossley
    Posts: 5817
    Joined: Thu 07 Jan 2010 9:44 pm
    Weather Station: Davis VP2
    Operating System: Stretch Lite rPi
    Location: Wilmslow, Cheshire, UK
    Contact:

    Re: alltime records editor

    Post by mcrossley » Tue 03 Dec 2019 5:50 pm

    Great, thanks for confirming.

    Dolmen
    Posts: 9
    Joined: Thu 23 Jan 2014 7:21 am
    Weather Station: Davis VP2
    Operating System: Windows 7
    Location: Genoa - Italy

    Re: alltime records editor

    Post by Dolmen » Thu 05 Dec 2019 6:20 pm

    mcrossley wrote:
    Mon 02 Dec 2019 9:58 am
    Dolmen wrote:
    Sun 01 Dec 2019 8:45 pm
    Question: is there a smart way to convert the old hh.mm lines into hh:mm?
    Could be tricky or simple ;)

    Do you use a comma decimal?
    What is your list separator?

    If you use a comma decimal and say ";" as a separator then simple - can you not just replace all occurrences of "." with ":"?

    If the file uses a dot for other things in the first 580 lines then it is trickier.
    I succeded, using an advanced text editor: Find/Replace with regular expression

    Code: Select all

    Find ;(\d\d)[.](\d\d);
    Replace with ;(\1):(\2);
    CMX records editor works great now!

    Thank you,
    Alessandro

    Weerhaas
    Posts: 7
    Joined: Mon 31 Aug 2015 6:31 am
    Weather Station: Vantage Pro 2 Plus
    Operating System: Windows Pro 10 32b
    Location: Zaandam, Nederland
    Contact:

    Re: alltime records editor

    Post by Weerhaas » Fri 06 Dec 2019 8:28 am

    Thanks.

    That works nice in Notepad++

    Post Reply