Welcome to the Cumulus Support forum.

Latest Cumulus MX release 3.8.0 (build 3090) - 12 August 2020 (please see important announcement regarding releases since 3.5.0)
Legacy Cumulus 1 release v1.9.4 (build 1099) - 28 November 2014 (a patch is available for 1.9.4 build 1099 that extends the date range of the NOAA report and Snow Index drop-down menus to 2030)

Use this link to Download the Software (Cumulus MX / Cumulus 1 and other related items). Software

alltime records editor

From build 3044 the development baton passed to Mark Crossley. Mark has been responsible for all the Builds since. He has made the code available on GitHub. It is Mark's hope that others will join in this development, but at the very least he welcomes your ideas for future developments (see Cumulus MX Development suggestions).

Moderator: mcrossley

Post Reply
Dolmen
Posts: 9
Joined: Thu 23 Jan 2014 7:21 am
Weather Station: Davis VP2
Operating System: Windows 7
Location: Genoa - Italy

alltime records editor

Post by Dolmen »

Hallo,
I've just installed v3.2.0 build 3056, coming from v3.0.0. build 3048.
I appreciate very much the new added features.

My problem is in the alltime records editor section:
the page shows only the list of my station's records, with value and timestamp (first three columns); the rest of the page is blank.
At the bottom I can see the button "Fetch Monthly Log Data (caution, lenghty process)" (see attached pic n.1)
pic1.png
Clicking on the button, Cumulus correcly loads the records from Monthly Log data: after some minutes of work (I have 10 years of data, 1 minute interval) the loaded values and timestamps appears in their columns (pic. n. 2)
Apparently, there's no way to make it extract data from dayfile
pic2.png
You do not have the required permissions to view the files attached to this post.

Mapantz
Posts: 773
Joined: Sat 17 Dec 2011 11:55 am
Weather Station: Davis Vantage Pro2
Operating System: Windows 10 x64
Location: Dorset - UK
Contact:

Re: alltime records editor

Post by Mapantz »

I don't know for sure, but you may have an erroneous line somewhere in your dayfile?

I only have just shy of 4 years worth, but both options are working ok for me.
Image

User avatar
mcrossley
Posts: 6765
Joined: Thu 07 Jan 2010 9:44 pm
Weather Station: Davis VP2
Operating System: Buster Lite rPi
Location: Wilmslow, Cheshire, UK
Contact:

Re: alltime records editor

Post by mcrossley »

Take a look in your MXdiags file and see if it is logging an error when reading the dayfile.

Dolmen
Posts: 9
Joined: Thu 23 Jan 2014 7:21 am
Weather Station: Davis VP2
Operating System: Windows 7
Location: Genoa - Italy

Re: alltime records editor

Post by Dolmen »

Thanks a lot for your answers :-)

I've found the first 580 lines (almost two years of data!) in my dayfile.txt are written in hh.mm time format, the rest is in hh:mm format.
I've deleted those "hh.mm" lines (I've made a backup copy first ;-)), and the editor now works!

Question: is there a smart way to convert the old hh.mm lines into hh:mm?

Thanks a lot,
Alessandro

User avatar
mcrossley
Posts: 6765
Joined: Thu 07 Jan 2010 9:44 pm
Weather Station: Davis VP2
Operating System: Buster Lite rPi
Location: Wilmslow, Cheshire, UK
Contact:

Re: alltime records editor

Post by mcrossley »

Dolmen wrote:
Sun 01 Dec 2019 8:45 pm
Question: is there a smart way to convert the old hh.mm lines into hh:mm?
Could be tricky or simple ;)

Do you use a comma decimal?
What is your list separator?

If you use a comma decimal and say ";" as a separator then simple - can you not just replace all occurrences of "." with ":"?

If the file uses a dot for other things in the first 580 lines then it is trickier.

Dolmen
Posts: 9
Joined: Thu 23 Jan 2014 7:21 am
Weather Station: Davis VP2
Operating System: Windows 7
Location: Genoa - Italy

Re: alltime records editor

Post by Dolmen »

mcrossley wrote:
Mon 02 Dec 2019 9:58 am
Dolmen wrote:
Sun 01 Dec 2019 8:45 pm
Question: is there a smart way to convert the old hh.mm lines into hh:mm?
Could be tricky or simple ;)

Do you use a comma decimal?
What is your list separator?

If you use a comma decimal and say ";" as a separator then simple - can you not just replace all occurrences of "." with ":"?

If the file uses a dot for other things in the first 580 lines then it is trickier.
I'm afraid we're on the trickier side: my file uses dot decimal :-/

Weerhaas
Posts: 10
Joined: Mon 31 Aug 2015 6:31 am
Weather Station: Vantage Pro 2 Plus
Operating System: Windows Pro 10 32b
Location: Zaandam, Nederland
Contact:

Re: alltime records editor

Post by Weerhaas »

Maybe can you dayfile.txt export to Excel and split it in colums .
Change the dot in the wrong columns to :

rich27gc
Posts: 75
Joined: Thu 08 Jul 2010 3:15 pm
Weather Station: WeatherDuino Pro2
Operating System: Raspbian
Location: Shap, Cumbria
Contact:

Re: alltime records editor

Post by rich27gc »

I also have a problem with the dayfile in the All time records editor.
When I open the editor an error is generated in the MXdiags folder : -

2019-12-02 20:17:44.072 Error on line 1 of data/dayfile.txt: Invalid format.

I've looked at the format of the dayfile and it looks fine the first few lines look like this : -

13/01/10,6.0,315,21:20,-1.9,19:20,0.0,00:00,1000.0,00:00,1001.3,17:36,0.0,00:00,0.0,-1.3,2.9,2.2,21:50,,,,,,,,,,,,,,,,,,,,,,,,,,,
14/01/10,6.9,90,16:36,-1.7,02:44,4.8,13:45,1000.4,01:34,1011.3,23:44,1.8,11:35,0.6,0.2,9.2,2.2,23:44,,,,,,,,,,,,,,,,,,,,,,,,,,,
15/01/10,14.5,225,19:50,-1.3,00:14,4.6,19:57,1006.4,23:55,1011.4,00:14,3.6,20:02,4.5,2.4,34.0,6.0,19:30,,,,,,,,,,,,,,,,,,,,,,,,,,,

The dayfile loads ok into the Data logs section on the CMX interface.

I'm at a bit of a loss!! :?

User avatar
beteljuice
Posts: 2978
Joined: Tue 09 Dec 2008 1:37 pm
Weather Station: None !
Operating System: W10 - Threadripper 16core, etc
Location: Dudley, West Midlands, UK

Re: alltime records editor

Post by beteljuice »

You have lots of data missing ! (and the first couple of dozen lines are shorter than the rest)

Here's all the fields you should have

Also ... if this is your current dayfile.txt why does it end 21/05/(20)11 ?
Image
......................Imagine, what you will KNOW tomorrow !

User avatar
mcrossley
Posts: 6765
Joined: Thu 07 Jan 2010 9:44 pm
Weather Station: Davis VP2
Operating System: Buster Lite rPi
Location: Wilmslow, Cheshire, UK
Contact:

Re: alltime records editor

Post by mcrossley »

rich27gc wrote:
Mon 02 Dec 2019 8:26 pm
I also have a problem with the dayfile in the All time records editor.
When I open the editor an error is generated in the MXdiags folder : -

2019-12-02 20:17:44.072 Error on line 1 of data/dayfile.txt: Invalid format.

I've looked at the format of the dayfile and it looks fine the first few lines look like this : -

13/01/10,6.0,315,21:20,-1.9,19:20,0.0,00:00,1000.0,00:00,1001.3,17:36,0.0,00:00,0.0,-1.3,2.9,2.2,21:50,,,,,,,,,,,,,,,,,,,,,,,,,,,
14/01/10,6.9,90,16:36,-1.7,02:44,4.8,13:45,1000.4,01:34,1011.3,23:44,1.8,11:35,0.6,0.2,9.2,2.2,23:44,,,,,,,,,,,,,,,,,,,,,,,,,,,
15/01/10,14.5,225,19:50,-1.3,00:14,4.6,19:57,1006.4,23:55,1011.4,00:14,3.6,20:02,4.5,2.4,34.0,6.0,19:30,,,,,,,,,,,,,,,,,,,,,,,,,,,

The dayfile loads ok into the Data logs section on the CMX interface.

I'm at a bit of a loss!! :?
I see the problem, the entries created with very old versions of Cumulus did not have as many records as later versions - they also predate the Wiki information.

Another problem is the appended empty fields -was this file edited in Excel or similar at some point? They are not taken into account in my code as I just count the number of fields and assumed they would have data in them - lazy coding, I'll fix it.

Weerhaas
Posts: 10
Joined: Mon 31 Aug 2015 6:31 am
Weather Station: Vantage Pro 2 Plus
Operating System: Windows Pro 10 32b
Location: Zaandam, Nederland
Contact:

Re: alltime records editor

Post by Weerhaas »

Maybe you can use something like this?

Put the php file and dayfile.txt in the same folder.

<!DOCTYPE HTML>
<html>
<head>
<title>convert hh:mm naar hh.mm</title>
</head>
<body>

<?php
$path_to_file = 'dayfile.txt';
$file_contents = file_get_contents($path_to_file);
$file_contents = str_replace("00.00","00:00",$file_contents);
$file_contents = str_replace("00.01","00:01",$file_contents);
$file_contents = str_replace("00.02","00:02",$file_contents);
$file_contents = str_replace("00.03","00:03",$file_contents);
$file_contents = str_replace("00.04","00:04",$file_contents);

file_put_contents($path_to_file,$file_contents);
echo "FINISHED";

?>
</body>
</html>

rich27gc
Posts: 75
Joined: Thu 08 Jul 2010 3:15 pm
Weather Station: WeatherDuino Pro2
Operating System: Raspbian
Location: Shap, Cumbria
Contact:

Re: alltime records editor

Post by rich27gc »

mcrossley wrote:
Mon 02 Dec 2019 10:38 pm
rich27gc wrote:
Mon 02 Dec 2019 8:26 pm
I also have a problem with the dayfile in the All time records editor.
When I open the editor an error is generated in the MXdiags folder : -

2019-12-02 20:17:44.072 Error on line 1 of data/dayfile.txt: Invalid format.

I've looked at the format of the dayfile and it looks fine the first few lines look like this : -

13/01/10,6.0,315,21:20,-1.9,19:20,0.0,00:00,1000.0,00:00,1001.3,17:36,0.0,00:00,0.0,-1.3,2.9,2.2,21:50,,,,,,,,,,,,,,,,,,,,,,,,,,,
14/01/10,6.9,90,16:36,-1.7,02:44,4.8,13:45,1000.4,01:34,1011.3,23:44,1.8,11:35,0.6,0.2,9.2,2.2,23:44,,,,,,,,,,,,,,,,,,,,,,,,,,,
15/01/10,14.5,225,19:50,-1.3,00:14,4.6,19:57,1006.4,23:55,1011.4,00:14,3.6,20:02,4.5,2.4,34.0,6.0,19:30,,,,,,,,,,,,,,,,,,,,,,,,,,,

The dayfile loads ok into the Data logs section on the CMX interface.

I'm at a bit of a loss!! :?
I see the problem, the entries created with very old versions of Cumulus did not have as many records as later versions - they also predate the Wiki information.

Another problem is the appended empty fields -was this file edited in Excel or similar at some point? They are not taken into account in my code as I just count the number of fields and assumed they would have data in them - lazy coding, I'll fix it.
The new update B3058 has fixed the problem.
Thanks Mark :clap:

User avatar
mcrossley
Posts: 6765
Joined: Thu 07 Jan 2010 9:44 pm
Weather Station: Davis VP2
Operating System: Buster Lite rPi
Location: Wilmslow, Cheshire, UK
Contact:

Re: alltime records editor

Post by mcrossley »

Great, thanks for confirming.

Dolmen
Posts: 9
Joined: Thu 23 Jan 2014 7:21 am
Weather Station: Davis VP2
Operating System: Windows 7
Location: Genoa - Italy

Re: alltime records editor

Post by Dolmen »

mcrossley wrote:
Mon 02 Dec 2019 9:58 am
Dolmen wrote:
Sun 01 Dec 2019 8:45 pm
Question: is there a smart way to convert the old hh.mm lines into hh:mm?
Could be tricky or simple ;)

Do you use a comma decimal?
What is your list separator?

If you use a comma decimal and say ";" as a separator then simple - can you not just replace all occurrences of "." with ":"?

If the file uses a dot for other things in the first 580 lines then it is trickier.
I succeded, using an advanced text editor: Find/Replace with regular expression

Code: Select all

Find ;(\d\d)[.](\d\d);
Replace with ;(\1):(\2);
CMX records editor works great now!

Thank you,
Alessandro

Weerhaas
Posts: 10
Joined: Mon 31 Aug 2015 6:31 am
Weather Station: Vantage Pro 2 Plus
Operating System: Windows Pro 10 32b
Location: Zaandam, Nederland
Contact:

Re: alltime records editor

Post by Weerhaas »

Thanks.

That works nice in Notepad++

Post Reply