Page 1 of 1

Problem with "Create missing"

Posted: Sun 10 Feb 2013 2:47 pm
by JacquesD
Hi,

I've installed 1.9.3 yesterday on "official" station and this morning
there was a rain spike, so I go to Edit --> Dayfile.txt and seen pretty
irregular lines, so I've taked "Create Mising" and it inserted 691 lines!
(Station is online since 27-04-2010 - 932 days!)

Now, fetch dayfile data button, In Edit records, produce no results.
When I start Cumulus, I have a lot of errors (1029), like this one:

2013-02-10 09:00:18.520 : Error plotting charts at line 1029 of dayfile.txt: '''' is not a valid integer value
2013-02-10 09:00:18.520 : Please correct the error by editing dayfile.txt


Something could be done? (I have backup, before 1.9.3 install )

Thanks,
JacquesD
Ps... Files included: Dayfiles.txt (before and after) and Diags folder

Re: Problem with "Create missing"

Posted: Sun 10 Feb 2013 3:02 pm
by steve
I think it's something to do with your date format of dd-mm-yy (with '-' separators). I see that your file was already corrupt anyway, before:

Code: Select all

31-07-10;20,9;202;15:49;8,2;05:36;27,9;18:00;1016,5;17:52;1018,6;06:56;0,0;00:00;0,0;18,4;25,2;6,4;11:17;;;;;;;;;;;;;;;;;;;;;;;
31-07-11;15,8;180;18:23;11,4;05:41;31,0;15:33;1004,3;23:53;1010,0;08:46;0,0;00:00;0,0;22,0;53,4;7,5;18:25;39;14:04;100;01:54;0,00;0,0;31,9;15:42;33,2;15:35;11,8;05:41;0,0;00:00;11,4;05:41;18,8;10:50;11,2;05:41;;;
31-07-12;29,5;180;13:38;17,9;05:26;32,3;15:44;1013,1;23:57;1018,4;08:48;0,0;00:00;0,0;25,5;242,7;185,0;11:18;35;17:46;97;05:36;0,00;0,0;35,0;15:44;34,5;15:44;-2,9;11:18;0,0;00:00;17,9;05:26;22,4;12:23;14,0;17:55;195;0,0;7,2
This looks like the sorting problem that affected people with US date formats that I fixed in build 1053. It appears that it also affected people like you who have '-' as date separators.

You also have duplicated entries in your 'before' file, e.g:

Code: Select all

31-12-11;0,0;0;00:00;0,0;00:00;0,0;00:00;0,0;00:00;0,0;00:00;0,0;00:00;0,0;0,0;0,0;0,0;00:00;0;00:00;0;00:00;0,00;0,0;0,0;00:00;0,0;00:00;0,0;00:00;0,0;00:00;0,0;00:00;2,8;00:00;2,8;00:00;0;0,0;0,0
31-12-11;0,0;0;00:00;0,0;00:00;0,0;00:00;989,3;13:39;995,1;00:24;0,0;00:00;0,0;0,0;0,0;0,0;00:00;0;00:00;0;00:00;0,00;0,0;0,0;00:00;0,0;00:00;0,0;00:00;0,0;00:00;0,0;00:00;2,8;00:00;2,8;00:00;0;0,0;0,0
31-12-11;0,0;0;00:04;0,0;00:04;0,0;00:04;0,0;00:04;0,0;00:04;0,0;00:04;0,0;0,0;0,0;0,0;00:04;0;00:04;0;00:04;0,00;0,0;0,0;00:04;0,0;00:04;0,0;00:04;0,0;00:04;0,0;00:04;2,8;00:04;2,8;00:04;0;0,0;0,0
31-12-11;0,0;0;00:14;0,0;00:14;0,0;00:14;0,0;00:14;0,0;00:14;0,0;00:14;0,0;0,0;0,0;0,0;00:14;0;00:14;0;00:14;0,00;0,0;0,0;00:14;0,0;00:14;0,0;00:14;0,0;00:14;0,0;00:14;2,8;00:14;2,8;00:14;0;0,0;0,0
31-12-11;0,0;0;00:14;0,0;00:14;0,0;00:14;0,0;00:14;0,0;00:14;0,0;00:14;0,0;0,0;0,0;0,0;00:14;0;00:14;0;00:14;0,00;0,0;0,0;00:14;0,0;00:14;0,0;00:14;0,0;00:14;0,0;00:14;2,8;00:14;2,8;00:14;0;0,0;0,0
Your 'after' file has entries with no dates. I don't know whether this is a result of the fix I did in build 1053.

I'll investigate; but if you revert to your 'before' file, you will need to correct it anyway.

Re: Problem with "Create missing"

Posted: Sun 10 Feb 2013 3:19 pm
by steve
I've tried switching to your date format yyyy-mm-dd, and using 'create missing', and it worked fine, so I think there must be some problem with your data files. Could you zip up your entire data folder and attach it, please?

Re: Problem with "Create missing"

Posted: Sun 10 Feb 2013 4:55 pm
by JacquesD
Hi Steve,

I've worked on Dayfile.txt to correct duplicate lines. Then data in this file are ok!
So, now Cumulus standard date is generated this way (yyyy-mm-dd)?

Thanks,
JacquesD

Re: Problem with "Create missing"

Posted: Sun 10 Feb 2013 5:05 pm
by steve
JacquesD wrote:So, now Cumulus standard date is generated this way (yyyy-mm-dd)?
No, the date in dayfile.txt is dd/mm/yy the same as always (but it uses "-" instead of "/" if that's what your system uses).

I changed my settings to French (Canada), installed your data folder, and did a 'create missing'. It created an entry for 9th Feb, and the saved file was fine. So I'm afraid I have no idea what happened when you tried it, unless it was something to do with the problems that were already there in dayfile.txt. If you try it again now, it should work.

Re: Problem with "Create missing"

Posted: Sun 10 Feb 2013 5:19 pm
by JacquesD
Hi Steve,

Yes, all is back to normal!! :D

Thanks for your (as always) prompt reply!
(I don't know how Bill is charging for a 15mins reply a sunday am? :lol: )

Kind regards,
Jacques