Problem with "Create missing"

[JacquesD]

Hi,

I've installed 1.9.3 yesterday on "official" station and this morning
there was a rain spike, so I go to Edit --> Dayfile.txt and seen pretty
irregular lines, so I've taked "Create Mising" and it inserted 691 lines!
(Station is online since 27-04-2010 - 932 days!)

Now, fetch dayfile data button, In Edit records, produce no results.
When I start Cumulus, I have a lot of errors (1029), like this one:

2013-02-10 09:00:18.520 : Error plotting charts at line 1029 of dayfile.txt: '''' is not a valid integer value
2013-02-10 09:00:18.520 : Please correct the error by editing dayfile.txt

Something could be done? (I have backup, before 1.9.3 install )

Thanks,
JacquesD
Ps... Files included: Dayfiles.txt (before and after) and Diags folder

[steve]

I think it's something to do with your date format of dd-mm-yy (with '-' separators). I see that your file was already corrupt anyway, before:

Code: Select all

31-07-10;20,9;202;15:49;8,2;05:36;27,9;18:00;1016,5;17:52;1018,6;06:56;0,0;00:00;0,0;18,4;25,2;6,4;11:17;;;;;;;;;;;;;;;;;;;;;;;
31-07-11;15,8;180;18:23;11,4;05:41;31,0;15:33;1004,3;23:53;1010,0;08:46;0,0;00:00;0,0;22,0;53,4;7,5;18:25;39;14:04;100;01:54;0,00;0,0;31,9;15:42;33,2;15:35;11,8;05:41;0,0;00:00;11,4;05:41;18,8;10:50;11,2;05:41;;;
31-07-12;29,5;180;13:38;17,9;05:26;32,3;15:44;1013,1;23:57;1018,4;08:48;0,0;00:00;0,0;25,5;242,7;185,0;11:18;35;17:46;97;05:36;0,00;0,0;35,0;15:44;34,5;15:44;-2,9;11:18;0,0;00:00;17,9;05:26;22,4;12:23;14,0;17:55;195;0,0;7,2

This looks like the sorting problem that affected people with US date formats that I fixed in build 1053. It appears that it also affected people like you who have '-' as date separators.

You also have duplicated entries in your 'before' file, e.g:

Code: Select all

31-12-11;0,0;0;00:00;0,0;00:00;0,0;00:00;0,0;00:00;0,0;00:00;0,0;00:00;0,0;0,0;0,0;0,0;00:00;0;00:00;0;00:00;0,00;0,0;0,0;00:00;0,0;00:00;0,0;00:00;0,0;00:00;0,0;00:00;2,8;00:00;2,8;00:00;0;0,0;0,0
31-12-11;0,0;0;00:00;0,0;00:00;0,0;00:00;989,3;13:39;995,1;00:24;0,0;00:00;0,0;0,0;0,0;0,0;00:00;0;00:00;0;00:00;0,00;0,0;0,0;00:00;0,0;00:00;0,0;00:00;0,0;00:00;0,0;00:00;2,8;00:00;2,8;00:00;0;0,0;0,0
31-12-11;0,0;0;00:04;0,0;00:04;0,0;00:04;0,0;00:04;0,0;00:04;0,0;00:04;0,0;0,0;0,0;0,0;00:04;0;00:04;0;00:04;0,00;0,0;0,0;00:04;0,0;00:04;0,0;00:04;0,0;00:04;0,0;00:04;2,8;00:04;2,8;00:04;0;0,0;0,0
31-12-11;0,0;0;00:14;0,0;00:14;0,0;00:14;0,0;00:14;0,0;00:14;0,0;00:14;0,0;0,0;0,0;0,0;00:14;0;00:14;0;00:14;0,00;0,0;0,0;00:14;0,0;00:14;0,0;00:14;0,0;00:14;0,0;00:14;2,8;00:14;2,8;00:14;0;0,0;0,0
31-12-11;0,0;0;00:14;0,0;00:14;0,0;00:14;0,0;00:14;0,0;00:14;0,0;00:14;0,0;0,0;0,0;0,0;00:14;0;00:14;0;00:14;0,00;0,0;0,0;00:14;0,0;00:14;0,0;00:14;0,0;00:14;0,0;00:14;2,8;00:14;2,8;00:14;0;0,0;0,0

Your 'after' file has entries with no dates. I don't know whether this is a result of the fix I did in build 1053.

I'll investigate; but if you revert to your 'before' file, you will need to correct it anyway.

[steve]

I've tried switching to your date format yyyy-mm-dd, and using 'create missing', and it worked fine, so I think there must be some problem with your data files. Could you zip up your entire data folder and attach it, please?

[JacquesD]

Hi Steve,

I've worked on Dayfile.txt to correct duplicate lines. Then data in this file are ok!
So, now Cumulus standard date is generated this way (yyyy-mm-dd)?

Thanks,
JacquesD

[steve]

So, now Cumulus standard date is generated this way (yyyy-mm-dd)?

No, the date in dayfile.txt is dd/mm/yy the same as always (but it uses "-" instead of "/" if that's what your system uses).

I changed my settings to French (Canada), installed your data folder, and did a 'create missing'. It created an entry for 9th Feb, and the saved file was fine. So I'm afraid I have no idea what happened when you tried it, unless it was something to do with the problems that were already there in dayfile.txt. If you try it again now, it should work.

[JacquesD]

Hi Steve,

Yes, all is back to normal!!

Thanks for your (as always) prompt reply!
(I don't know how Bill is charging for a 15mins reply a sunday am? )

Kind regards,
Jacques