Page 1 of 3

NOAA Report Error [Solved]

Posted: Mon 13 Dec 2021 12:57 pm
by Cambium
Can't figure this one out. Did a search and can't seem to find a fix.

Attached is the MX Diags before the fix and after it.

I fixed the duplicate line but couldn't find the 0:03 where its saying so I changed all 0:03 to 0:04 in case. NOAA reports Still not working

Code: Select all

2021-12-13 07:35:32.285 Creating NOAA monthly report
2021-12-13 07:35:32.301 Duplicate entry at line 2 of dayfile.txt: 05/12/21. Please correct this by editing the file
2021-12-13 07:35:32.301 Error at line 159, column 1, value '0:03' of data\Dec21log.txt : System.FormatException: Input string was not in a correct format.
   at System.Number.StringToNumber(String str, NumberStyles options, NumberBuffer& number, NumberFormatInfo info, Boolean parseDecimal)
   at System.Number.ParseInt32(String s, NumberStyles style, NumberFormatInfo info)
   at System.Convert.ToInt32(String value)
   at CumulusMX.NOAA.CreateMonthlyReport(DateTime thedate)
2021-12-13 07:35:32.301 Please edit the file to correct the error
2021-12-13 07:35:32.301 Saving monthly NOAA report as Reports\NOAAMO1221.txt
2021-12-13 07:35:41.674 GetLogfile: Processing log file - data\Dec21log.txt
2021-12-13 07:35:41.706 GetLogfile: Finished processing log files
I fixed all that and it's still not working.

Image

Re: NOAA Report Error

Posted: Mon 13 Dec 2021 3:25 pm
by HansR

Code: Select all

Error at line 159, column 1, value '0:03'
I think you need to have '00:03'. The time in the dayfile has two digits for the hour and two for the minutes.
This may occur more often in the file so you may have to repeat this.

Re: NOAA Report Error

Posted: Mon 13 Dec 2021 6:43 pm
by Cambium
HansR wrote: Mon 13 Dec 2021 3:25 pm

Code: Select all

Error at line 159, column 1, value '0:03'
I think you need to have '00:03'. The time in the dayfile has two digits for the hour and two for the minutes.
This may occur more often in the file so you may have to repeat this.
Nope, that wasnt it. :cry:

Re: NOAA Report Error

Posted: Mon 13 Dec 2021 9:39 pm
by Cambium
Cambium wrote: Mon 13 Dec 2021 6:43 pm
HansR wrote: Mon 13 Dec 2021 3:25 pm

Code: Select all

Error at line 159, column 1, value '0:03'
I think you need to have '00:03'. The time in the dayfile has two digits for the hour and two for the minutes.
This may occur more often in the file so you may have to repeat this.
Nope, that wasnt it. :cry:
Yup, that was it. :bash: Didnt relize Excel didnt use the double digits for any of the AM time. SMH. I was just looking at the 00, not the 1am, 2am, 3am, ect, ect. :bash:

Thanks all.

Re: NOAA Report Error

Posted: Mon 13 Dec 2021 9:41 pm
by mcrossley
maybe post your file so we can take a look?

Re: NOAA Report Error

Posted: Tue 14 Dec 2021 12:17 pm
by Cambium
mcrossley wrote: Mon 13 Dec 2021 9:41 pm maybe post your file so we can take a look?
I figured out what I had wrong so that part is good now, thank you. But a new issue arose this morning. Cumulus didnt automatically create a line for yesterday December 13, so NOAA report isnt reading anything.

Hmmm.

I attached the Dayfile and the Diags. Thanks!

Re: NOAA Report Error

Posted: Tue 14 Dec 2021 12:33 pm
by HansR
You still have data errors in you datafiles:

Code: Select all

2021-12-13 07:58:22.090 Error at line 159, column 1, value '0:04' of data\Dec21log.txt : System.FormatException: Input string was not in a correct format.
   at System.Number.StringToNumber(String str, NumberStyles options, NumberBuffer& number, NumberFormatInfo info, Boolean parseDecimal)
   at System.Number.ParseInt32(String s, NumberStyles style, NumberFormatInfo info)
   at System.Convert.ToInt32(String value)
   at CumulusMX.NOAA.CreateMonthlyReport(DateTime thedate)
Note that this is not in your Dayfile but in your Dec21log.txt file.
When posting a datafile, please post the whole file as is and not just a few lines (or did you just start on the 6th of december?)
When a day is missed in dayfile for one reason or another, you should run CreateMissing.exe which should to the best of possibilities add missing data.

But before anything: make sure your data in the logfiles are OK.

Re: NOAA Report Error

Posted: Tue 14 Dec 2021 1:36 pm
by mcrossley
Cambium wrote: Mon 13 Dec 2021 9:39 pm Didnt relize Excel didnt use the double digits for any of the AM time. SMH.
One of the reasons we repeatedly recommend not to use Excel to edit the data files - unless you really know Excel and how to handle data files in it, there are all sorts of subtle ways it can change your data.

Re: NOAA Report Error

Posted: Tue 14 Dec 2021 10:39 pm
by Cambium
mcrossley wrote: Tue 14 Dec 2021 1:36 pm One of the reasons we repeatedly recommend not to use Excel to edit the data files - unless you really know Excel and how to handle data files in it, there are all sorts of subtle ways it can change your data.
Pretty familiar with it. Just a matter of reformatting the colum with a custom time format of hh:mm. But yeah, if you dont catch the different formats it'll bite you
HansR wrote: Tue 14 Dec 2021 12:33 pm You still have data errors in you datafiles:

Code: Select all

2021-12-13 07:58:22.090 Error at line 159, column 1, value '0:04' of data\Dec21log.txt : System.FormatException: Input string was not in a correct format.
   at System.Number.StringToNumber(String str, NumberStyles options, NumberBuffer& number, NumberFormatInfo info, Boolean parseDecimal)
   at System.Number.ParseInt32(String s, NumberStyles style, NumberFormatInfo info)
   at System.Convert.ToInt32(String value)
   at CumulusMX.NOAA.CreateMonthlyReport(DateTime thedate)
Note that this is not in your Dayfile but in your Dec21log.txt file.
When posting a datafile, please post the whole file as is and not just a few lines (or did you just start on the 6th of december?)
When a day is missed in dayfile for one reason or another, you should run CreateMissing.exe which should to the best of possibilities add missing data.

But before anything: make sure your data in the logfiles are OK.
That diags file was from yesterday. Sorry. Attached new one. The time has been fixed. Everything working except NOAA report didnt add the 13th . Cumulus didnt add it to the Dayfile.

Yes, I started on December 6th... or 5th maybe. Just got the station. I'd love to input previous months and years but thats another ballgame.

Re: NOAA Report Error

Posted: Wed 15 Dec 2021 12:20 pm
by Cambium
Ok, the 14th came up this morning but why are the low " 0 " ?

Image

Re: NOAA Report Error

Posted: Wed 15 Dec 2021 12:58 pm
by HansR
@Cambium:
Still errors in your datafile(s):

Code: Select all

2021-12-15 07:17:45.927 Creating NOAA yearly report
2021-12-15 07:17:46.755 Error at line 1927, column 7, value '0.0' of data\Dec21log.txt : System.FormatException: Input string was not in a correct format.
   at System.Number.StringToNumber(String str, NumberStyles options, NumberBuffer& number, NumberFormatInfo info, Boolean parseDecimal)
   at System.Number.ParseInt32(String s, NumberStyles style, NumberFormatInfo info)
   at System.Convert.ToInt32(String value)
   at CumulusMX.NOAA.GetAverageWindSpeed(Int32 month, Int32 year, Int32& domdir)
2021-12-15 07:17:46.755 Please edit the file to correct the error
2021-12-15 07:17:46.755 Saving yearly report as Reports\NOAAYR2021.txt
2021-12-15 07:17:46.755 NOAA reports will be uploaded at next web update
You can and should check the MXdiags yourself before posting because this is a repetition of the same/similar errors over and over. So when reading the diagnostics file you can find the error, correct and as such iterate until there are no errors left. This prevents overload of the forum support.
If it still does not work then we can look again.

Re: NOAA Report Error

Posted: Wed 15 Dec 2021 2:18 pm
by Cambium
HansR wrote: Wed 15 Dec 2021 12:58 pm @Cambium:
Still errors in your datafile(s):

Code: Select all

2021-12-15 07:17:45.927 Creating NOAA yearly report
2021-12-15 07:17:46.755 Error at line 1927, column 7, value '0.0' of data\Dec21log.txt : System.FormatException: Input string was not in a correct format.
   at System.Number.StringToNumber(String str, NumberStyles options, NumberBuffer& number, NumberFormatInfo info, Boolean parseDecimal)
   at System.Number.ParseInt32(String s, NumberStyles style, NumberFormatInfo info)
   at System.Convert.ToInt32(String value)
   at CumulusMX.NOAA.GetAverageWindSpeed(Int32 month, Int32 year, Int32& domdir)
2021-12-15 07:17:46.755 Please edit the file to correct the error
2021-12-15 07:17:46.755 Saving yearly report as Reports\NOAAYR2021.txt
2021-12-15 07:17:46.755 NOAA reports will be uploaded at next web update
You can and should check the MXdiags yourself before posting because this is a repetition of the same/similar errors over and over. So when reading the diagnostics file you can find the error, correct and as such iterate until there are no errors left. This prevents overload of the forum support.
If it still does not work then we can look again.
I apologize. Once I figure this out, I go away. I just want the NOAA report to work without me imputting the numbers. I fixed the errors but NOAA report still not reading the 13th of December.

Also.... If I added data from December 1st in the Dec21 log, how do I get it to show up in the Day file log?
Thanks

Re: NOAA Report Error

Posted: Wed 15 Dec 2021 3:06 pm
by Gyvate
That's a bit of detail work.
The dayfile.txt, as mentioned earlier by me (maybe in your 2nd, related post) has some max/min values, some summary values, some average values and related time stamps for each day - you can tell from the header description in the CumulusMX folder.
So for each day you will have to go through 1.440 entries (a minute based log asssumed - if it's 5 minute based then 288 entries) and create the daily entry from there.
To make this faster and easier I would use a copy of Dec21log.txt in MS Excel (rename to Dec21log.csv, load into Excel - then you can sort the columns inside Excel and easily find out max and min values). The timestamp needed comes with the record which contains the min or max value.

EDIT: Using the CreateMissing utiliy (see WiKi downloads) will be easier and faster - however the month file here Dec21log.txt must not contain any error - if there's an error (or more than one), the MXdiags file will tell which line and which position inside the line - usually it is a wrong format e.g. 3:00 instead of 03:00, a missing comma etc.

Re: NOAA Report Error

Posted: Wed 15 Dec 2021 3:29 pm
by PaulMy
Hi,
Also.... If I added data from December 1st in the Dec21 log, how do I get it to show up in the Day file log?
It looks like your Dec21 log file has data from Dec 1 to current, but I haven't looked closely to see if it is all ok.
Your dayfile.txt has data for Dec 3,7,8,10,12,14
You should run the CreateMissing utility to have it add the missing December days to your dayfile.txt. Then you should be able to ReGenerate the NOAA reports, unless there are more errors in the data files.

Enjoy,
Paul

Re: NOAA Report Error

Posted: Wed 15 Dec 2021 3:30 pm
by HansR
Cambium wrote: Wed 15 Dec 2021 2:18 pm I apologize. Once I figure this out, I go away. I just want the NOAA report to work without me imputting the numbers. I fixed the errors but NOAA report still not reading the 13th of December.

Also.... If I added data from December 1st in the Dec21 log, how do I get it to show up in the Day file log?
Thanks
You don't need to go away :)

You can't have the NOAA report to work if your input data are wrong. So
I just want the NOAA report to work without me imputting the numbers.
is merely impossible. You fixed errors, but if you look in the logfile, you did not fix all errors (or maybe created new ones).

1) Just fix all errors in your datafiles and the MXdiags file will tell you after every run if there are errors. It tells you the datafile, the line nr and the column. In previous posts and in the wiki you will find the exact format of the fields. Format errors can easily be solved by comparing those fields with previous lines where apparently it went well.
Unfortunately, we can't do it for you, it is a puzzle you have to solve yourself.

Then when no errors show up anymore you do the next step.

2) For the missing line of the 13th of december, I wrote above:
HansR wrote: Tue 14 Dec 2021 12:33 pm When a day is missed in dayfile for one reason or another, you should run CreateMissing.exe which should to the best of possibilities add missing data.
Also look in the wiki how to use CreateMissing. The wiki has the software download and a usage page for it.
But then again: CreateMissing also needs correctly formatted data.

When you really get stuck, ask, no problem.
But please, as long as you find errors in the logfile for the dayfile.txt or the monthly logfile(s) you will have to correct those errors, we can't do that.