Page 1 of 1
Replace Missing Data Files with Report Files
Posted: Fri 24 Jun 2016 1:36 am
by apple8
Some time ago due to a PC malfunction I lost a lot of data. I now have a gap of over a year in the Data files. I do have however all the monthly NOAA Report files for the missing months.
Does anyone know of a process that I could convert data in the NOAA Report files to Data files or if it is even possible.
Re: Replace Missing Data Files with Report Files
Posted: Fri 24 Jun 2016 7:32 am
by steve
There isn't the correct type of data in the NOOA reports for recreating the minute-by-minute data for the monthly logs, they are summaries. There is sufficient information to create only a subset of the daily summaries in dayfile.txt.
Re: Replace Missing Data Files with Report Files
Posted: Fri 24 Jun 2016 12:04 pm
by apple8
steve wrote:There is sufficient information to create only a subset of the daily summaries in dayfile.txt.
I see what your saying and have come to that conclusion too overnight.
Just trying to work out how to do that, one is manually entering each cell through dayfile.txt editor, a big job with 10 entries for each day. What I have tried is import into excel the NOAA data as a csv, re-sort columns under the dayfileheaders, save as a csv, open as a text file and then select and paste into the dayfile. Sound a bit complex but I think that might be the way to go.
Thoughts on this approach?
Re: Replace Missing Data Files with Report Files
Posted: Fri 24 Jun 2016 1:18 pm
by steve
Yes, I don't think you'll do any better than that, without writing a program or script to fully automate the process.
Re: Replace Missing Data Files with Report Files
Posted: Mon 27 Jun 2016 3:02 pm
by apple8
Mostly going well, it has been a bit tricky and I am working through it.
I am getting errors when I do a this month and year search and get: Error at line xxx of dayfile.txt: " is not a valid floating point value.
I can't see any " in the lines so is this a formatting problem, maybe numbers are seen as text? It is making NOAA style reports
Re: Replace Missing Data Files with Report Files
Posted: Mon 27 Jun 2016 3:03 pm
by steve
I suspect that '' means an empty field where a number is expected.
Re: Replace Missing Data Files with Report Files
Posted: Tue 28 Jun 2016 1:18 am
by apple8
steve wrote:I suspect that '' means an empty field where a number is expected.
Yes, that was the problem, it needed data in mim/max pressure and max rainfall rate fields in addition to what I had. Might have use some dummy average data to remove errors.