Some time ago due to a PC malfunction I lost a lot of data. I now have a gap of over a year in the Data files. I do have however all the monthly NOAA Report files for the missing months.
Does anyone know of a process that I could convert data in the NOAA Report files to Data files or if it is even possible.
Welcome to the Cumulus Support forum.
Latest Cumulus MX V4 release 4.4.2 (build 4085) - 12 March 2025
Latest Cumulus MX V3 release 3.28.6 (build 3283) - 21 March 2024
Legacy Cumulus 1 release 1.9.4 (build 1099) - 28 November 2014
(a patch is available for 1.9.4 build 1099 that extends the date range of drop-down menus to 2030)
Download the Software (Cumulus MX / Cumulus 1 and other related items) from the Wiki
If you are posting a new Topic about an error or if you need help PLEASE read this first viewtopic.php?p=164080#p164080
Latest Cumulus MX V4 release 4.4.2 (build 4085) - 12 March 2025
Latest Cumulus MX V3 release 3.28.6 (build 3283) - 21 March 2024
Legacy Cumulus 1 release 1.9.4 (build 1099) - 28 November 2014
(a patch is available for 1.9.4 build 1099 that extends the date range of drop-down menus to 2030)
Download the Software (Cumulus MX / Cumulus 1 and other related items) from the Wiki
If you are posting a new Topic about an error or if you need help PLEASE read this first viewtopic.php?p=164080#p164080
Replace Missing Data Files with Report Files
- steve
- Cumulus Author
- Posts: 26672
- Joined: Mon 02 Jun 2008 6:49 pm
- Weather Station: None
- Operating System: None
- Location: Vienne, France
- Contact:
Re: Replace Missing Data Files with Report Files
There isn't the correct type of data in the NOOA reports for recreating the minute-by-minute data for the monthly logs, they are summaries. There is sufficient information to create only a subset of the daily summaries in dayfile.txt.
Steve
-
apple8
- Posts: 141
- Joined: Sun 21 Aug 2011 2:26 am
- Weather Station: Davis Vantage Vue
- Operating System: Windows 10
- Location: Sydney. Australia
- Contact:
Re: Replace Missing Data Files with Report Files
I see what your saying and have come to that conclusion too overnight.steve wrote:There is sufficient information to create only a subset of the daily summaries in dayfile.txt.
Just trying to work out how to do that, one is manually entering each cell through dayfile.txt editor, a big job with 10 entries for each day. What I have tried is import into excel the NOAA data as a csv, re-sort columns under the dayfileheaders, save as a csv, open as a text file and then select and paste into the dayfile. Sound a bit complex but I think that might be the way to go.
Thoughts on this approach?
- steve
- Cumulus Author
- Posts: 26672
- Joined: Mon 02 Jun 2008 6:49 pm
- Weather Station: None
- Operating System: None
- Location: Vienne, France
- Contact:
Re: Replace Missing Data Files with Report Files
Yes, I don't think you'll do any better than that, without writing a program or script to fully automate the process.
Steve
-
apple8
- Posts: 141
- Joined: Sun 21 Aug 2011 2:26 am
- Weather Station: Davis Vantage Vue
- Operating System: Windows 10
- Location: Sydney. Australia
- Contact:
Re: Replace Missing Data Files with Report Files
Mostly going well, it has been a bit tricky and I am working through it.
I am getting errors when I do a this month and year search and get: Error at line xxx of dayfile.txt: " is not a valid floating point value.
I can't see any " in the lines so is this a formatting problem, maybe numbers are seen as text? It is making NOAA style reports
I am getting errors when I do a this month and year search and get: Error at line xxx of dayfile.txt: " is not a valid floating point value.
I can't see any " in the lines so is this a formatting problem, maybe numbers are seen as text? It is making NOAA style reports
- steve
- Cumulus Author
- Posts: 26672
- Joined: Mon 02 Jun 2008 6:49 pm
- Weather Station: None
- Operating System: None
- Location: Vienne, France
- Contact:
Re: Replace Missing Data Files with Report Files
I suspect that '' means an empty field where a number is expected.
Steve
-
apple8
- Posts: 141
- Joined: Sun 21 Aug 2011 2:26 am
- Weather Station: Davis Vantage Vue
- Operating System: Windows 10
- Location: Sydney. Australia
- Contact:
Re: Replace Missing Data Files with Report Files
Yes, that was the problem, it needed data in mim/max pressure and max rainfall rate fields in addition to what I had. Might have use some dummy average data to remove errors.steve wrote:I suspect that '' means an empty field where a number is expected.