Page 1 of 1

Integrating Wunderground data

Posted: Fri 08 May 2020 4:48 pm
by petercoxphoto12
Hi guys -
I've moved to Cumulus MX from WeeWx and have several years Wunderground data to integrate. I set up and installed the software on a Raspberry Pi and have downloaded the Wunderground data via their API. I've parsed it into Cumulus monthy file format and put it in the data directory for MX.

What next? How can I get graphs based on it, NOAA reports, etc? If I try to generate NOAA reports for months that exist in this data, I get an empty report back.

Also, the all time records seem to be difficult to update. In Cumulus 1 editor you could click on the log data and automatically populate it in the relevant field. This doesn't seem to be the case with MX?

Thanks for your help.

Cheers,
Peter

Re: Integrating Wunderground data

Posted: Sat 09 May 2020 8:06 pm
by petercoxphoto12
I've also noticed something odd - I tried populating the all time highs and lows using the built-in editor. The record high temperature it has chosen from the log files (after I asked it to scan them) is lower than the actual high present in those files. It picked a record from the month file that contains the actual high, but not the highest value there.

Could use some help with this!

Cheers,
Peter

Re: Integrating Wunderground data

Posted: Sat 09 May 2020 9:45 pm
by richard_newberry
Mines working put the key from weather underground into password box

https://www.wunderground.com/dashboard/pws/ILEICE32

Re: Integrating Wunderground data

Posted: Sat 09 May 2020 11:38 pm
by petercoxphoto12
Richard, you misunderstand. I'm not trying to populate weather underground. I'm trying to import historical data from the weather underground. I have it already in the cumulus monthly log format but it's not being utilized.

Peter

Re: Integrating Wunderground data

Posted: Mon 11 May 2020 9:16 am
by mcrossley
Currently for MX you will also need to generate the dayfile.txt file. MX does not have the ability to regenerate the dayfile.

Re: Integrating Wunderground data

Posted: Mon 11 May 2020 12:48 pm
by petercoxphoto12
Thanks Mark, I'll look at that. What about the record issue where it wasn't picking the extreme from the monthly logs?

Cheers,
Peter

Re: Integrating Wunderground data

Posted: Mon 11 May 2020 12:52 pm
by mcrossley
Did you set the date records began field in Cumulus.ini to the start of your monthly files?

Re: Integrating Wunderground data

Posted: Mon 11 May 2020 8:16 pm
by petercoxphoto12
I did. Interestingly the date the actual high temperature occurred was a couple of weeks after the date it picked in the edit records tool, from the same monthly log.

The start date set for Cumulus is also well before the dates in question.

Re: Integrating Wunderground data

Posted: Tue 12 May 2020 3:43 pm
by mcrossley
I think you'll have to zip up your files so I can try them out.

Re: Integrating Wunderground data

Posted: Tue 12 May 2020 11:50 pm
by petercoxphoto12
Thanks Mark. File was too big to attach here, so here's a Dropbox link: https://www.dropbox.com/s/d97gd803natti ... a.zip?dl=0

Appreciate your help!

Cheers,
Peter

Re: Integrating Wunderground data

Posted: Wed 13 May 2020 1:20 pm
by mcrossley
OK, so I just tried "This year" to cut down the processing...

First error I have hit is that field #3, humidity, you have formatted as a decimal, MX requires an integer. It looks like if you fix that you may be OK.

Re: Integrating Wunderground data

Posted: Wed 13 May 2020 4:58 pm
by petercoxphoto12
Thanks Mark. I've corrected that and now the values imported into the editor seem better.

Is there a way to get the charts feature to use the archival data though?

Cheers,
Peter

Re: Integrating Wunderground data

Posted: Wed 13 May 2020 4:59 pm
by petercoxphoto12
Also, is there a way to have the logged data automatically populate into the all time and monthly records? Having to manually copy/paste the records line by line for each month is going to be tedious.

Thanks,
Peter

Re: Integrating Wunderground data

Posted: Wed 13 May 2020 8:16 pm
by petercoxphoto12
Sorry, missed your post about the dayfile.txt. I'll work on that. Thanks for your help!

Cheers,
Peter