Welcome to the Cumulus Support forum.

Latest Cumulus MX V4 release 4.4.2 (build 4085) - 12 March 2025

Latest Cumulus MX V3 release 3.28.6 (build 3283) - 21 March 2024

Legacy Cumulus 1 release 1.9.4 (build 1099) - 28 November 2014
(a patch is available for 1.9.4 build 1099 that extends the date range of drop-down menus to 2030)

Download the Software (Cumulus MX / Cumulus 1 and other related items) from the Wiki

If you are posting a new Topic about an error or if you need help PLEASE read this first viewtopic.php?p=164080#p164080

Integrating Wunderground data

From build 3044 the development baton passed to Mark Crossley. Mark has been responsible for all the Builds since. He has made the code available on GitHub. It is Mark's hope that others will join in this development, but at the very least he welcomes your ideas for future developments (see Cumulus MX Development suggestions).

Moderator: mcrossley

Post Reply
petercoxphoto12
Posts: 9
Joined: Fri 08 May 2020 4:41 pm
Weather Station: Davis Vantage Pro2
Operating System: Linux

Integrating Wunderground data

Post by petercoxphoto12 »

Hi guys -
I've moved to Cumulus MX from WeeWx and have several years Wunderground data to integrate. I set up and installed the software on a Raspberry Pi and have downloaded the Wunderground data via their API. I've parsed it into Cumulus monthy file format and put it in the data directory for MX.

What next? How can I get graphs based on it, NOAA reports, etc? If I try to generate NOAA reports for months that exist in this data, I get an empty report back.

Also, the all time records seem to be difficult to update. In Cumulus 1 editor you could click on the log data and automatically populate it in the relevant field. This doesn't seem to be the case with MX?

Thanks for your help.

Cheers,
Peter
petercoxphoto12
Posts: 9
Joined: Fri 08 May 2020 4:41 pm
Weather Station: Davis Vantage Pro2
Operating System: Linux

Re: Integrating Wunderground data

Post by petercoxphoto12 »

I've also noticed something odd - I tried populating the all time highs and lows using the built-in editor. The record high temperature it has chosen from the log files (after I asked it to scan them) is lower than the actual high present in those files. It picked a record from the month file that contains the actual high, but not the highest value there.

Could use some help with this!

Cheers,
Peter
richard_newberry
Posts: 500
Joined: Tue 12 Apr 2011 10:23 pm
Weather Station: Watson W-8186
Operating System: Raspbian Bookworm & Debian 12
Location: Leicester
Contact:

Re: Integrating Wunderground data

Post by richard_newberry »

Mines working put the key from weather underground into password box

https://www.wunderground.com/dashboard/pws/ILEICE32
Desford Weather (at parents)
https://desford-weather.co.uk

Countesthorpe Weather (at mine)
https://countesthorpe-weather.co.uk
petercoxphoto12
Posts: 9
Joined: Fri 08 May 2020 4:41 pm
Weather Station: Davis Vantage Pro2
Operating System: Linux

Re: Integrating Wunderground data

Post by petercoxphoto12 »

Richard, you misunderstand. I'm not trying to populate weather underground. I'm trying to import historical data from the weather underground. I have it already in the cumulus monthly log format but it's not being utilized.

Peter
User avatar
mcrossley
Posts: 14388
Joined: Thu 07 Jan 2010 9:44 pm
Weather Station: Davis VP2/WLL
Operating System: Bullseye Lite rPi
Location: Wilmslow, Cheshire, UK
Contact:

Re: Integrating Wunderground data

Post by mcrossley »

Currently for MX you will also need to generate the dayfile.txt file. MX does not have the ability to regenerate the dayfile.
petercoxphoto12
Posts: 9
Joined: Fri 08 May 2020 4:41 pm
Weather Station: Davis Vantage Pro2
Operating System: Linux

Re: Integrating Wunderground data

Post by petercoxphoto12 »

Thanks Mark, I'll look at that. What about the record issue where it wasn't picking the extreme from the monthly logs?

Cheers,
Peter
User avatar
mcrossley
Posts: 14388
Joined: Thu 07 Jan 2010 9:44 pm
Weather Station: Davis VP2/WLL
Operating System: Bullseye Lite rPi
Location: Wilmslow, Cheshire, UK
Contact:

Re: Integrating Wunderground data

Post by mcrossley »

Did you set the date records began field in Cumulus.ini to the start of your monthly files?
petercoxphoto12
Posts: 9
Joined: Fri 08 May 2020 4:41 pm
Weather Station: Davis Vantage Pro2
Operating System: Linux

Re: Integrating Wunderground data

Post by petercoxphoto12 »

I did. Interestingly the date the actual high temperature occurred was a couple of weeks after the date it picked in the edit records tool, from the same monthly log.

The start date set for Cumulus is also well before the dates in question.
User avatar
mcrossley
Posts: 14388
Joined: Thu 07 Jan 2010 9:44 pm
Weather Station: Davis VP2/WLL
Operating System: Bullseye Lite rPi
Location: Wilmslow, Cheshire, UK
Contact:

Re: Integrating Wunderground data

Post by mcrossley »

I think you'll have to zip up your files so I can try them out.
petercoxphoto12
Posts: 9
Joined: Fri 08 May 2020 4:41 pm
Weather Station: Davis Vantage Pro2
Operating System: Linux

Re: Integrating Wunderground data

Post by petercoxphoto12 »

Thanks Mark. File was too big to attach here, so here's a Dropbox link: https://www.dropbox.com/s/d97gd803natti ... a.zip?dl=0

Appreciate your help!

Cheers,
Peter
User avatar
mcrossley
Posts: 14388
Joined: Thu 07 Jan 2010 9:44 pm
Weather Station: Davis VP2/WLL
Operating System: Bullseye Lite rPi
Location: Wilmslow, Cheshire, UK
Contact:

Re: Integrating Wunderground data

Post by mcrossley »

OK, so I just tried "This year" to cut down the processing...

First error I have hit is that field #3, humidity, you have formatted as a decimal, MX requires an integer. It looks like if you fix that you may be OK.
petercoxphoto12
Posts: 9
Joined: Fri 08 May 2020 4:41 pm
Weather Station: Davis Vantage Pro2
Operating System: Linux

Re: Integrating Wunderground data

Post by petercoxphoto12 »

Thanks Mark. I've corrected that and now the values imported into the editor seem better.

Is there a way to get the charts feature to use the archival data though?

Cheers,
Peter
petercoxphoto12
Posts: 9
Joined: Fri 08 May 2020 4:41 pm
Weather Station: Davis Vantage Pro2
Operating System: Linux

Re: Integrating Wunderground data

Post by petercoxphoto12 »

Also, is there a way to have the logged data automatically populate into the all time and monthly records? Having to manually copy/paste the records line by line for each month is going to be tedious.

Thanks,
Peter
petercoxphoto12
Posts: 9
Joined: Fri 08 May 2020 4:41 pm
Weather Station: Davis Vantage Pro2
Operating System: Linux

Re: Integrating Wunderground data

Post by petercoxphoto12 »

Sorry, missed your post about the dayfile.txt. I'll work on that. Thanks for your help!

Cheers,
Peter
Post Reply