Welcome to the Cumulus Support forum.

Latest Cumulus MX V4 release 4.4.2 (build 4085) - 12 March 2025

Latest Cumulus MX V3 release 3.28.6 (build 3283) - 21 March 2024

Legacy Cumulus 1 release 1.9.4 (build 1099) - 28 November 2014
(a patch is available for 1.9.4 build 1099 that extends the date range of drop-down menus to 2030)

Download the Software (Cumulus MX / Cumulus 1 and other related items) from the Wiki

If you are posting a new Topic about an error or if you need help PLEASE read this first viewtopic.php?p=164080#p164080

Help Exporting All Weather Station Data into a Single File (macOS Sonoma)

From Cumulus MX version 3 build 3044 the development baton passed to Mark Crossley. Mark has been responsible for all the Builds since, and has recently released Cumulus MX version 4. He has made the code available on GitHub. It is Mark's hope that others will join in this development, but at the very least he welcomes your ideas for future developments (see Cumulus MX Development suggestions).

Moderator: mcrossley

Post Reply
traveling36
Posts: 3
Joined: Sat 28 Dec 2024 10:34 am
Weather Station: Ecowitt GW2001
Operating System: macOS Sonoma

Help Exporting All Weather Station Data into a Single File (macOS Sonoma)

Post by traveling36 »

Hi everyone,

I’m new to all of this and feeling a little stuck, so I’m hoping someone here can help me out.

I need to export all the data from my weather station into a single file with proper headers, but I’m running into several issues:
• I can see all the data in the Data Log Viewer under monthly logs when I select the timeframe my station has been running. (367 days) However, it only shows 100 entries at a time max, out of the total 76,404, and there’s no option to export the data directly.
• When I open the cumulusmx.db file using DB Browser for SQLite, it only shows some of the recent data, regardless of which table I open.
• The monthly txt files in the data folder do contain the data, but they don’t include headers, which makes them hard to work with.

Most of this data is historic data recently downloaded from the Ecowitt cloud. I’d really like to have all of it consolidated into a single file with proper headers for easier analysis and use. (.csv or similar)

I also realized that since I’m working on macOS Sonoma, I can’t use tools like ExportToMySQL, which I read in the forum here might do the trick. As someone without a technical background, I’d greatly appreciate any straightforward solution or guidance to achieve this!

Thank you in advance for your help!
User avatar
PaulMy
Posts: 4355
Joined: Sun 28 Sep 2008 11:54 pm
Weather Station: Davis VP2 Plus 24-Hour FARS
Operating System: Windows8 and Windows10
Location: Komoka, ON Canada
Contact:

Re: Help Exporting All Weather Station Data into a Single File (macOS Sonoma)

Post by PaulMy »

Hi,
I need to export all the data from my weather station into a single file with proper headers, but I’m running into several issues:
• The monthly txt files in the data folder do contain the data, but they don’t include headers, which makes them hard to work with.
The CumulusMX unzipped includes 2 files that show the monthlyfileheader and dayfileheader descriptions

Code: Select all

Date (dd/mm/yy)	Time	Temperature	Humidity	Dew point	Wind speed	Recent high gust	Average wind bearing	Rainfall rate	Rainfall so far	Sea level pressure	Rainfall counter	Inside temperature	Inside humidity	Current gust	Wind chill	Heat Index	UV Index	Solar Radiation	Evapotranspiration	Annual Evapotranspiration	Apparent temperature	Max Solar radiation	Hours of sunshine	Wind bearing	RG-11 Rain	Rain Since Midnight	Feels Like	Humidex																												

Code: Select all

Date (dd/mm/yy)	High wind gust	Highest gust bearing	High gust time	Min temperature	Min temp time	Max temperature	Max temp time	Min sea level pressure	Min pressure time	Max sea level pressure	Max pressure time	Max rainfall rate	Max rain rate time	Total rainfall today	Avg temperature today	Total wind run	High average wind speed	High avg wind speed time	Low humidity	Low humidity time	High humidity	High humidity time	Total evapotranspiration	Total hours of sunshine	High heat index	High heat index time	High apparent temperature	High app temp time	Low apparent temperature	Low app temp time	High 1h rain	High 1h rain time	Low wind chill	Low wind chill time	High dew point	High dew point time	Low dew point	Low dew point time	Dominant wind bearing	Heating degree days	Cooling degree days	High solar radiation	High solar rad time	High UV-I	High UV-I time	High feels like	High feels like time	Low feels like	Low feels like time	High humidex	High humidex time	Chill hours	High 24h Rain	High 24h Rain time
• I can see all the data in the Data Log Viewer under monthly logs when I select the timeframe my station has been running. (367 days) However, it only shows 100 entries at a time max, out of the total 76,404, and there’s no option to export the data directly.
I don't use Mac and not sure what you are trying to do, but you can open the monthly and dayfile files in Excel and then add the header - i.e.

Code: Select all

Date (dd/mm/yy)	Time	Temperature	Humidity	Dew point	Wind speed	Recent high gust	Average wind bearing	Rainfall rate	Rainfall so far	Sea level pressure	Rainfall counter	Inside temperature	Inside humidity	Current gust	Wind chill	Heat Index	UV Index	Solar Radiation	Evapotranspiration	Annual Evapotranspiration	Apparent temperature	Max Solar radiation	Hours of sunshine	Wind bearing	RG-11 Rain	Rain Since Midnight	Feels Like	Humidex
																												
01/12/24	0:00	-4.7	77	-9.4	5.8	19.3	314	0	0	1014	1028.8	25	32	6.4	-6.6	-4.7	0	0	0	811.23	-8.7	0	0	296	0	0	-7.3	-4.7
01/12/24	0:05	-4.7	77	-9.4	8	21.4	307	0	0	1013.9	1028.8	24.9	32	8.6	-7.1	-4.7	0	0	0	811.23	-9.1	0	0	294	0	0	-8.2	-4.7
01/12/24	0:10	-4.7	77	-9.4	8.7	27.8	299	0	0	1014	1028.8	25	32	8.6	-7.5	-4.7	0	0	0	811.23	-9.3	0	0	297	0	0	-8.5	-4.7
01/12/24	0:15	-4.8	77	-9.4	8.5	21.4	307	0	0	1013.9	1028.8	25.1	32	4.3	-7.7	-4.8	0	0	0	811.23	-9.4	0	0	330	0	0	-8.6	-4.8
01/12/24	0:20	-4.8	77	-9.4	6.9	10.7	322	0	0	1013.9	1028.8	25.1	32	0	-7.4	-4.8	0	0	0	811.23	-9.1	0	0	0	0	0	-8	-4.8

p.s. The selected data does not line up with the header in this reply post, but does in an Excel file.

Enjoy,
Paul
VP2+
C1 www.komokaweather.com/komokaweather-ca
MX https://komokaweather.com/cumulusmx/index.htm /index.html /index.php
MX https://komokaweather.com/cumulusmxwll/index.htm /index.html /index.php
MX https:// komokaweather.com/cumulusmx4/index.htm
Image
Post Reply