Page 1 of 1

Help Exporting All Weather Station Data into a Single File (macOS Sonoma)

Posted: Sun 29 Dec 2024 9:25 pm
by traveling36
Hi everyone,

I’m new to all of this and feeling a little stuck, so I’m hoping someone here can help me out.

I need to export all the data from my weather station into a single file with proper headers, but I’m running into several issues:
• I can see all the data in the Data Log Viewer under monthly logs when I select the timeframe my station has been running. (367 days) However, it only shows 100 entries at a time max, out of the total 76,404, and there’s no option to export the data directly.
• When I open the cumulusmx.db file using DB Browser for SQLite, it only shows some of the recent data, regardless of which table I open.
• The monthly txt files in the data folder do contain the data, but they don’t include headers, which makes them hard to work with.

Most of this data is historic data recently downloaded from the Ecowitt cloud. I’d really like to have all of it consolidated into a single file with proper headers for easier analysis and use. (.csv or similar)

I also realized that since I’m working on macOS Sonoma, I can’t use tools like ExportToMySQL, which I read in the forum here might do the trick. As someone without a technical background, I’d greatly appreciate any straightforward solution or guidance to achieve this!

Thank you in advance for your help!

Re: Help Exporting All Weather Station Data into a Single File (macOS Sonoma)

Posted: Sun 29 Dec 2024 10:25 pm
by PaulMy
Hi,
I need to export all the data from my weather station into a single file with proper headers, but I’m running into several issues:
• The monthly txt files in the data folder do contain the data, but they don’t include headers, which makes them hard to work with.
The CumulusMX unzipped includes 2 files that show the monthlyfileheader and dayfileheader descriptions

Code: Select all

Date (dd/mm/yy)	Time	Temperature	Humidity	Dew point	Wind speed	Recent high gust	Average wind bearing	Rainfall rate	Rainfall so far	Sea level pressure	Rainfall counter	Inside temperature	Inside humidity	Current gust	Wind chill	Heat Index	UV Index	Solar Radiation	Evapotranspiration	Annual Evapotranspiration	Apparent temperature	Max Solar radiation	Hours of sunshine	Wind bearing	RG-11 Rain	Rain Since Midnight	Feels Like	Humidex																												

Code: Select all

Date (dd/mm/yy)	High wind gust	Highest gust bearing	High gust time	Min temperature	Min temp time	Max temperature	Max temp time	Min sea level pressure	Min pressure time	Max sea level pressure	Max pressure time	Max rainfall rate	Max rain rate time	Total rainfall today	Avg temperature today	Total wind run	High average wind speed	High avg wind speed time	Low humidity	Low humidity time	High humidity	High humidity time	Total evapotranspiration	Total hours of sunshine	High heat index	High heat index time	High apparent temperature	High app temp time	Low apparent temperature	Low app temp time	High 1h rain	High 1h rain time	Low wind chill	Low wind chill time	High dew point	High dew point time	Low dew point	Low dew point time	Dominant wind bearing	Heating degree days	Cooling degree days	High solar radiation	High solar rad time	High UV-I	High UV-I time	High feels like	High feels like time	Low feels like	Low feels like time	High humidex	High humidex time	Chill hours	High 24h Rain	High 24h Rain time
• I can see all the data in the Data Log Viewer under monthly logs when I select the timeframe my station has been running. (367 days) However, it only shows 100 entries at a time max, out of the total 76,404, and there’s no option to export the data directly.
I don't use Mac and not sure what you are trying to do, but you can open the monthly and dayfile files in Excel and then add the header - i.e.

Code: Select all

Date (dd/mm/yy)	Time	Temperature	Humidity	Dew point	Wind speed	Recent high gust	Average wind bearing	Rainfall rate	Rainfall so far	Sea level pressure	Rainfall counter	Inside temperature	Inside humidity	Current gust	Wind chill	Heat Index	UV Index	Solar Radiation	Evapotranspiration	Annual Evapotranspiration	Apparent temperature	Max Solar radiation	Hours of sunshine	Wind bearing	RG-11 Rain	Rain Since Midnight	Feels Like	Humidex
																												
01/12/24	0:00	-4.7	77	-9.4	5.8	19.3	314	0	0	1014	1028.8	25	32	6.4	-6.6	-4.7	0	0	0	811.23	-8.7	0	0	296	0	0	-7.3	-4.7
01/12/24	0:05	-4.7	77	-9.4	8	21.4	307	0	0	1013.9	1028.8	24.9	32	8.6	-7.1	-4.7	0	0	0	811.23	-9.1	0	0	294	0	0	-8.2	-4.7
01/12/24	0:10	-4.7	77	-9.4	8.7	27.8	299	0	0	1014	1028.8	25	32	8.6	-7.5	-4.7	0	0	0	811.23	-9.3	0	0	297	0	0	-8.5	-4.7
01/12/24	0:15	-4.8	77	-9.4	8.5	21.4	307	0	0	1013.9	1028.8	25.1	32	4.3	-7.7	-4.8	0	0	0	811.23	-9.4	0	0	330	0	0	-8.6	-4.8
01/12/24	0:20	-4.8	77	-9.4	6.9	10.7	322	0	0	1013.9	1028.8	25.1	32	0	-7.4	-4.8	0	0	0	811.23	-9.1	0	0	0	0	0	-8	-4.8

p.s. The selected data does not line up with the header in this reply post, but does in an Excel file.

Enjoy,
Paul