Hello, I've looked through the wiki and I saw that it was possible to insert missing data, but I didn't understand the exact procedure in my case.
To make it simple, following a power cut, my Ecowitt GW1000 changed IP address yesterday evening (it won't happen again, I set my box to fix the address).
So there is a lot of data missing. I just thought I could reinsert my missing data thanks to my console which saves the data on a csv file.
In attachment I put my file.
How can I transform this file into data that can be inserted into the Oct21log.txt file?
Thank you.
Translated with www.DeepL.com/Translator (free version)
Welcome to the Cumulus Support forum.
Latest Cumulus MX V4 release 4.4.2 (build 4085) - 12 March 2025
Latest Cumulus MX V3 release 3.28.6 (build 3283) - 21 March 2024
Legacy Cumulus 1 release 1.9.4 (build 1099) - 28 November 2014
(a patch is available for 1.9.4 build 1099 that extends the date range of drop-down menus to 2030)
Download the Software (Cumulus MX / Cumulus 1 and other related items) from the Wiki
If you are posting a new Topic about an error or if you need help PLEASE read this first viewtopic.php?p=164080#p164080
Latest Cumulus MX V4 release 4.4.2 (build 4085) - 12 March 2025
Latest Cumulus MX V3 release 3.28.6 (build 3283) - 21 March 2024
Legacy Cumulus 1 release 1.9.4 (build 1099) - 28 November 2014
(a patch is available for 1.9.4 build 1099 that extends the date range of drop-down menus to 2030)
Download the Software (Cumulus MX / Cumulus 1 and other related items) from the Wiki
If you are posting a new Topic about an error or if you need help PLEASE read this first viewtopic.php?p=164080#p164080
Missing data
Moderator: mcrossley
-
Benji60
- Posts: 67
- Joined: Mon 11 Oct 2021 12:38 pm
- Weather Station: HP1000 Froggit Pro
- Operating System: Windows 10
Missing data
You do not have the required permissions to view the files attached to this post.
-
Benji60
- Posts: 67
- Joined: Mon 11 Oct 2021 12:38 pm
- Weather Station: HP1000 Froggit Pro
- Operating System: Windows 10
Re: Missing data
Hello,
Is this not possible?
I lost again 8 hours of data due to a disconnected cable while I have an sql database (export in csv) where I have all these data.
Is this not possible?
I lost again 8 hours of data due to a disconnected cable while I have an sql database (export in csv) where I have all these data.
-
LindaFNM
- Posts: 168
- Joined: Wed 06 Jan 2021 3:01 pm
- Weather Station: Ecowitt
- Operating System: Raspberry Pi
Re: Missing data
Hi,
You’ll need to convert the October text file to a .csv one, then insert the missing lines of data from your backup. Save this file back to a .txt file and copy back into CumulusMX. You can run the Insert Missing utility to update the day file.
Alternatively, I assume you could convert the whole database data from October to a .txt file and use this to replace your October data.
If you need more detail let me know. Before making adjustments (my CumulusMX is running on a Pi) I take a copy and do all of the manipulation on my PC so I don’t make any mistakes on the live running copy.
You’ll need to convert the October text file to a .csv one, then insert the missing lines of data from your backup. Save this file back to a .txt file and copy back into CumulusMX. You can run the Insert Missing utility to update the day file.
Alternatively, I assume you could convert the whole database data from October to a .txt file and use this to replace your October data.
If you need more detail let me know. Before making adjustments (my CumulusMX is running on a Pi) I take a copy and do all of the manipulation on my PC so I don’t make any mistakes on the live running copy.
-
LindaFNM
- Posts: 168
- Joined: Wed 06 Jan 2021 3:01 pm
- Weather Station: Ecowitt
- Operating System: Raspberry Pi
Re: Missing data
Sorry, I’ve just realised the backup is from an Ecowitt console. This is going to give you some problems as the data doesn’t exist in the correct format. It depends on how ‘fussy’ you want to be. I’ll need to look at my notes etc again, I get confused with this as I’m (stupidly!) trying to consolidate data from WeatherLink, PC weather, Weather Display and CumulusMX!! I’ve had to build a database as much of the data is held in different ways. You’ll have to convert the October .txt to .csv and insert as best as you can the matching data from the Ecowitt file.
-
LindaFNM
- Posts: 168
- Joined: Wed 06 Jan 2021 3:01 pm
- Weather Station: Ecowitt
- Operating System: Raspberry Pi
Re: Missing data
Oh dear, I should have waited till I was properly awake this morning before doing a comprehensive reply!
Another, much simpler option may be available. Are you up loading to Ecowitt.net? If so, you can get the daily max/min figures from there and then amend your day that’s incorrect directly in the CumulusMX dayfile. Unless you had a particularly active period of weather when your data was down this should take care of the things that are important like daily rain, gust temperature etc. In trying to sort out 11 years of mixed mess, I’m learning that some of the data that is provided isn’t necessarily worth the huge amount of effort to recreate it!! Hope you manage to solve the problem.
Another, much simpler option may be available. Are you up loading to Ecowitt.net? If so, you can get the daily max/min figures from there and then amend your day that’s incorrect directly in the CumulusMX dayfile. Unless you had a particularly active period of weather when your data was down this should take care of the things that are important like daily rain, gust temperature etc. In trying to sort out 11 years of mixed mess, I’m learning that some of the data that is provided isn’t necessarily worth the huge amount of effort to recreate it!! Hope you manage to solve the problem.
-
Benji60
- Posts: 67
- Joined: Mon 11 Oct 2021 12:38 pm
- Weather Station: HP1000 Froggit Pro
- Operating System: Windows 10
Re: Missing data
Thank you very much for the answer!
Indeed with the csv file of the console I can try to modify it.
I already modified the daily max/min, you are right!
It's just that it's quite tedious to replace the missing data but it's not serious, even if it makes "holes" in the graphs
Indeed with the csv file of the console I can try to modify it.
I already modified the daily max/min, you are right!
It's just that it's quite tedious to replace the missing data but it's not serious, even if it makes "holes" in the graphs