Page 1 of 1
Data spike (humidity)
Posted: Mon 16 May 2022 6:10 am
by Benji60
Hello,
First real big storm for me since I got my station and Cumulus detected a humidity spike which means that since yesterday evening when the storm arrived, the humidity has been stuck at 64% instead of rising to 90% in less than 10 minutes. Except that the software remained on 64% until I restarted it this morning.
As I have set the data catching up with Ecowitt, is there a way to catch up the 10 hours of humidity?
I have a huge doubt, I can't find the place where you can remove the spikes suppression?
Translated with
www.DeepL.com/Translator (free version)
Thanks
Translated with
www.DeepL.com/Translator (free version)
Re: Data spike (humidity)
Posted: Mon 16 May 2022 8:21 am
by Gyvate
Assuming your console has posted the proper humidity readings to the Ecowitt cloud.
If your CMX is configured for the Ecowitt cloud backfill (API key, App key, MAC address of the posting console), you can go back to the daily backup of either last midnight or day before last midnight. The files you will find in ..\CumulusMX\backups\daily
First save the files in the ..\CumulusMX\data directory which have the same name as those in the backups directory to some other place (or rename them).
Shut down CMX.
Copy the files from the .\backup directory into the .\data directory overwriting your before saved files.
Restart CMX. It should now download all the data since midnight of the day you chose the backup from.
If you have a one minute logging interval, you can fill the gaps from your saved files (maybe using an average humidity value between the 5 minute readings from the cloud) by copying the respective lines into the log file. (your extra sensor logfile data - provided you have any - you can take 1:1 from the saved files as no humidity reading should be there).
Work on a copy of May22log.txt to complete the work. Then shut down CMX again on the minute (2 seconds later). Copy your updated data into the actual May22log.txt file before the time CMX continued logging while you were working on the copy. Restart CMX as soon as possible, best still within the 30 seconds bfore the next full minute not to lose a record.
If you are anyway using a 5 minute interval, you are already set after CMX completed the backfill.
Re: Data spike (humidity)
Posted: Mon 16 May 2022 9:16 am
by mcrossley
You will find your spike removal settings under "Calibration settings" - they default to 999 - i.e. "off".
Re: Data spike (humidity)
Posted: Mon 16 May 2022 9:40 am
by Gyvate
as far as I read the OP's writing, his issue was mainly that the "spike", a real reading of 90% humidity, wasn't recorded by CMX but somehow got stuck at 64%.
So the opposite of spike removal - rather spike allowance within the set limits.
The spike "removal" won't help here. But still good to know for him where this option is located.
But I don't think that this option has to do with the CMX behaviour in that case.
Re: Data spike (humidity)
Posted: Mon 16 May 2022 10:46 am
by freddie
I read it as the spike detection/removal at work.
Cumulus detected a humidity spike which means that since yesterday evening when the storm arrived, the humidity has been stuck at 64% instead of rising to 90% in less than 10 minutes
So Cumulus detected the spike in humidity value and disallowed it as there was a spike setting in place. If the humidity remained at a high value then spike detection would have continued to be triggered, with Cumulus discarding the readings. This would result in the humidity being recorded at the "stuck" lower value until a restart was performed.
IMHO, of course

Re: Data spike (humidity)
Posted: Mon 16 May 2022 11:37 am
by Gyvate
let's see what the OP reports. By the question it seems he didn't know where this is done. Then it should still be the the default = off - and then no suppression would have taken place and especially not over a long period of time (10 hours) ...
Re: Data spike (humidity)
Posted: Mon 16 May 2022 11:55 am
by Benji60
Hello,
Thank you for the answers.
Yes indeed since the storm arrived the humidity has hardly gone below 85% and cumulus has sent me an email saying that a spike has been removed.
So I'll try the procedure to put back the right data and switch to off.
I'm going to have to manually modify my SQL database (for my charts) which cumulus also completes because of this
https://raspigournayaronde.sytes.net/Gr ... phique.php
Re: Data spike (humidity)
Posted: Mon 16 May 2022 1:18 pm
by Gyvate
if you know SQL, you can also do this faster

, but as it's 600 records only (10 hours x 60 records/hour), it's not too much work doing it manually
