Welcome to the Cumulus Support forum.

Latest Cumulus MX V4 release 4.4.2 (build 4085) - 12 March 2025

Latest Cumulus MX V3 release 3.28.6 (build 3283) - 21 March 2024

Legacy Cumulus 1 release 1.9.4 (build 1099) - 28 November 2014
(a patch is available for 1.9.4 build 1099 that extends the date range of drop-down menus to 2030)

Download the Software (Cumulus MX / Cumulus 1 and other related items) from the Wiki

If you are posting a new Topic about an error or if you need help PLEASE read this first viewtopic.php?p=164080#p164080

missing data ?!

Discussion of the Cumulusutils tool and website generator.

Moderator: HansR

Post Reply
GaxUser
Posts: 29
Joined: Thu 19 May 2022 9:26 pm
Weather Station: davis vp2
Operating System: windows
Contact:

missing data ?!

Post by GaxUser »

I'm not sure how to interpret what I'm seeing. Any advise would be appreciated.

the last entry in dayfile.txt is 07/08/23
Aug23log.txt has data from 01/08/23,00:00 to 08/08/23,20:07
The temperature historic chart
temperature.png
What can I do to correct this?
You do not have the required permissions to view the files attached to this post.
User avatar
PaulMy
Posts: 4355
Joined: Sun 28 Sep 2008 11:54 pm
Weather Station: Davis VP2 Plus 24-Hour FARS
Operating System: Windows8 and Windows10
Location: Komoka, ON Canada
Contact:

Re: missing data ?!

Post by PaulMy »

Hi,
If your data logger has the missing data then you may be able to get that data in CumulusMX by backdating. What station and datalogger? Do you have the CumulusMX automatic \backup\daily from August 7

Enjoy,
Paul
VP2+
C1 www.komokaweather.com/komokaweather-ca
MX https://komokaweather.com/cumulusmx/index.htm /index.html /index.php
MX https://komokaweather.com/cumulusmxwll/index.htm /index.html /index.php
MX https:// komokaweather.com/cumulusmx4/index.htm
Image
GaxUser
Posts: 29
Joined: Thu 19 May 2022 9:26 pm
Weather Station: davis vp2
Operating System: windows
Contact:

Re: missing data ?!

Post by GaxUser »

Hi thanks.
I do have the backup/daily files up to August 8. Its a Davis 2. I'm curious though, where does the charts get the its data? Why is it missing data when the data exist in the dayfile and showing data when there is no data? Alos the station and Cumulus have been running where is the data going?
User avatar
PaulMy
Posts: 4355
Joined: Sun 28 Sep 2008 11:54 pm
Weather Station: Davis VP2 Plus 24-Hour FARS
Operating System: Windows8 and Windows10
Location: Komoka, ON Canada
Contact:

Re: missing data ?!

Post by PaulMy »

Hi,
the last entry in dayfile.txt is 07/08/23
Aug23log.txt has data from 01/08/23,00:00 to 08/08/23,20:07
I do have the backup/daily files up to August 8. Its a Davis 2.
That would indicate it stopped during 08/08 so the last good backup would be end of day 07/08.
Depending on your data logger interval, after stopping CMX and copying-in all the backup files to your CumulusMX\data, a CMX restart would get the historical data to catch up from 07/08 to current.
I'm curious though, where does the charts get the its data?
I am not sure but presume from the monthly log files. If there is no logged data, then can't display charts...
Why is it missing data when the data exist in the dayfile and showing data when there is no data?
The dayfile.txt contains the various data for the whole day when it is processed at the end of day. If you have some days missing in dayfile.txt but you do have the data logged in the monthly log files then the CreateMissing utility can populate dayfile.txt for the missing days. If there is no data for a day in the monthly log files then CMX cannot add that day to dayfile.txt. If there is data for a day in dayfile.txt but no data for that day in the monthly log file then I presume it has been removed in error.
Alos the station and Cumulus have been running where is the data going?
If your station console is receiving live data from the ISS, and you have a data logger, the ongoing data is saved at the logger's interval settings, and if CumulusMX is also running at the same time then CMX also receives that live data and logs that in its monthly log files, as well as in the various today, yesterday, monthly .ini files. If CMX is stopped for a while, a CMX restart will get that data logger's historical data and add that to the monthly log and .ini files, and to dayfile at the end of any day while CMX was stopped.

Enjoy,
Paul
VP2+
C1 www.komokaweather.com/komokaweather-ca
MX https://komokaweather.com/cumulusmx/index.htm /index.html /index.php
MX https://komokaweather.com/cumulusmxwll/index.htm /index.html /index.php
MX https:// komokaweather.com/cumulusmx4/index.htm
Image
GaxUser
Posts: 29
Joined: Thu 19 May 2022 9:26 pm
Weather Station: davis vp2
Operating System: windows
Contact:

Re: missing data ?!

Post by GaxUser »

I'm afraid I wasn't clear. If you look at my first post I point out that the data seemed to stop being logged on the 8th. However, if you look at the graph there are many days going back though June where the graph flat lines (With the exception of two days in July) and then starts recording on the 8th. The dayfiles and monthly logs HAVE data up to the 8th. Through out this whole period the weather station was working properly (I check the web page daily).

My questions would be
1) how come the charts don't show data when I have data (e.g most of July)
2) how come the charts show data when I don't have data (e.g. after the 8th)
3) how come data is no longer getting logged but cumulus recieves the data from the station (e.g no data in the dayfile and monthly log file)
4) how can I fix it
User avatar
PaulMy
Posts: 4355
Joined: Sun 28 Sep 2008 11:54 pm
Weather Station: Davis VP2 Plus 24-Hour FARS
Operating System: Windows8 and Windows10
Location: Komoka, ON Canada
Contact:

Re: missing data ?!

Post by PaulMy »

Your CUtils Yadr also is missing Aug 8 to 16th and the same for NOAA.
Your CMX template website Reports August is missing Aug 1 - 6, ok for 7 - 13, and then missing to date. What is in your MXdiags file around end-of-day for NOA A reports processing? Also what is being logged in your MXdiags files for the days the data is missing, as well as in utils\utilslog after its daily run?
Could be errors in your dayfile.txt and/or log files, have you checked that thoroughly? You could zip and attach to your dayfile.txt and Aug23log.txt so others could have a look.

Enjoy,
Paul
VP2+
C1 www.komokaweather.com/komokaweather-ca
MX https://komokaweather.com/cumulusmx/index.htm /index.html /index.php
MX https://komokaweather.com/cumulusmxwll/index.htm /index.html /index.php
MX https:// komokaweather.com/cumulusmx4/index.htm
Image
GaxUser
Posts: 29
Joined: Thu 19 May 2022 9:26 pm
Weather Station: davis vp2
Operating System: windows
Contact:

Re: missing data ?!

Post by GaxUser »

I'm more confused then ever. I shut everything down and restarted and ran all of the CMX modules I usually run. Now everything looks "better" but I'm still missing data for the period of the 8th to the 17th. But at least everything is consistent (e.g. the charts, NOAA, etc. show data for the up to the 8th and then pick up again on the 17th).
AndyKF650
Posts: 818
Joined: Thu 20 Aug 2020 8:35 am
Weather Station: Davis VP2 Plus
Operating System: RPiv5B 64bit Linux 12 Bookworm
Location: Jersey Channel Islands
Contact:

Re: missing data ?!

Post by AndyKF650 »

Hi there

I just looked at your CUtils site and in particular the YADR data and your data set looks good, so you have the data for the "missing" period.

My suggestion would be to recreate the NOAA report for August in the CMX admin site and that should sort you out.
User avatar
HansR
Posts: 6926
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: GW1100 (WS80/WH40)
Operating System: Raspberry OS/Bookworm
Location: Wagenborgen (NL)
Contact:

Re: missing data ?!

Post by HansR »

When I look at your site it looks as if all issues have been solved? Am I correct?
In general this was a CMX issue so I would have moved it to the CMX thread had I been around, leave it as is now ;)
Hans

https://meteo-wagenborgen.nl
CMX build 4070+ ● RPi 4B ● Linux 6.6.62+rpt-rpi-v8 aarch64 (bookworm) ● dotnet 8.0.1
BlueSky: https://bsky.app/profile/wagenborgenwx.bsky.social
GaxUser
Posts: 29
Joined: Thu 19 May 2022 9:26 pm
Weather Station: davis vp2
Operating System: windows
Contact:

Re: missing data ?!

Post by GaxUser »

Thanks, I was able to recover the lost data from backups. All is good now
Post Reply