Welcome to the Cumulus Support forum.

Latest Cumulus MX V4 release 4.4.2 (build 4085) - 12 March 2025

Latest Cumulus MX V3 release 3.28.6 (build 3283) - 21 March 2024

Legacy Cumulus 1 release 1.9.4 (build 1099) - 28 November 2014
(a patch is available for 1.9.4 build 1099 that extends the date range of drop-down menus to 2030)

Download the Software (Cumulus MX / Cumulus 1 and other related items) from the Wiki

If you are posting a new Topic about an error or if you need help PLEASE read this first viewtopic.php?p=164080#p164080

website not fully updating - not new update related

Discussion of the Cumulusutils tool and website generator.

Moderator: HansR

Post Reply
Nossie
Posts: 424
Joined: Tue 16 Aug 2022 8:01 pm
Weather Station: Ecowitt 2551
Operating System: Raspberry Pi5 Debian Bookworm
Location: Stewarton, East Ayrshire UK
Contact:

website not fully updating - not new update related

Post by Nossie »

So again this is not related to the new update - appears this happened on the 16/07

Only seems to half update, the graphs etc do not.. attached utils log
You do not have the required permissions to view the files attached to this post.
Ian.

http://www.StewartonWeather.com
Containerised Cumulus[MX] 4.2.1 (build: 4040) ● CumulusUtils Version 7.1.1● Ecowitt 2551/WH65/T&HP/WH57/WH45/3x WH51 ● Pi 5 8GB ● Debian Bookworm ● Ubuntu Server Host
User avatar
HansR
Posts: 6926
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: GW1100 (WS80/WH40)
Operating System: Raspberry OS/Bookworm
Location: Wagenborgen (NL)
Contact:

Re: website not fully updating - not new update related

Post by HansR »

Ian,

What I can see is:
  1. that apparently the realtime files have a date of 21/07/23 10:18:53 so apparently they are no longer updated by CMX
  2. the UserAskedData does not complete because the extrasensorsdata.json does not exist because there appears to be an issue with ExtraLog202307.txt which seems to be empty
  3. For the same reason as above the CO2 sensor is ignored because it cannot find any data.
I don't know why but there seems to be a data issue suddenly both for CMX (no realtime files are being sent) and for CUtils.
Start with:
  1. remove any copy_* file from the data directory
  2. check your ExtraLog202307.txt file. That should not be empty!
Then we'll see where we stand.

The CUtils update seems to have been completed correctly
Hans

https://meteo-wagenborgen.nl
CMX build 4070+ ● RPi 4B ● Linux 6.6.62+rpt-rpi-v8 aarch64 (bookworm) ● dotnet 8.0.1
BlueSky: https://bsky.app/profile/wagenborgenwx.bsky.social
Nossie
Posts: 424
Joined: Tue 16 Aug 2022 8:01 pm
Weather Station: Ecowitt 2551
Operating System: Raspberry Pi5 Debian Bookworm
Location: Stewarton, East Ayrshire UK
Contact:

Re: website not fully updating - not new update related

Post by Nossie »

that apparently the realtime files have a date of 21/07/23 10:18:53 so apparently they are no longer updated by CMX
That's the last time I ran the update manually
the UserAskedData does not complete because the extrasensorsdata.json does not exist because there appears to be an issue with ExtraLog202307.txt which seems to be empty
ExtraLog202307.txt is 7,277kb and full of digits

no copy files found
Ian.

http://www.StewartonWeather.com
Containerised Cumulus[MX] 4.2.1 (build: 4040) ● CumulusUtils Version 7.1.1● Ecowitt 2551/WH65/T&HP/WH57/WH45/3x WH51 ● Pi 5 8GB ● Debian Bookworm ● Ubuntu Server Host
User avatar
HansR
Posts: 6926
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: GW1100 (WS80/WH40)
Operating System: Raspberry OS/Bookworm
Location: Wagenborgen (NL)
Contact:

Re: website not fully updating - not new update related

Post by HansR »

Nossie wrote: Sat 22 Jul 2023 6:21 pm That's the last time I ran the update manually
Update of what?

Could you post the MXdiags logfile (if it rolled over to a new one please include the one covering 21 july).
Hans

https://meteo-wagenborgen.nl
CMX build 4070+ ● RPi 4B ● Linux 6.6.62+rpt-rpi-v8 aarch64 (bookworm) ● dotnet 8.0.1
BlueSky: https://bsky.app/profile/wagenborgenwx.bsky.social
Nossie
Posts: 424
Joined: Tue 16 Aug 2022 8:01 pm
Weather Station: Ecowitt 2551
Operating System: Raspberry Pi5 Debian Bookworm
Location: Stewarton, East Ayrshire UK
Contact:

Re: website not fully updating - not new update related

Post by Nossie »

If I force it to update from the terminal (it has partially updated again)

diag files attached.

thanks,
Ian.
You do not have the required permissions to view the files attached to this post.
Ian.

http://www.StewartonWeather.com
Containerised Cumulus[MX] 4.2.1 (build: 4040) ● CumulusUtils Version 7.1.1● Ecowitt 2551/WH65/T&HP/WH57/WH45/3x WH51 ● Pi 5 8GB ● Debian Bookworm ● Ubuntu Server Host
Nossie
Posts: 424
Joined: Tue 16 Aug 2022 8:01 pm
Weather Station: Ecowitt 2551
Operating System: Raspberry Pi5 Debian Bookworm
Location: Stewarton, East Ayrshire UK
Contact:

Re: website not fully updating - not new update related

Post by Nossie »

For the same reason as above the CO2 sensor is ignored because it cannot find any data.
Just also discovered the CO2 sensor was physically switched off as part of a server diagnostic the other day - just turned it back on.
Ian.

http://www.StewartonWeather.com
Containerised Cumulus[MX] 4.2.1 (build: 4040) ● CumulusUtils Version 7.1.1● Ecowitt 2551/WH65/T&HP/WH57/WH45/3x WH51 ● Pi 5 8GB ● Debian Bookworm ● Ubuntu Server Host
User avatar
HansR
Posts: 6926
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: GW1100 (WS80/WH40)
Operating System: Raspberry OS/Bookworm
Location: Wagenborgen (NL)
Contact:

Re: website not fully updating - not new update related

Post by HansR »

OK, it all seems to be running OK:

Code: Select all

2023-07-22 19:32:55.866 Realtime[10]: Start cycle
2023-07-22 19:32:55.871 Realtime[10]: Creating realtime.txt
2023-07-22 19:32:55.876 Realtime[10]: Creating realtime file - realtimegauges.txt
2023-07-22 19:32:55.887 Realtime[10]: Copying extra file[16] config/CamdataT.txt to config/Camdata.txt
2023-07-22 19:32:55.905 RealtimeLocalCopy[10]: Copying - realtime.txt
2023-07-22 19:32:55.918 RealtimeLocalCopy[10]: Copying - realtimegauges.txt
2023-07-22 19:32:55.932 Realtime[10]: Real time files starting
2023-07-22 19:32:55.937 PHP[10]: Uploading to realtime.txt
2023-07-22 19:32:55.937 Realtime[10]: End cycle
2023-07-22 19:32:55.978 PHP[10]: Upload to realtime.txt: Response code = 200: OK
2023-07-22 19:32:55.983 PHP[10]: Upload to realtime.txt: Response text follows:
Opening text file realtime.txt for replacement
Writing text file realtime.txt
Write complete
2023-07-22 19:32:55.987 Realtime[10]: Extra Files starting
2023-07-22 19:32:55.990 PHP[10]: Uploading to realtimegauges.txt
2023-07-22 19:32:56.020 PHP[10]: Upload to realtimegauges.txt: Response code = 200: OK
2023-07-22 19:32:56.024 PHP[10]: Upload to realtimegauges.txt: Response text follows:
Unzipping data
Opening text file realtimegauges.txt for replacement
Writing text file realtimegauges.txt
Write complete
2023-07-22 19:32:56.029 Realtime[10]: Uploading extra web file utils/extrasensorsrealtime.txt to extrasensorsrealtime.txt
2023-07-22 19:32:56.036 PHP[10]: Uploading to extrasensorsrealtime.txt
2023-07-22 19:32:56.066 PHP[10]: Upload to extrasensorsrealtime.txt: Response code = 200: OK
2023-07-22 19:32:56.071 PHP[10]: Upload to extrasensorsrealtime.txt: Response text follows:
Opening text file extrasensorsrealtime.txt for replacement
Writing text file extrasensorsrealtime.txt
Write complete
2023-07-22 19:32:56.077 Realtime[10]: Real time files complete, 3 files uploaded
So this means CMX is uploading to somewhere where your CUtils website can't find the data.
  • Did you install CUtils to a different directory and did you [note?] change the value of CumulusRealTimeLocation?
  • Did you now start using PHP upload and did you not take into account the relative paths?
To put it short: it all seems to work fine but CUtils can't find the data so 1) either the files are copied to the wrong place or 2) you did change things such that CumulusRealTimeLocation now points to the wrong place.

My first idea would be that the PHP upload is wrongly configured because CMX does not move the realtime files to the webroot (http://www.stewartonweather.com/) That is something you first have to correct.
Hans

https://meteo-wagenborgen.nl
CMX build 4070+ ● RPi 4B ● Linux 6.6.62+rpt-rpi-v8 aarch64 (bookworm) ● dotnet 8.0.1
BlueSky: https://bsky.app/profile/wagenborgenwx.bsky.social
Nossie
Posts: 424
Joined: Tue 16 Aug 2022 8:01 pm
Weather Station: Ecowitt 2551
Operating System: Raspberry Pi5 Debian Bookworm
Location: Stewarton, East Ayrshire UK
Contact:

Re: website not fully updating - not new update related

Post by Nossie »

I don't understand why it would just start happening though - I've not made any changes.
Did you install CUtils to a different directory and did you [note?] change the value of CumulusRealTimeLocation?
Did you now start using PHP upload and did you not take into account the relative paths?
nothing has changed.
Last edited by Nossie on Sat 22 Jul 2023 7:04 pm, edited 1 time in total.
Ian.

http://www.StewartonWeather.com
Containerised Cumulus[MX] 4.2.1 (build: 4040) ● CumulusUtils Version 7.1.1● Ecowitt 2551/WH65/T&HP/WH57/WH45/3x WH51 ● Pi 5 8GB ● Debian Bookworm ● Ubuntu Server Host
User avatar
HansR
Posts: 6926
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: GW1100 (WS80/WH40)
Operating System: Raspberry OS/Bookworm
Location: Wagenborgen (NL)
Contact:

Re: website not fully updating - not new update related

Post by HansR »

Nossie wrote: Sat 22 Jul 2023 6:36 pm If I force it to update from the terminal (it has partially updated again)
I actually thought about what was "it" ;)
Is it CMX or CUtils which you mean to update here? And is it data or software which you update?
Hans

https://meteo-wagenborgen.nl
CMX build 4070+ ● RPi 4B ● Linux 6.6.62+rpt-rpi-v8 aarch64 (bookworm) ● dotnet 8.0.1
BlueSky: https://bsky.app/profile/wagenborgenwx.bsky.social
User avatar
HansR
Posts: 6926
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: GW1100 (WS80/WH40)
Operating System: Raspberry OS/Bookworm
Location: Wagenborgen (NL)
Contact:

Re: website not fully updating - not new update related

Post by HansR »

Nossie wrote: Sat 22 Jul 2023 7:02 pm I don't understand why it would just start happening though - I've not made any changes.
Yes, good question :lol:
Hans

https://meteo-wagenborgen.nl
CMX build 4070+ ● RPi 4B ● Linux 6.6.62+rpt-rpi-v8 aarch64 (bookworm) ● dotnet 8.0.1
BlueSky: https://bsky.app/profile/wagenborgenwx.bsky.social
User avatar
HansR
Posts: 6926
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: GW1100 (WS80/WH40)
Operating System: Raspberry OS/Bookworm
Location: Wagenborgen (NL)
Contact:

Re: website not fully updating - not new update related

Post by HansR »

What did you do? It is working!

Aha.... only once...
Hans

https://meteo-wagenborgen.nl
CMX build 4070+ ● RPi 4B ● Linux 6.6.62+rpt-rpi-v8 aarch64 (bookworm) ● dotnet 8.0.1
BlueSky: https://bsky.app/profile/wagenborgenwx.bsky.social
Nossie
Posts: 424
Joined: Tue 16 Aug 2022 8:01 pm
Weather Station: Ecowitt 2551
Operating System: Raspberry Pi5 Debian Bookworm
Location: Stewarton, East Ayrshire UK
Contact:

Re: website not fully updating - not new update related

Post by Nossie »

I checked the CMX setup and that appears to be fine.

It's the website that partially updates and stalls I have everything uploading to the web_html folder and utils it the utils folder - but again I've not changed anything.


graphs are not showing anything past the 16/07
Ian.

http://www.StewartonWeather.com
Containerised Cumulus[MX] 4.2.1 (build: 4040) ● CumulusUtils Version 7.1.1● Ecowitt 2551/WH65/T&HP/WH57/WH45/3x WH51 ● Pi 5 8GB ● Debian Bookworm ● Ubuntu Server Host
User avatar
HansR
Posts: 6926
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: GW1100 (WS80/WH40)
Operating System: Raspberry OS/Bookworm
Location: Wagenborgen (NL)
Contact:

Re: website not fully updating - not new update related

Post by HansR »

Nossie wrote: Sat 22 Jul 2023 7:17 pm It's the website that partially updates and stalls I have everything uploading to the web_html folder and utils it the utils folder - but again I've not changed anything.
So on the website you have a utils folder? That is interesting because the webroot - where the index.html file is - should be the web_html folder. That folder must contain data and all generated CUtils files including the data. Is that not the case?
Hans

https://meteo-wagenborgen.nl
CMX build 4070+ ● RPi 4B ● Linux 6.6.62+rpt-rpi-v8 aarch64 (bookworm) ● dotnet 8.0.1
BlueSky: https://bsky.app/profile/wagenborgenwx.bsky.social
Nossie
Posts: 424
Joined: Tue 16 Aug 2022 8:01 pm
Weather Station: Ecowitt 2551
Operating System: Raspberry Pi5 Debian Bookworm
Location: Stewarton, East Ayrshire UK
Contact:

Re: website not fully updating - not new update related

Post by Nossie »

sorry yes - it's pushing everything to the webroot

most of the json files on the host have not updated since 16/07
Ian.

http://www.StewartonWeather.com
Containerised Cumulus[MX] 4.2.1 (build: 4040) ● CumulusUtils Version 7.1.1● Ecowitt 2551/WH65/T&HP/WH57/WH45/3x WH51 ● Pi 5 8GB ● Debian Bookworm ● Ubuntu Server Host
Post Reply