Welcome to the Cumulus Support forum.

Latest Cumulus MX V3 release 3.28.6 (build 3283) - 21 March 2024

Cumulus MX V4 beta test release 4.0.0 (build 4018) - 28 March 2024

Legacy Cumulus 1 release v1.9.4 (build 1099) - 28 November 2014 (a patch is available for 1.9.4 build 1099 that extends the date range of drop-down menus to 2030)

Download the Software (Cumulus MX / Cumulus 1 and other related items) from the Wiki

Intermittent incomplete display of data on website

From build 3044 the development baton passed to Mark Crossley. Mark has been responsible for all the Builds since. He has made the code available on GitHub. It is Mark's hope that others will join in this development, but at the very least he welcomes your ideas for future developments (see Cumulus MX Development suggestions).

Moderator: mcrossley

Post Reply
freddie
Posts: 2434
Joined: Wed 08 Jun 2011 11:19 am
Weather Station: Davis Vantage Pro 2 + Ecowitt
Operating System: GNU/Linux Ubuntu 22.04 LXC
Location: Alcaston, Shropshire, UK
Contact:

Intermittent incomplete display of data on website

Post by freddie »

Asked on behalf of Michael Lawler (user mdlawler) who can't use this forum:

As the title suggests, Michael is having problems with the display of data on his website being intermittent. He says this:
I'm using Edge Canary, but it happens with the regular version of Edge also. As you can see the data stops displaying after the rain data and the Cumulusmx version displays as a web tag. If I go to http://lawlers.us/weather and then use f5 or control-f5 I can get it to do this and then the next refresh it will probably display correctly and then the next refresh or two it will mess up again.
Screen shot of this behaviour:
1d915fd3.jpg
I tried accessing Michael's site using Edge (and Chrome also) and couldn't replicate this behaviour. He then asks:
Perhaps this is some type of timing problem that only happens when the server and browser are on the same machine and things are super fast. Could you post this to the forum and see if Neil has any ideas?
You do not have the required permissions to view the files attached to this post.
Freddie
Image
flort
Posts: 213
Joined: Thu 17 Dec 2020 9:06 am
Weather Station: Davis Vantage Vue
Operating System: Raspbian GNU/Linux 10 (buster)
Location: Tin Can Bay, Queensland, Australia
Contact:

Re: Intermittent incomplete display of data on website

Post by flort »

I also have this issue and have to refresh the browser to show all the data. I use Edge as my browser. For me, it only started happening after I started using Google Drive Sync. Haven't tried turning it off to see if this resolves the issue.

Regards,
Trevor
User avatar
philpugh
Posts: 381
Joined: Tue 24 May 2011 8:34 am
Weather Station: See Signature
Operating System: Debian 11 (RPi4)
Location: Antrobus, Cheshire, UK
Contact:

Re: Intermittent incomplete display of data on website

Post by philpugh »

I also see this using Edge but not on Firefox or Safari. The page refreshes itself on Edge at the next update period. I also run my web server and CumulusMX software on the same system - RPi 4
Phil Pugh
GW1000 + WH65/WH57/WH31; HP2551 + WS68/WH40A; GW2001 WittBoy
cumulusutils generating website
http://goosegate.uk/
User avatar
ConligWX
Posts: 1573
Joined: Mon 19 May 2014 10:45 pm
Weather Station: Davis vPro2+ w/DFARS + AirLink
Operating System: Ubuntu 22.04 LTS
Location: Bangor, NI
Contact:

Re: Intermittent incomplete display of data on website

Post by ConligWX »

is there any type of cache being used in php? like Zend OPcache or something similar?

or even Leverage browser caching.

I noticed no compression is being used or http/2 protocols on that site as well.
Regards Simon

https://www.conligwx.org - @conligwx
Davis Vantage Pro2 Plus with Daytime FARS • WeatherLink Live • Davis AirLink • PurpleAir •

Image
freddie
Posts: 2434
Joined: Wed 08 Jun 2011 11:19 am
Weather Station: Davis Vantage Pro 2 + Ecowitt
Operating System: GNU/Linux Ubuntu 22.04 LXC
Location: Alcaston, Shropshire, UK
Contact:

Re: Intermittent incomplete display of data on website

Post by freddie »

This is just the default website - no PHP.
Freddie
Image
User avatar
mcrossley
Posts: 12694
Joined: Thu 07 Jan 2010 9:44 pm
Weather Station: Davis VP2/WLL
Operating System: Bullseye Lite rPi
Location: Wilmslow, Cheshire, UK
Contact:

Re: Intermittent incomplete display of data on website

Post by mcrossley »

I've been loading that page maybe a hundred times in Edge and did not see the issue! :(

The data is refreshed once a minute, is the websitedata.json file uploaded once a minute as well?

Does the upload use the FTP Rename option? If not there is a longer window when the file will be partially written to on update and possibly sent by the web site - however if the file was incomplete you would expect the JSON parser to fail. :?
flort
Posts: 213
Joined: Thu 17 Dec 2020 9:06 am
Weather Station: Davis Vantage Vue
Operating System: Raspbian GNU/Linux 10 (buster)
Location: Tin Can Bay, Queensland, Australia
Contact:

Re: Intermittent incomplete display of data on website

Post by flort »

I generally only see it happen on the initial page load. Subsequent refreshes don't seem to have an issue. It can also happen when moving to a different page on the website but, again, a refresh will fix the issue.

I don't use CMX's built-in FTP functionality. I use a free web hosting service and my account gets blocked if I do. Instead, I upload the websitedata.json file every 2 minutes with LFTP via a Cron job. All other required files are done every 15 minutes.

I also have a local webserver installation visible inside my network which processes the websitedata.json file every minute using the Extra Web Files. This installation allows me to use SQL database as that is not available on the free service.

The issue of the page not fully loading happens on both the internal and external website which points to the issue being with the browser rather than anything else.

Regards,
Trevor
User avatar
mcrossley
Posts: 12694
Joined: Thu 07 Jan 2010 9:44 pm
Weather Station: Davis VP2/WLL
Operating System: Bullseye Lite rPi
Location: Wilmslow, Cheshire, UK
Contact:

Re: Intermittent incomplete display of data on website

Post by mcrossley »

flort wrote: Sat 25 Jun 2022 12:35 am I generally only see it happen on the initial page load. Subsequent refreshes don't seem to have an issue. It can also happen when moving to a different page on the website but, again, a refresh will fix the issue.
Right, I'll try again...
User avatar
mcrossley
Posts: 12694
Joined: Thu 07 Jan 2010 9:44 pm
Weather Station: Davis VP2/WLL
Operating System: Bullseye Lite rPi
Location: Wilmslow, Cheshire, UK
Contact:

Re: Intermittent incomplete display of data on website

Post by mcrossley »

OK, I have found the problem and have a solution, I think.

Care to try this new version of the setpagedata script for me?
You do not have the required permissions to view the files attached to this post.
flort
Posts: 213
Joined: Thu 17 Dec 2020 9:06 am
Weather Station: Davis Vantage Vue
Operating System: Raspbian GNU/Linux 10 (buster)
Location: Tin Can Bay, Queensland, Australia
Contact:

Re: Intermittent incomplete display of data on website

Post by flort »

Hi Mark,

I've tried the new script but am still experiencing the issue.

Regards,
Trevor
User avatar
mcrossley
Posts: 12694
Joined: Thu 07 Jan 2010 9:44 pm
Weather Station: Davis VP2/WLL
Operating System: Bullseye Lite rPi
Location: Wilmslow, Cheshire, UK
Contact:

Re: Intermittent incomplete display of data on website

Post by mcrossley »

Did you flush your browser cache - or Ctrl-F5 the page to ensure you pick up the new version of the script?
flort
Posts: 213
Joined: Thu 17 Dec 2020 9:06 am
Weather Station: Davis Vantage Vue
Operating System: Raspbian GNU/Linux 10 (buster)
Location: Tin Can Bay, Queensland, Australia
Contact:

Re: Intermittent incomplete display of data on website

Post by flort »

No I didn't. I was checking it over several hours and everything was looking good but then it had a failure so I thought there was still an issue. I've now cleared the cache so we'll wait and see if there is a reoccurrence.

Regards,
Trevor
flort
Posts: 213
Joined: Thu 17 Dec 2020 9:06 am
Weather Station: Davis Vantage Vue
Operating System: Raspbian GNU/Linux 10 (buster)
Location: Tin Can Bay, Queensland, Australia
Contact:

Re: Intermittent incomplete display of data on website

Post by flort »

Hi Mark,

I haven't had any further issues with this using the new script so looks like it has worked.

Regards,
Trevor
User avatar
mcrossley
Posts: 12694
Joined: Thu 07 Jan 2010 9:44 pm
Weather Station: Davis VP2/WLL
Operating System: Bullseye Lite rPi
Location: Wilmslow, Cheshire, UK
Contact:

Re: Intermittent incomplete display of data on website

Post by mcrossley »

Great thanks, I'll incorporate the changes in the next release.
Post Reply