Welcome to the Cumulus Support forum.

Latest Cumulus MX release 3.11.4 (build 3133) - 25 May 2021 (please see announcement regarding releases since 3.5.0)
Legacy Cumulus 1 release v1.9.4 (build 1099) - 28 November 2014 (a patch is available for 1.9.4 build 1099 that extends the date range of drop-down menus to 2030)

Download the Software (Cumulus MX / Cumulus 1 and other related items) from the Wiki

Build 3080 Realtime FTP.

From build 3044 the development baton passed to Mark Crossley. Mark has been responsible for all the Builds since. He has made the code available on GitHub. It is Mark's hope that others will join in this development, but at the very least he welcomes your ideas for future developments (see Cumulus MX Development suggestions).

Moderator: mcrossley

Phil23
Posts: 647
Joined: Sat 16 Jul 2016 11:59 pm
Weather Station: Davis Vantage Pro2 Plus
Operating System: Win10 Pro
Location: Australia

Build 3080 Realtime FTP.

Post by Phil23 »

Noticed in the release notes there were some changes in this area.

Upgraded this morning & then noticed realtime updates failed after a few hours.
Standard files were still uploading.
Restarted & it has recovered.

Attached Diags is as of the Startup immediately following the upgrade.

Cheers

Phil.
You do not have the required permissions to view the files attached to this post.

optoisolated
Posts: 8
Joined: Tue 06 Jan 2015 10:03 pm
Weather Station: WH3081
Operating System: Windows 8.1
Location: Brisbane, AU

Re: Build 3080 Realtime FTP.

Post by optoisolated »

Can confirm I am seeing the same thing. realtimegauges.txt also not generating.

water01
Posts: 2164
Joined: Sat 13 Aug 2011 9:33 am
Weather Station: WH1081
Operating System: Windows 10 64bit
Location: Burnham-on-Sea
Contact:

Re: Build 3080 Realtime FTP.

Post by water01 »

Whereas mine is working perfectly with only one "failure to connect" in 18 hours and it reconnected on the next attempt after failing and disconnecting gracefully, so the stuck on "already in progress" has been fixed.
David
Image

User avatar
meteo19
Posts: 33
Joined: Tue 03 May 2016 8:13 pm
Weather Station: Davis VP2
Operating System: Microsoft Windows 7 Pro
Location: Ségur-Le-Château, France
Contact:

Re: Build 3080 Realtime FTP.

Post by meteo19 »

Big problems for me too random updates.

Patrick
http://www.meteosegur.fr/Base-segur/index.php

User avatar
mcrossley
Posts: 8473
Joined: Thu 07 Jan 2010 9:44 pm
Weather Station: Davis VP2/WLL
Operating System: Buster Lite rPi
Location: Wilmslow, Cheshire, UK
Contact:

Re: Build 3080 Realtime FTP.

Post by mcrossley »

Phil23 wrote:
Tue 26 May 2020 10:31 pm
Noticed in the release notes there were some changes in this area.

Upgraded this morning & then noticed realtime updates failed after a few hours.
Standard files were still uploading.
Restarted & it has recovered.

Attached Diags is as of the Startup immediately following the upgrade.

Cheers

Phil.
Hi Phil, I think I see what is happening, can you switch on debug logging and post another log please.

Phil23
Posts: 647
Joined: Sat 16 Jul 2016 11:59 pm
Weather Station: Davis Vantage Pro2 Plus
Operating System: Win10 Pro
Location: Australia

Re: Build 3080 Realtime FTP.

Post by Phil23 »

mcrossley wrote:
Wed 27 May 2020 8:35 am
can you switch on debug logging and post another log please.
It's currently working Ok, but then it's had my scheduled restarts @ 9:00am & 6:00pm since I notice the first issue.

Presume changing my schedule as below is what you need?

Phil.
Capture.JPG
You do not have the required permissions to view the files attached to this post.

Phil23
Posts: 647
Joined: Sat 16 Jul 2016 11:59 pm
Weather Station: Davis Vantage Pro2 Plus
Operating System: Win10 Pro
Location: Australia

Re: Build 3080 Realtime FTP.

Post by Phil23 »

Hmmmm,

-debug doesn't work when used as above.

Started it manually from a prompt, so at least it's running in debug mode now.

User avatar
mcrossley
Posts: 8473
Joined: Thu 07 Jan 2010 9:44 pm
Weather Station: Davis VP2/WLL
Operating System: Buster Lite rPi
Location: Wilmslow, Cheshire, UK
Contact:

Re: Build 3080 Realtime FTP.

Post by mcrossley »

I think that should be...

Code: Select all

cmd.exe /C start "CumulusMX" "C:\CumulusMX\CumulusMX.exe" -debug
Though I don't think you need the quotes as you have no spaces in the Window name or executable path.

User avatar
mcrossley
Posts: 8473
Joined: Thu 07 Jan 2010 9:44 pm
Weather Station: Davis VP2/WLL
Operating System: Buster Lite rPi
Location: Wilmslow, Cheshire, UK
Contact:

Re: Build 3080 Realtime FTP.

Post by mcrossley »

It appears the latest real time FTP changes improved matters for some, and made them worse for others, my apologies for that.

I have spent some time looking at the real time FTP and decided to change the code quite extensively. I got my NAS (FTP) server in a state where it is quite slow at FTP, and this has allowed me to test various failure paths.

So, I'll have a patch release soon. The logging is now much more extensive (you will have to enable debug and FTP logging to get all the messages in the MXdiags log). It is now much more robust, and I have labelled each real time FTP "cycle" with a unique number, so the messages in the log from overlapping cycles are much easier to decipher. It also makes it easy to see if your real time interval is shorter than your server will accept the uploads.

Testing this has rammed home how hopeless the FTP protocol is in performance terms compared to SFTP. Use SFTP if your hosting service supports it!

Phil23
Posts: 647
Joined: Sat 16 Jul 2016 11:59 pm
Weather Station: Davis Vantage Pro2 Plus
Operating System: Win10 Pro
Location: Australia

Re: Build 3080 Realtime FTP.

Post by Phil23 »

Just up a 5:35am & I checked the gauge page & it reported station off-line & no realtime happening.

It was only reporting being off line for 4 minutes as @ 5:41am.
Opened the logfile with Notepad++ to avoid closing MX & copied the text into another file.

Also notice that it has now recovered.

Cheers

Phil.
You do not have the required permissions to view the files attached to this post.

Phil23
Posts: 647
Joined: Sat 16 Jul 2016 11:59 pm
Weather Station: Davis Vantage Pro2 Plus
Operating System: Win10 Pro
Location: Australia

Re: Build 3080 Realtime FTP.

Post by Phil23 »

Correction,

It has not recovered, gauges page now show this....
Capture.JPG
As @ 5:57:00 Realtimegauges & Realtime.txt show time stamps of 5:56:30 & 5:56:32.

Phil.
You do not have the required permissions to view the files attached to this post.

Phil23
Posts: 647
Joined: Sat 16 Jul 2016 11:59 pm
Weather Station: Davis Vantage Pro2 Plus
Operating System: Win10 Pro
Location: Australia

Re: Build 3080 Realtime FTP.

Post by Phil23 »

mcrossley wrote:
Wed 27 May 2020 4:11 pm
(you will have to enable debug and FTP logging to get all the messages in the MXdiags log).
Is there a switch to turn on FTP logging from the prompt on launch?

User avatar
mcrossley
Posts: 8473
Joined: Thu 07 Jan 2010 9:44 pm
Weather Station: Davis VP2/WLL
Operating System: Buster Lite rPi
Location: Wilmslow, Cheshire, UK
Contact:

Re: Build 3080 Realtime FTP.

Post by mcrossley »

Phil23 wrote:
Wed 27 May 2020 8:07 pm
Is there a switch to turn on FTP logging from the prompt on launch?
No, but if set from the admin interface it persists across runs unlike the debug and data logging options.

alexlc13
Posts: 22
Joined: Thu 22 Aug 2013 8:35 pm
Weather Station: Davis Vantage Pro2
Operating System: Windows 10
Location: Piedmont, SD

Re: Build 3080 Realtime FTP.

Post by alexlc13 »

I'm having the same realtime problems (I use SFTP). I upload every 5 seconds. I used to upload every 3 seconds for a few months with no issues, then started having problems around May 4th. I increased the upload time to 5 seconds, which helped. But the issues still kept coming. When I updated on May 21, the issues went away (at 5 seconds). Then they came back last night (and continue today) after installing the latest update. I hope this information helps. I'm including my debug log (which includes the debug and ftp debug info) from this morning when it crashed on me. FYI - my website pages continue to update just fine every 5 minutes.
You do not have the required permissions to view the files attached to this post.

Phil23
Posts: 647
Joined: Sat 16 Jul 2016 11:59 pm
Weather Station: Davis Vantage Pro2 Plus
Operating System: Win10 Pro
Location: Australia

Re: Build 3080 Realtime FTP.

Post by Phil23 »

mcrossley wrote:
Wed 27 May 2020 9:40 pm
if set from the admin interface it persists across runs unlike the debug and data logging options.
Have that turned on now & it's been logging since just after 6:00am.

Will let it run untouched for most of the day & then post it at a respectable UK Time.

There will no doubt be some anomalies in my log file as I'm part way into setting up / diagnosing some VPN issues with a new router, so it will require a few reboots during the day which will cause the CMX PC to lose it's internet connectivity periodically.

Cheers

Phil.

Post Reply