Page 1 of 2

Build 3080 Realtime FTP.

Posted: Tue 26 May 2020 10:31 pm
by Phil23
Noticed in the release notes there were some changes in this area.

Upgraded this morning & then noticed realtime updates failed after a few hours.
Standard files were still uploading.
Restarted & it has recovered.

Attached Diags is as of the Startup immediately following the upgrade.

Cheers

Phil.

Re: Build 3080 Realtime FTP.

Posted: Wed 27 May 2020 12:19 am
by optoisolated
Can confirm I am seeing the same thing. realtimegauges.txt also not generating.

Re: Build 3080 Realtime FTP.

Posted: Wed 27 May 2020 7:07 am
by water01
Whereas mine is working perfectly with only one "failure to connect" in 18 hours and it reconnected on the next attempt after failing and disconnecting gracefully, so the stuck on "already in progress" has been fixed.

Re: Build 3080 Realtime FTP.

Posted: Wed 27 May 2020 7:28 am
by meteo19
Big problems for me too random updates.

Patrick
http://www.meteosegur.fr/Base-segur/index.php

Re: Build 3080 Realtime FTP.

Posted: Wed 27 May 2020 8:35 am
by mcrossley
Phil23 wrote: Tue 26 May 2020 10:31 pm Noticed in the release notes there were some changes in this area.

Upgraded this morning & then noticed realtime updates failed after a few hours.
Standard files were still uploading.
Restarted & it has recovered.

Attached Diags is as of the Startup immediately following the upgrade.

Cheers

Phil.
Hi Phil, I think I see what is happening, can you switch on debug logging and post another log please.

Re: Build 3080 Realtime FTP.

Posted: Wed 27 May 2020 9:42 am
by Phil23
mcrossley wrote: Wed 27 May 2020 8:35 am can you switch on debug logging and post another log please.
It's currently working Ok, but then it's had my scheduled restarts @ 9:00am & 6:00pm since I notice the first issue.

Presume changing my schedule as below is what you need?

Phil.
Capture.JPG

Re: Build 3080 Realtime FTP.

Posted: Wed 27 May 2020 9:47 am
by Phil23
Hmmmm,

-debug doesn't work when used as above.

Started it manually from a prompt, so at least it's running in debug mode now.

Re: Build 3080 Realtime FTP.

Posted: Wed 27 May 2020 10:35 am
by mcrossley
I think that should be...

Code: Select all

cmd.exe /C start "CumulusMX" "C:\CumulusMX\CumulusMX.exe" -debug
Though I don't think you need the quotes as you have no spaces in the Window name or executable path.

Re: Build 3080 Realtime FTP.

Posted: Wed 27 May 2020 4:11 pm
by mcrossley
It appears the latest real time FTP changes improved matters for some, and made them worse for others, my apologies for that.

I have spent some time looking at the real time FTP and decided to change the code quite extensively. I got my NAS (FTP) server in a state where it is quite slow at FTP, and this has allowed me to test various failure paths.

So, I'll have a patch release soon. The logging is now much more extensive (you will have to enable debug and FTP logging to get all the messages in the MXdiags log). It is now much more robust, and I have labelled each real time FTP "cycle" with a unique number, so the messages in the log from overlapping cycles are much easier to decipher. It also makes it easy to see if your real time interval is shorter than your server will accept the uploads.

Testing this has rammed home how hopeless the FTP protocol is in performance terms compared to SFTP. Use SFTP if your hosting service supports it!

Re: Build 3080 Realtime FTP.

Posted: Wed 27 May 2020 7:51 pm
by Phil23
Just up a 5:35am & I checked the gauge page & it reported station off-line & no realtime happening.

It was only reporting being off line for 4 minutes as @ 5:41am.
Opened the logfile with Notepad++ to avoid closing MX & copied the text into another file.

Also notice that it has now recovered.

Cheers

Phil.

Re: Build 3080 Realtime FTP.

Posted: Wed 27 May 2020 7:59 pm
by Phil23
Correction,

It has not recovered, gauges page now show this....
Capture.JPG
As @ 5:57:00 Realtimegauges & Realtime.txt show time stamps of 5:56:30 & 5:56:32.

Phil.

Re: Build 3080 Realtime FTP.

Posted: Wed 27 May 2020 8:07 pm
by Phil23
mcrossley wrote: Wed 27 May 2020 4:11 pm (you will have to enable debug and FTP logging to get all the messages in the MXdiags log).
Is there a switch to turn on FTP logging from the prompt on launch?

Re: Build 3080 Realtime FTP.

Posted: Wed 27 May 2020 9:40 pm
by mcrossley
Phil23 wrote: Wed 27 May 2020 8:07 pm Is there a switch to turn on FTP logging from the prompt on launch?
No, but if set from the admin interface it persists across runs unlike the debug and data logging options.

Re: Build 3080 Realtime FTP.

Posted: Wed 27 May 2020 10:09 pm
by alexlc13
I'm having the same realtime problems (I use SFTP). I upload every 5 seconds. I used to upload every 3 seconds for a few months with no issues, then started having problems around May 4th. I increased the upload time to 5 seconds, which helped. But the issues still kept coming. When I updated on May 21, the issues went away (at 5 seconds). Then they came back last night (and continue today) after installing the latest update. I hope this information helps. I'm including my debug log (which includes the debug and ftp debug info) from this morning when it crashed on me. FYI - my website pages continue to update just fine every 5 minutes.

Re: Build 3080 Realtime FTP.

Posted: Wed 27 May 2020 10:23 pm
by Phil23
mcrossley wrote: Wed 27 May 2020 9:40 pmif set from the admin interface it persists across runs unlike the debug and data logging options.
Have that turned on now & it's been logging since just after 6:00am.

Will let it run untouched for most of the day & then post it at a respectable UK Time.

There will no doubt be some anomalies in my log file as I'm part way into setting up / diagnosing some VPN issues with a new router, so it will require a few reboots during the day which will cause the CMX PC to lose it's internet connectivity periodically.

Cheers

Phil.