Continued SFTP upload failure of realtime.txt

[pkiener]

Using CumulusMX ver 3.6.10 (build 3086) 24 June 2020 on a raspberry pi 3.
Uploading data, including realtime.txt and realtimegauges.txt to server hosted by TsoHost.

I have been having periodic failure with the upload of realtime.txt and realtimegauges.txt. The most recent failure was 2020-07-01 09-16. Error log recorded the message at that time as:
2020-07-01 09:16:08.099 Realtime[124]: Uploading - realtime.txt
2020-07-01 09:16:08.099 SFTP[124]: Starting Upload of realtime.txt to /home/kiener/public_html/Cumulus/realtime.txt
2020-07-01 09:16:23.101 SFTP[124]: Error uploading realtime.txt to /home/kiener/public_html/Cumulus/realtime.txt : Operation has timed out.
(The realtimegauges.txt had a similar error message)

The subsequent attempts to upload realtime.txt resulted in the following message(s):
2020-07-01 09:19:08.099 Realtime[125]: Uploading - realtime.txt
2020-07-01 09:19:08.099 SFTP[125]: Starting Upload of realtime.txt to /home/kiener/public_html/Cumulus/realtime.txt
2020-07-01 09:19:08.101 SFTP[125]: Error uploading realtime.txt to /home/kiener/public_html/Cumulus/realtime.txt : Safe handle has been closed
(The realtimegauges.txt had a similar error message)

The error messages "Safe handle has been closed" continued until I stopped CumulusMX on the raspberry pi, and then re-started the program.

I checked the file permission for both realtime.txt and realtimegauges.txt on both the raspberry pi and the web server, and the permissions have not changed; they have remained the same as when the uploads were completed successfully earlier.

I have attached a zip file containing: (1) 20200629-123952.txt (log file); (2) realtime.txt (from CumulusMX); (3) realtimegauges.txt (from CumulusMX); (4) realtime-WEB.txt (from the TsoHost web site); and (5) realtimegauges-WEB (from the TsoHost web site). I'm hoping that the attached files can provide enough information to explain my problem and hopefully find a solution.

Any and all help will be greatly appreciated. Thanks in advance!

Paul

[mcrossley]

Hmm, another interesting way for SFTP to fail - this looks like an internal error in the SSH package. They have just released a new beta version of the SSH (the first since 2016) which includes lots of new authentication protocols and a quite a few fixes. I'll test this new version out and include it if it seems OK. And try and add a catch for this Safe handle error as well - I cannot test it as I have zero chance of reproducing it

As an side, your network connection doesn't look very reliable, transfers often time out. And your WU updates always seem to fail?

[pkiener]

Thanks, Mark for your reply! I appreciate it, but sorry to add to the woes of SFTP! And I'll try to do a little housekeeping to see if I can improve the WU connections. Thanks for pointing that out.

Paul

[Phil23]

Still only using standard FTP here but been meaning to mention this.

Last week we had woeful issues with our hosting provide. Basically every thing that could go down did.
Then services up & down following that.

I did notice though that the current MX though that it remained very stable throughout the entire 24+ hour period of their issues.
Uploads to other services continued just fine. In the past this would give MX & the whole PC's a variety of issue; often reboots required.

Should just reconfig for SFTP.....

On the whole FTP thing. Is something like a Test FTP button that simply upload say Test.txt & reports in a dialog a big ask?

It's certainly not something I need, but could be useful for newcomers.

Cheers.