Page 2 of 3

Re: Uploading of realtime.txt via ftp

Posted: Mon 29 Mar 2021 6:09 am
by Rylands
PM sent (at least I hope it has been sent....)

Re: Uploading of realtime.txt via ftp

Posted: Mon 29 Mar 2021 6:14 am
by HansR
Tbh, it is OK a communication goes over PM if its too detailed or whatever, but if there is a solution, I would appreciate to see it.
I sometimes encounter issues with FTP as well, might pick up ideas from solutions!

Re: Uploading of realtime.txt via ftp

Posted: Mon 29 Mar 2021 7:07 am
by Rylands
Hello all.

I believe (but might be totally wrong) that the error lies in the path I am using in Cumulus to transfer the files, as currently NO files are being transferred.

If somebody could be kind enough to explain remote FTP directory on Cumulus and how this corresponds to remote directory as viewed in an FTP program (eg Filezilla) it would be much appreciated.

i.e.

If my website is iloveweather.com.

and I want files from Cumulus to be sent via ftp to /iloveweather.com/public_html/cumulus

is the host name on cumulus iloveweather.com, and the remote FTP Directory iloveweather.com/public_html/cumulus or something different?

Surely, somebody has a similar setup and can guide me accordingly?

Re: Uploading of realtime.txt via ftp

Posted: Mon 29 Mar 2021 7:35 am
by ConligWX
try using /public_html/cumulus as the path.

Re: Uploading of realtime.txt via ftp

Posted: Mon 29 Mar 2021 11:27 am
by Rylands
Thanks to all of you who have tried to help so far.

It doesn't seem to matter what path I enter in my Remote FTP Directory, nothing will upload, and the ftplog.txt file continues to show errors such as

Error uploading realtime.txt to /cumulus//realtime.txt : Timed out trying to connect!

The actual path is public_html/template, but using this path also gives the error

Error uploading realtime.txt to public_html/template//realtime.txt : Connection refused

So either there is a problem with my host in terms of the format required to send files through to my site OR I cannot get the right path.

I think I'll just give up - and refer to Cumulus itself to provide me the data. Doesn't look like setting up file transfer is going to work :(

Re: Uploading of realtime.txt via ftp

Posted: Mon 29 Mar 2021 12:14 pm
by freddie
Rylands wrote: Mon 29 Mar 2021 11:27 amError uploading realtime.txt to /cumulus//realtime.txt : Timed out trying to connect!

The actual path is public_html/template, but using this path also gives the error

Error uploading realtime.txt to public_html/template//realtime.txt : Connection refused
Both of these errors are related to being unable to connect to your hosting - nothing to do with file paths.
Some questions:
-> Does your host permit connections via FTP? In my experience, not many do nowadays.
-> Have you tried transferring your files using SFTP (or FTPS)? These two protocols are the ones favoured by hosting companies rather than FTP.

You can change MX to use SFTP (or FTPS) in your settings pages.

Re: Uploading of realtime.txt via ftp

Posted: Mon 29 Mar 2021 12:59 pm
by PaulMy
HansR wrote: Mon 29 Mar 2021 6:14 am Tbh, it is OK a communication goes over PM if its too detailed or whatever, but if there is a solution, I would appreciate to see it.
I sometimes encounter issues with FTP as well, might pick up ideas from solutions!
Agreed. and in this case it was a PM regarding a potential security matter re the Cumulus.ini posting.

Enjoy,
Paul

Re: Uploading of realtime.txt via ftp

Posted: Mon 29 Mar 2021 1:30 pm
by HansR
@Paul: OK, thnx.

Re: Uploading of realtime.txt via ftp

Posted: Mon 29 Mar 2021 8:53 pm
by Rylands
Given I can't seem to transfer files using the inbuilt file transfer options on Cumulus, are there any other options to transfer the realtime text file from Cumulus to my site?

Re: Uploading of realtime.txt via ftp

Posted: Mon 29 Mar 2021 9:09 pm
by freddie
Rylands wrote: Mon 29 Mar 2021 8:53 pm Given I can't seem to transfer files using the inbuilt file transfer options on Cumulus, are there any other options to transfer the realtime text file from Cumulus to my site?
Have you tried the SFTP and FTPS options? If so, what errors were reported? Reading this topic, you only appear to have tried FTP ...

Re: Uploading of realtime.txt via ftp

Posted: Tue 30 Mar 2021 12:18 am
by Rylands
Having experimented with different file paths over the last 24 hours, I have noticed the following:

ftplog.txt shows timed out errors no matter what path I set. HOWEVER

At 7:50 pm last night my time, a series of json files (eg dailytemp.json, dailyrain.json) were uploaded to my root directory /

AT 8:43 pm last night, the same files were uploaded to my directory /cumulus, and again between 9:05 and 9:50 am this morning - however the files from the morning have the extension jsontemp.

So I'm confused as to how these files are transferred to my site if it's not ftp??

Re: Uploading of realtime.txt via ftp

Posted: Tue 30 Mar 2021 4:23 am
by HansR
Now that is interesting because I have a (remotely) similar issue with my CumulusUils where it, with one user, started to fail sending a file with plain vanilla FTP. Then suddenly after some ten day it did send it once and then failed again. Currently waiting for it to have a successful send again.

I extended the info and had an inner exception on the timeout (yes the same error as @rylands) and it fails to read something back after it thinks it sent the file. And even in the case where the file did come through that same error occurs. Searching the internet for that error !does not come up with a solution other than a bug in the FluentFTP library. I'll add the specific text of that error later.

@rylands i can't find any location info of you nor a site. The problem i describe is in Norway. And you are where?

Re: Uploading of realtime.txt via ftp

Posted: Tue 30 Mar 2021 4:29 am
by HansR
Rylands wrote: Tue 30 Mar 2021 12:18 am So I'm confused as to how these files are transferred to my site if it's not ftp??
And yes that is through FTP (you did send the protocol to plain FTP did you?). You use renaming of the files after the copy. That is internal and should not be the problem.

Re: Uploading of realtime.txt via ftp

Posted: Tue 30 Mar 2021 4:39 am
by Rylands
@rylands i can't find any location info of you nor a site. The problem i describe is in Norway. And you are where?
I'm from Melbourne, Australia.

My site at www.eyeseontheweather.com.au had been working fine until 48 hours ago.

I decided to move it to a new host, as I had already moved another site to the same host. Big mistake.

My advice - if anybody is looking for a new host, stay away from siteground.

I'm going to give it another 24 hours to see if there is a solution, before moving everything back and having the site up and running again.

Out of interest, 2 more zero byte files transferred at 11:30am and 11:50am this morning - airquality.jsontemp and dailyrain.jsontemp

Re: Uploading of realtime.txt via ftp

Posted: Tue 30 Mar 2021 6:45 am
by HansR
Rylands wrote: Tue 30 Mar 2021 4:39 am
@rylands i can't find any location info of you nor a site. The problem i describe is in Norway. And you are where?
I'm from Melbourne, Australia.
OK, that's far from Norway :lol:
Rylands wrote: Tue 30 Mar 2021 4:39 am My site at www.eyeseontheweather.com.au had been working fine until 48 hours ago.

I decided to move it to a new host, as I had already moved another site to the same host. Big mistake.

My advice - if anybody is looking for a new host, stay away from siteground.

I'm going to give it another 24 hours to see if there is a solution, before moving everything back and having the site up and running again.

Out of interest, 2 more zero byte files transferred at 11:30am and 11:50am this morning - airquality.jsontemp and dailyrain.jsontemp
OK. Thanks for the info.

Below is the extended error information from my problem with FTP in NOrway using the same library as CMX. So it would be interesting to see what extended error information you can come up with. Maybe we should wait a comment by @mcrossley on this before you switch provider again (assuming your CMX is running fine). If he could come up with a CMX version to show the inner exception we could have proof of an issue with the library (if against some specific type of server - so what server is the provider using? If we should report a bug then the server is asked).

NOTE: in one case an upload was successful (the file was there) but the code gave a fail because it could not read the response. Below it is just failing the response.

2021-03-26 06:39:12.016 Error MapsOn: Upload Exception: Error while uploading the file to the server. See InnerException for more info.
2021-03-26 06:39:12.026 Error MapsOn ERROR: Inner Exception: System.TimeoutException: Timed out trying to read data from the socket stream!
at FluentFTP.FtpSocketStream.Read (System.Byte[] buffer, System.Int32 offset, System.Int32 count) [0x00042] in <3792a06df8ff4ac698665c1c1cbabf74>:0
at FluentFTP.FtpSocketStream.ReadLine (System.Text.Encoding encoding) [0x00045] in <3792a06df8ff4ac698665c1c1cbabf74>:0
at (wrapper remoting-invoke-with-check) FluentFTP.FtpSocketStream.ReadLine(System.Text.Encoding)
at FluentFTP.FtpClient.GetReply () [0x000b4] in <3792a06df8ff4ac698665c1c1cbabf74>:0
at FluentFTP.FtpClient.Execute (System.String command) [0x000d9] in <3792a06df8ff4ac698665c1c1cbabf74>:0
at FluentFTP.FtpClient.OpenPassiveDataStream (FluentFTP.FtpDataConnectionType type, System.String command, System.Int64 restart) [0x00198] in <3792a06df8ff4ac698665c1c1cbabf74>:0
at FluentFTP.FtpClient.OpenDataStream (System.String command, System.Int64 restart) [0x00070] in <3792a06df8ff4ac698665c1c1cbabf74>:0
at FluentFTP.FtpClient.OpenWrite (System.String path, FluentFTP.FtpDataType type, System.Boolean checkIfFileExists) [0x0009d] in <3792a06df8ff4ac698665c1c1cbabf74>:0
at FluentFTP.FtpClient.UploadFileInternal (System.IO.Stream fileData, System.String localPath, System.String remotePath, System.Boolean createRemoteDir, FluentFTP.FtpRemoteExists existsMode, System.Boolean fileExists, System.Boolean fileExistsKnown, System.Action`1[T] progress, FluentFTP.FtpProgress metaProgress) [0x00115] in <3792a06df8ff4ac698665c1c1cbabf74>:0
2021-03-26 06:39:12.026 Error MapsOn: Upload failed, Map update failed, continuing