Uploading of realtime.txt via ftp

[Rylands]

PM sent (at least I hope it has been sent....)

[HansR]

Tbh, it is OK a communication goes over PM if its too detailed or whatever, but if there is a solution, I would appreciate to see it.
I sometimes encounter issues with FTP as well, might pick up ideas from solutions!

[Rylands]

Hello all.

I believe (but might be totally wrong) that the error lies in the path I am using in Cumulus to transfer the files, as currently NO files are being transferred.

If somebody could be kind enough to explain remote FTP directory on Cumulus and how this corresponds to remote directory as viewed in an FTP program (eg Filezilla) it would be much appreciated.

i.e.

If my website is iloveweather.com.

and I want files from Cumulus to be sent via ftp to /iloveweather.com/public_html/cumulus

is the host name on cumulus iloveweather.com, and the remote FTP Directory iloveweather.com/public_html/cumulus or something different?

Surely, somebody has a similar setup and can guide me accordingly?

[ConligWX]

try using /public_html/cumulus as the path.

[Rylands]

Thanks to all of you who have tried to help so far.

It doesn't seem to matter what path I enter in my Remote FTP Directory, nothing will upload, and the ftplog.txt file continues to show errors such as

Error uploading realtime.txt to /cumulus//realtime.txt : Timed out trying to connect!

The actual path is public_html/template, but using this path also gives the error

Error uploading realtime.txt to public_html/template//realtime.txt : Connection refused

So either there is a problem with my host in terms of the format required to send files through to my site OR I cannot get the right path.

I think I'll just give up - and refer to Cumulus itself to provide me the data. Doesn't look like setting up file transfer is going to work

[freddie]

Error uploading realtime.txt to /cumulus//realtime.txt : Timed out trying to connect!

The actual path is public_html/template, but using this path also gives the error

Error uploading realtime.txt to public_html/template//realtime.txt : Connection refused

Both of these errors are related to being unable to connect to your hosting - nothing to do with file paths.
Some questions:
-> Does your host permit connections via FTP? In my experience, not many do nowadays.
-> Have you tried transferring your files using SFTP (or FTPS)? These two protocols are the ones favoured by hosting companies rather than FTP.

You can change MX to use SFTP (or FTPS) in your settings pages.

[PaulMy]

Tbh, it is OK a communication goes over PM if its too detailed or whatever, but if there is a solution, I would appreciate to see it.
I sometimes encounter issues with FTP as well, might pick up ideas from solutions!

Agreed. and in this case it was a PM regarding a potential security matter re the Cumulus.ini posting.

Enjoy,
Paul

[HansR]

@Paul: OK, thnx.

[Rylands]

Given I can't seem to transfer files using the inbuilt file transfer options on Cumulus, are there any other options to transfer the realtime text file from Cumulus to my site?

[freddie]

Given I can't seem to transfer files using the inbuilt file transfer options on Cumulus, are there any other options to transfer the realtime text file from Cumulus to my site?

Have you tried the SFTP and FTPS options? If so, what errors were reported? Reading this topic, you only appear to have tried FTP ...

[Rylands]

Having experimented with different file paths over the last 24 hours, I have noticed the following:

ftplog.txt shows timed out errors no matter what path I set. HOWEVER

At 7:50 pm last night my time, a series of json files (eg dailytemp.json, dailyrain.json) were uploaded to my root directory /

AT 8:43 pm last night, the same files were uploaded to my directory /cumulus, and again between 9:05 and 9:50 am this morning - however the files from the morning have the extension jsontemp.

So I'm confused as to how these files are transferred to my site if it's not ftp??

[HansR]

Now that is interesting because I have a (remotely) similar issue with my CumulusUils where it, with one user, started to fail sending a file with plain vanilla FTP. Then suddenly after some ten day it did send it once and then failed again. Currently waiting for it to have a successful send again.

I extended the info and had an inner exception on the timeout (yes the same error as @rylands) and it fails to read something back after it thinks it sent the file. And even in the case where the file did come through that same error occurs. Searching the internet for that error !does not come up with a solution other than a bug in the FluentFTP library. I'll add the specific text of that error later.

@rylands i can't find any location info of you nor a site. The problem i describe is in Norway. And you are where?

[HansR]

So I'm confused as to how these files are transferred to my site if it's not ftp??

And yes that is through FTP (you did send the protocol to plain FTP did you?). You use renaming of the files after the copy. That is internal and should not be the problem.

[Rylands]

@rylands i can't find any location info of you nor a site. The problem i describe is in Norway. And you are where?

I'm from Melbourne, Australia.

My site at www.eyeseontheweather.com.au had been working fine until 48 hours ago.

I decided to move it to a new host, as I had already moved another site to the same host. Big mistake.

My advice - if anybody is looking for a new host, stay away from siteground.

I'm going to give it another 24 hours to see if there is a solution, before moving everything back and having the site up and running again.

Out of interest, 2 more zero byte files transferred at 11:30am and 11:50am this morning - airquality.jsontemp and dailyrain.jsontemp

[HansR]

@rylands i can't find any location info of you nor a site. The problem i describe is in Norway. And you are where?

I'm from Melbourne, Australia.

OK, that's far from Norway

My site at www.eyeseontheweather.com.au had been working fine until 48 hours ago.

I decided to move it to a new host, as I had already moved another site to the same host. Big mistake.

My advice - if anybody is looking for a new host, stay away from siteground.

I'm going to give it another 24 hours to see if there is a solution, before moving everything back and having the site up and running again.

Out of interest, 2 more zero byte files transferred at 11:30am and 11:50am this morning - airquality.jsontemp and dailyrain.jsontemp

OK. Thanks for the info.

Below is the extended error information from my problem with FTP in NOrway using the same library as CMX. So it would be interesting to see what extended error information you can come up with. Maybe we should wait a comment by @mcrossley on this before you switch provider again (assuming your CMX is running fine). If he could come up with a CMX version to show the inner exception we could have proof of an issue with the library (if against some specific type of server - so what server is the provider using? If we should report a bug then the server is asked).

NOTE: in one case an upload was successful (the file was there) but the code gave a fail because it could not read the response. Below it is just failing the response.

2021-03-26 06:39:12.016 Error MapsOn: Upload Exception: Error while uploading the file to the server. See InnerException for more info.
2021-03-26 06:39:12.026 Error MapsOn ERROR: Inner Exception: System.TimeoutException: Timed out trying to read data from the socket stream!
at FluentFTP.FtpSocketStream.Read (System.Byte[] buffer, System.Int32 offset, System.Int32 count) [0x00042] in <3792a06df8ff4ac698665c1c1cbabf74>:0
at FluentFTP.FtpSocketStream.ReadLine (System.Text.Encoding encoding) [0x00045] in <3792a06df8ff4ac698665c1c1cbabf74>:0
at (wrapper remoting-invoke-with-check) FluentFTP.FtpSocketStream.ReadLine(System.Text.Encoding)
at FluentFTP.FtpClient.GetReply () [0x000b4] in <3792a06df8ff4ac698665c1c1cbabf74>:0
at FluentFTP.FtpClient.Execute (System.String command) [0x000d9] in <3792a06df8ff4ac698665c1c1cbabf74>:0
at FluentFTP.FtpClient.OpenPassiveDataStream (FluentFTP.FtpDataConnectionType type, System.String command, System.Int64 restart) [0x00198] in <3792a06df8ff4ac698665c1c1cbabf74>:0
at FluentFTP.FtpClient.OpenDataStream (System.String command, System.Int64 restart) [0x00070] in <3792a06df8ff4ac698665c1c1cbabf74>:0
at FluentFTP.FtpClient.OpenWrite (System.String path, FluentFTP.FtpDataType type, System.Boolean checkIfFileExists) [0x0009d] in <3792a06df8ff4ac698665c1c1cbabf74>:0
at FluentFTP.FtpClient.UploadFileInternal (System.IO.Stream fileData, System.String localPath, System.String remotePath, System.Boolean createRemoteDir, FluentFTP.FtpRemoteExists existsMode, System.Boolean fileExists, System.Boolean fileExistsKnown, System.Action`1[T] progress, FluentFTP.FtpProgress metaProgress) [0x00115] in <3792a06df8ff4ac698665c1c1cbabf74>:0
2021-03-26 06:39:12.026 Error MapsOn: Upload failed, Map update failed, continuing