realtime data will not upload - maybe bug or maybe not

[ace2]

I've had this issue before and always thought it was the PC related, but now moved to a new setup and its done it again.
This only happens every few months or so, basically I have 3 realtime files that get uploaded every 10 seconds(realtime). What happening is one will not upload at all, the 'name'.txttmp file is present in the web folder with correct updated data, but will not upload. I have tried everything from removing whole entry in cumulus, restarted cumulus, setting it in binary mode and selecting rename.
The only way to fix it, is this :
Now here is weird part, on my web site, the file is 0 bytes, if I delete that file it'll start working again!

So is it a bug with cumulus of a ISP ftp issue????

[steve]

What does the ftp log show?

[ace2]

The realtimeftp log shows an abort

• 16:36:21:403 ! HighLevelAsync 0
  16:36:21:403 04B89650 Socket handle created 1172
  16:36:21:404 TWSocket will connect to 203.16.214.120:58568
  16:36:21:428 ! Data Session opened (Put)
  16:36:21:429 04B89650 TriggerDataSent 1172
  16:36:21:429 04B88E90 TriggerDataSent 1032
  16:36:36:376 ! Aborting
  16:36:36:377 ! HighLevelAsync 0
  16:36:36:377 ! Abort detected
  16:36:36:377 ! HighLevelAsync done
  16:36:36:377 04B89650 TCustomWSocket.Shutdown 1 1172
  16:36:36:378 ! Data Session closed
  16:36:36:378 ! Next3PutAsync
  16:36:36:379 Putting done
  16:36:36:379 ===End of upload of realtime.txt

[steve]

It's aborting because of a timeout - it's had no response from the server for 15 seconds, while trying to upload the realtime.txt file.

[duke]

Could this because of the rather short, 10 second realtime upload?

[steve]

It shouldn't cause any problems; I use a 10 second interval and don't have any problems. If the connection can't actually upload the files in the selected interval, then what you see is the uploads actually occurring at longer intervals, as the next 'slot' gets missed.

It does seem a bit pointless uploading at 10 second intervals when the station only updates every 48 seconds, though.

[ace2]

Used to be 30 seconds with the same problem, I now do 10 seconds due to using cumulus to process a weather overlay file and a sunrise/sunset timing file.
Strange that everything else gets uploaded without issues.

[steve]

Perhaps occasionally the problem file contains something that the server doesn't like, so a failure occurs and a 'lock' is left, so it won't then accept any more uploads of that file. That's just wild speculation, I have no idea whether such a thing could happen (the 'stale lock' part is not speculation, I've seen that happen with some servers), and it's hard to say anything useful without seeing what the ftp log says for the actual file that has the problem at the time the problem occurs. Even seeing the ftp log at the appropriate time may still not pinpoint the problem, if it turns out (as I suspect it will) to be a server problem.

[ace2]

I kind of thought that Steve...
I just have to put up with it i guess..
I have a kind of work around, to manually upload those files with the my other scripts every X minutes which over writes them even if they are 0 bytes in size.

It's just Cumulus's FTP that can't write over them, as NCFTP, Filezila and FTP(android) don't seem to have a problem at all do it...

[Super-T]

I get the same intermittent problem with my webcam upload. 0 bytes, delete the file and all is OK again.

[ace2]

Maybe something could be put into cumulus to delete the file on server before uploading????

[steve]

Maybe something could be put into cumulus to delete the file on server before uploading????

Like the 'Delete before upload' setting in the web settings panel?

[water01]

Maybe something could be put into cumulus to delete the file on server before uploading????

Like the 'Delete before upload' setting in the web settings panel?

[ace2]

Like the 'Delete before upload' setting in the web settings panel?

DOH