Page 1 of 1

realtime data will not upload - maybe bug or maybe not

Posted: Thu 10 Jul 2014 9:29 am
by ace2
I've had this issue before and always thought it was the PC related, but now moved to a new setup and its done it again.
This only happens every few months or so, basically I have 3 realtime files that get uploaded every 10 seconds(realtime). What happening is one will not upload at all, the 'name'.txttmp file is present in the web folder with correct updated data, but will not upload. I have tried everything from removing whole entry in cumulus, restarted cumulus, setting it in binary mode and selecting rename.
The only way to fix it, is this :
Now here is weird part, on my web site, the file is 0 bytes, if I delete that file it'll start working again!

So is it a bug with cumulus of a ISP ftp issue????

Re: realtime data will not upload - maybe bug or maybe not

Posted: Thu 10 Jul 2014 9:35 am
by steve
What does the ftp log show?

Re: realtime data will not upload - maybe bug or maybe not

Posted: Thu 10 Jul 2014 3:18 pm
by ace2
The realtimeftp log shows an abort
  • 16:36:21:403 ! HighLevelAsync 0
    16:36:21:403 04B89650 Socket handle created 1172
    16:36:21:404 TWSocket will connect to 203.16.214.120:58568
    16:36:21:428 ! Data Session opened (Put)
    16:36:21:429 04B89650 TriggerDataSent 1172
    16:36:21:429 04B88E90 TriggerDataSent 1032
    16:36:36:376 ! Aborting
    16:36:36:377 ! HighLevelAsync 0
    16:36:36:377 ! Abort detected
    16:36:36:377 ! HighLevelAsync done
    16:36:36:377 04B89650 TCustomWSocket.Shutdown 1 1172
    16:36:36:378 ! Data Session closed
    16:36:36:378 ! Next3PutAsync
    16:36:36:379 Putting done
    16:36:36:379 ===End of upload of realtime.txt

Re: realtime data will not upload - maybe bug or maybe not

Posted: Thu 10 Jul 2014 3:50 pm
by steve
It's aborting because of a timeout - it's had no response from the server for 15 seconds, while trying to upload the realtime.txt file.

Re: realtime data will not upload - maybe bug or maybe not

Posted: Thu 10 Jul 2014 5:57 pm
by duke
Could this because of the rather short, 10 second realtime upload?

Re: realtime data will not upload - maybe bug or maybe not

Posted: Thu 10 Jul 2014 6:11 pm
by steve
It shouldn't cause any problems; I use a 10 second interval and don't have any problems. If the connection can't actually upload the files in the selected interval, then what you see is the uploads actually occurring at longer intervals, as the next 'slot' gets missed.

It does seem a bit pointless uploading at 10 second intervals when the station only updates every 48 seconds, though.

Re: realtime data will not upload - maybe bug or maybe not

Posted: Thu 10 Jul 2014 10:43 pm
by ace2
Used to be 30 seconds with the same problem, I now do 10 seconds due to using cumulus to process a weather overlay file and a sunrise/sunset timing file.
Strange that everything else gets uploaded without issues.

Re: realtime data will not upload - maybe bug or maybe not

Posted: Fri 11 Jul 2014 7:15 am
by steve
Perhaps occasionally the problem file contains something that the server doesn't like, so a failure occurs and a 'lock' is left, so it won't then accept any more uploads of that file. That's just wild speculation, I have no idea whether such a thing could happen (the 'stale lock' part is not speculation, I've seen that happen with some servers), and it's hard to say anything useful without seeing what the ftp log says for the actual file that has the problem at the time the problem occurs. Even seeing the ftp log at the appropriate time may still not pinpoint the problem, if it turns out (as I suspect it will) to be a server problem.

Re: realtime data will not upload - maybe bug or maybe not

Posted: Sat 12 Jul 2014 2:24 am
by ace2
I kind of thought that Steve...
I just have to put up with it i guess..
I have a kind of work around, to manually upload those files with the my other scripts every X minutes which over writes them even if they are 0 bytes in size.

It's just Cumulus's FTP that can't write over them, as NCFTP, Filezila and FTP(android) don't seem to have a problem at all do it...

Re: realtime data will not upload - maybe bug or maybe not

Posted: Sat 12 Jul 2014 5:48 am
by Super-T
I get the same intermittent problem with my webcam upload. 0 bytes, delete the file and all is OK again.

Re: realtime data will not upload - maybe bug or maybe not

Posted: Sat 12 Jul 2014 6:41 am
by ace2
Maybe something could be put into cumulus to delete the file on server before uploading????

Re: realtime data will not upload - maybe bug or maybe not

Posted: Sat 12 Jul 2014 7:49 am
by steve
ace2 wrote:Maybe something could be put into cumulus to delete the file on server before uploading????
Like the 'Delete before upload' setting in the web settings panel?

Re: realtime data will not upload - maybe bug or maybe not

Posted: Sat 12 Jul 2014 8:23 am
by water01
steve wrote:
ace2 wrote:Maybe something could be put into cumulus to delete the file on server before uploading????
Like the 'Delete before upload' setting in the web settings panel?
:lol: :lol: :lol: :lol: :lol: :lol: :lol: :lol: :lol:

Re: realtime data will not upload - maybe bug or maybe not

Posted: Sat 12 Jul 2014 11:39 am
by ace2
steve wrote:Like the 'Delete before upload' setting in the web settings panel?

DOH :groan: