Welcome to the Cumulus Support forum.

Latest Cumulus MX V4 release 4.4.2 (build 4085) - 12 March 2025

Latest Cumulus MX V3 release 3.28.6 (build 3283) - 21 March 2024

Legacy Cumulus 1 release 1.9.4 (build 1099) - 28 November 2014
(a patch is available for 1.9.4 build 1099 that extends the date range of drop-down menus to 2030)

Download the Software (Cumulus MX / Cumulus 1 and other related items) from the Wiki

If you are posting a new Topic about an error or if you need help PLEASE read this first viewtopic.php?p=164080#p164080

FTP / SFTP setups

Discussion and questions about Cumulus weather station software version 1. This section is the main place to get help with Cumulus 1 software developed by Steve Loft that ceased development in November 2014.
Post Reply
weatherhead
Posts: 1
Joined: Sat 31 Oct 2009 11:53 pm
Weather Station: WS2300

FTP / SFTP setups

Post by weatherhead »

Hey Everyone

I have recently move over to a new server which by default only used sftp. Since then I havent been able get cumuls to connect with the sftp or a constructed ftp on the server.

Are there are tips on the specific setup of this i.e. protocols (in the hostname should you put 'ftp.yoursite.com' or 'yoursite.com' or 'sftp.yoursite.com')?

Does SFTP work with cumulus?

I am getting connection timeouts:
FTPLOG
10:56:40:025 ! HighLevelAsync 0
10:56:40:025 ! HighLevelAsync done
10:56:40:029 ! HighLevelAsync 0
10:56:40:264 0260FCE0 TriggerDataSent 1096
10:56:40:504 >|SSH-2.0-OpenSSH_5.1p1 Debian-5ubuntu1|

Realtime FTPLOG
10:56:53:128 ! Aborting
10:56:53:129 ! HighLevelAsync 0
10:56:53:129 ! Abort detected
10:56:53:129 ! HighLevelAsync done
10:57:53:140 ! HighLevelAsync 0
10:57:53:141 TWSocket will connect to 69.164.199.59:22
10:57:53:374 02611210 TriggerDataSent 1192
10:57:53:614 >|SSH-2.0-OpenSSH_5.1p1 Debian-5ubuntu1|


I suspected something might have been awry with my credentials but can login fine with other FTP prpgrams..

Any ideas?

cheers
dann
User avatar
steve
Cumulus Author
Posts: 26672
Joined: Mon 02 Jun 2008 6:49 pm
Weather Station: None
Operating System: None
Location: Vienne, France
Contact:

Re: FTP / SFTP setups

Post by steve »

Cumulus doesn't support Secure FTP. It's possible that Cumulus 2 may do eventually, but I haven't looked into what would be required.

Edit: Are you saying that ftp doesn't work either? Is that what the log above is from? Unfortunately the ftp component's trace isn't always helpful in resolving problems. You could try turning on the debug log and see if Cumulus's own trace has anything useful.
Steve
species5618
Posts: 10
Joined: Mon 07 Dec 2009 8:15 pm
Weather Station: Maplin badged WH1081
Operating System: Windows 7 x86
Location: Glouceeter UK
Contact:

Re: FTP / SFTP setups

Post by species5618 »

have a look at http://winscp.net/eng/docs/script_upload_single_file

winSCP can be used to script SFTP
run it by hand once, to allow the SSH key, the it works on it's own

i have successfully used the following script

option batch abort
option confirm off
open User:pass@server
put "localpath\realtime.txt" /remotepath
exit

to update http://blog.species5618.net/bits/CumulusRealtime.html

still working on schedules and stuff, so not real time at the moment
:D
User avatar
daj
Posts: 2041
Joined: Tue 29 Jul 2008 8:00 pm
Weather Station: WH1081
Operating System: Pi & MX
Location: SW Scotland
Contact:

Re: FTP / SFTP setups

Post by daj »

Hi "species5618", and welcome to the forum

I'd be interested to see what solution you come up with for the scheduling element. I've been looking around at a variety of FTP tools to automate uploads, however none seem to have scheduling built in.

using the standard AT command in Windows is fine if you want a once per day, but anything more regularly is not possible so I need a better tool

Keep us updated please

thanks
David
kippfordweather.uk
Cumulus MX & Raspberry Pi
species5618
Posts: 10
Joined: Mon 07 Dec 2009 8:15 pm
Weather Station: Maplin badged WH1081
Operating System: Windows 7 x86
Location: Glouceeter UK
Contact:

Re: FTP / SFTP setups

Post by species5618 »

The advanced TAB in windows scheduler allows you to repeat a task more often, (every 5 mins for example), inside a once a day schedule

However i have some c# code which allows a simple scheduler to be created and controled by a ini/XML file,
however in Vista and Win7, it runs into issue around improved security, and access to files you want to action, so the service needs to run as a USER or file folder perms need to be amended
I may be able to produce something which monitors for file changes in a set of folders and then SFTPs using winscp
that way scheduling is driven by cumulus (updating files), not a asyncronous process

Time allowing, i may write it all up a bit better
User avatar
steve
Cumulus Author
Posts: 26672
Joined: Mon 02 Jun 2008 6:49 pm
Weather Station: None
Operating System: None
Location: Vienne, France
Contact:

Re: FTP / SFTP setups

Post by steve »

Would it help if there was an option in Cumulus to execute a command (batch file or whatever) after each upload? Where "upload" would include the case where no actual upload takes place, just the files are generated.
Steve
User avatar
daj
Posts: 2041
Joined: Tue 29 Jul 2008 8:00 pm
Weather Station: WH1081
Operating System: Pi & MX
Location: SW Scotland
Contact:

Re: FTP / SFTP setups

Post by daj »

species5618 wrote:The advanced TAB in windows scheduler allows you to repeat a task more often, (every 5 mins for example), inside a once a day schedule
Was not aware of that! I use the command line as I am old school :oops: Will check it out

steve wrote:Would it help if there was an option in Cumulus to execute a command (batch file or whatever) after each upload? Where "upload" would include the case where no actual upload takes place, just the files are generated.
Yes, would be great for me. I also want to upload my dayfile once per day, but I can handle that via windows scheduler
David
kippfordweather.uk
Cumulus MX & Raspberry Pi
species5618
Posts: 10
Joined: Mon 07 Dec 2009 8:15 pm
Weather Station: Maplin badged WH1081
Operating System: Windows 7 x86
Location: Glouceeter UK
Contact:

Re: FTP / SFTP setups

Post by species5618 »

steve wrote:Would it help if there was an option in Cumulus to execute a command (batch file or whatever) after each upload? Where "upload" would include the case where no actual upload takes place, just the files are generated.
oh yes, that would be a great solution,
Not just be limited to SFTP, but anything, push the data out via email, SMS, store in a DB, anything with an API
gemini06720
Posts: 1700
Joined: Mon 10 Aug 2009 10:16 pm
Weather Station: No weather station
Operating System: No operating system
Location: World...

Re: FTP / SFTP setups

Post by gemini06720 »

Steve...
...Would it help if there was an option in Cumulus to execute a command (batch file or whatever) after each upload? Where "upload" would include the case where no actual upload takes place, just the files are generated...
Indeed, that would be Grreeeaaaattttt... :P

David...
...I also want to upload my dayfile once per day, but I can handle that via windows scheduler...
Although I have not done/tried it with Windows scheduler, it should be possible for the scheduler to call a batch file (are you old enough to remember the word 'batch' :mrgreen: ) that would use Windows own FTP program... 8-)

As I mentioned in another message (re: Web camera), I have been (and I am still) using Take Command (a Windows 'cmd' replacement which offers a massive superset of 167 commands, 259 functions and 171 system variables) to upload (FTP) files to my Web server...
User avatar
daj
Posts: 2041
Joined: Tue 29 Jul 2008 8:00 pm
Weather Station: WH1081
Operating System: Pi & MX
Location: SW Scotland
Contact:

Re: FTP / SFTP setups

Post by daj »

gemini06720 wrote:David...

Although I have not done/tried it with Windows scheduler, it should be possible for the scheduler to call a batch file (are you old enough to remember the word 'batch' :mrgreen: ) that would use Windows own FTP program... 8-)
Sadly, I am old enough to do batch files. I'm 40 in a few weeks (did I just say that out loud, LOL)

I have written the batch file, and the script for the windows FTP command and it works well
David
kippfordweather.uk
Cumulus MX & Raspberry Pi
gemini06720
Posts: 1700
Joined: Mon 10 Aug 2009 10:16 pm
Weather Station: No weather station
Operating System: No operating system
Location: World...

Re: FTP / SFTP setups

Post by gemini06720 »

daj wrote:Sadly, I am old enough to do batch files. I'm 40 in a few weeks (did I just say that out loud, LOL)
Wow! That is old... :twisted:

You are almost ancient history ... well, not to me, you are still a young man in my eyes ... but again, my eyesight is not as good as it used to be ... darn, you are getting there... :D
daj wrote:I have written the batch file, and the script for the windows FTP command and it works well
I knew you could do it the easy way... Now, I am really proud of you... :mrgreen:
Post Reply