Welcome to the Cumulus Support forum.

Latest Cumulus MX V4 release 4.4.2 (build 4085) - 12 March 2025

Latest Cumulus MX V3 release 3.28.6 (build 3283) - 21 March 2024

Legacy Cumulus 1 release 1.9.4 (build 1099) - 28 November 2014
(a patch is available for 1.9.4 build 1099 that extends the date range of drop-down menus to 2030)

Download the Software (Cumulus MX / Cumulus 1 and other related items) from the Wiki

If you are posting a new Topic about an error or if you need help PLEASE read this first viewtopic.php?p=164080#p164080

PWSWeather daily precipitation

Discussion and questions about Cumulus weather station software version 1. This section is the main place to get help with Cumulus 1 software developed by Steve Loft that ceased development in November 2014.
User avatar
steve
Cumulus Author
Posts: 26672
Joined: Mon 02 Jun 2008 6:49 pm
Weather Station: None
Operating System: None
Location: Vienne, France
Contact:

Re: PWSWeather daily precipitation

Post by steve »

gluepack wrote:I have administrator privileges which I would have thought overcame any obstacle, unless you know something about "administration" that I don't and I'm sure you do.
There's a difference between a user with administrator privilege and 'run as administrator'. But it's probably not relevant anyway as you shouldn't need it given where you have your files.

I think your problem with the web tags file is because you have ftp configured, and ftp doesn't work for you - you presumably need secure ftp?

If I take your settings, but untick 'Enable Realtime FTP' and 'Realtime.txt FTP', and untick 'FTP?' on the file (so the settings match what I posted earlier), then the cumuluswebtags.txttmp file gets updated every 60 seconds.
2013-04-08 17_48_46-Internet Settings.png
2013-04-08 17_49_31-Internet Settings.png
You do not have the required permissions to view the files attached to this post.
Steve
User avatar
gluepack
Posts: 460
Joined: Tue 22 Jan 2013 9:20 pm
Weather Station: PCE-FWS 20
Operating System: Win 7 Pro
Location: Zlatina, Bulgaria

Re: PWSWeather daily precipitation

Post by gluepack »

If I take your settings, but untick 'Enable Realtime FTP' and 'Realtime.txt FTP', and untick 'FTP?' on the file, then the cumuluswebtags.txttmp file gets updated every 60 seconds.
Hey Presto!
(so the settings match what I posted earlier)
mea culpa, but then who would have thought it? It obviously hasn't been attempting to FTP, let alone doing it.
and ftp doesn't work for you - you presumably need secure ftp?
Lol, perhaps that would have been a better answer to my post...
Well, I give up. I'll use my own FTP to send files to my website as, although I have no problem doing that, I cannot get Cumulus to do it, despite the fact that it transfers files to other services fine.
;)

...but thanks anyway for resolving it.
Image

PWS links: WundergroundIVARNAPR3CWOP/APRSE(W)2048PWSWeatherZLATINABGAwekas10631Twitter@Zlatina_weather
Station type: PCE-FWS 20…Webcam link: View south to edge of Provadisko plateau
User avatar
steve
Cumulus Author
Posts: 26672
Joined: Mon 02 Jun 2008 6:49 pm
Weather Station: None
Operating System: None
Location: Vienne, France
Contact:

Re: PWSWeather daily precipitation

Post by steve »

gluepack wrote:Lol, perhaps that would have been a better answer to my post...
How could I possibly have known from what little you posted then that you needed secure FTP? I only got a clue today from looking for your data on your web site, where you mention SFTP.
Steve
User avatar
gluepack
Posts: 460
Joined: Tue 22 Jan 2013 9:20 pm
Weather Station: PCE-FWS 20
Operating System: Win 7 Pro
Location: Zlatina, Bulgaria

Re: PWSWeather daily precipitation

Post by gluepack »

Well, now, do I continue to post here or start another thread :) Oh. I'll post here....

OK, so now I have found the Wiki for SFTP ……
SFTP
Many ISPs now only support Secure FTP due to the open, unsecure nature of standard FTP.
As Cumulus does not currently support Secure FTP an external application must be used
WINSCP can be used
…which I had already found as being one of the few out there (well, free ones, that is) that support SFTP and cater for automated file updates.
Looking at http://winscp.net/eng/docs/script_upload_single_file, winSCP can be used to script SFTP
You have to run it by hand once, to allow the SSH key to be trusted, then it works on its own
I had actually been using the dialogue which kept crashing randomly and the guy who wrote it has still been unable to determine why, despite me using four alternative debug versions and providing horrendous size logs.

I also used the bat/script approach using the “keepuptodate” command with a "filemask", (because I didn’t realise at the time that there was a single file command) which, unfortunately, synchs the whole directory and sub-directories first time, despite the fact that it shouldn’t. That hasn't been resolved either.

So then I discovered AutoVer and have been using that. It is a great little program and does all that I need. However, that crashes occasionally too. Worse, if it only is unable to connect for some reason it stops and doesn't retry.

So, now I have basically gone full circle and am trying to SFTP from Cumulus by invoking WinSCP. All I want to do is transmit the realtime.txt file (oh, and just create the Toolbox php file, not transmit it, so that I can get an email when sensor contact is lost).
The following script works well
option batch abort
option confirm off
open User:pass@server
put "localpath\realtime.txt" /remotepath
exit

 change User:pass@server to your username, password and server name combination
 change localpath\realtime.txt to the local path on your PC
 change /remotepath to the remote path on the web server (as seen when you SFTP to the web site)
Save the commands in a text file, let's use the filename "C:\Cumulus\sftp-cmds.txt" as an example.
Well, my WinSCP is in its own sub-directory off the c: drive so I set something up like this in upreally.txt in the WinSCP folder…

# Automatically abort script on errors
option batch abort
# Disable overwrite confirmations that conflict with the previous
option confirm off
# Connect using a password
open sftp://userid:password@ftp4.bravehost.com
# Change remote directory
cd /
# Change local directory
lcd c:\cumulus
# put file
put realtime.txt
# Exit WinSCP
Exit

And then…
Now create a batch file with the following contents:
winscp.com /script=c:\cumulus\sftp-cmds.txt
Save this batch file, let's use the file name "C:\cumulus\sftp.bat" as an example.
I created one called upreally.bat that looks like this…

echo off
winscp.com /script=c:\WinSCP\upreally.txt
After creating the batch file, configure Cumulus to call it at each web update interval (using the 'external program' settings on the Internet Settings screen). For this example, the external program would be set to "c:\cumulus\sftp.bat".
If you don't supply an ftp host name to Cumulus, it will create the updated web files locally but not attempt to ftp them itself.
So… as my bat and script files work from the command prompt, when I am in the WinSCP folder, I attempted the above.

However, it is a bit unclear…

First…. There are three “external program” settings. Which one do I use?

I tried each of the first two, using c:\WinSCP\upreally.bat and neither of them caused the realtime.txt file to be (S)FTP’d.

Second.. “ If you don't supply an ftp host name to Cumulus”… supplying it still didn’t cause the realtime.txt file to be (S)FTP’d


Am I missing something? Are there any other settings?
Image

PWS links: WundergroundIVARNAPR3CWOP/APRSE(W)2048PWSWeatherZLATINABGAwekas10631Twitter@Zlatina_weather
Station type: PCE-FWS 20…Webcam link: View south to edge of Provadisko plateau
User avatar
steve
Cumulus Author
Posts: 26672
Joined: Mon 02 Jun 2008 6:49 pm
Weather Station: None
Operating System: None
Location: Vienne, France
Contact:

Re: PWSWeather daily precipitation

Post by steve »

gluepack wrote:First…. There are three “external program” settings. Which one do I use?
It depends on how often you want the command to be executed. The first one is executed at the 'normal' update interval, and you need 'auto update' selected for that. The second one is executed at the 'realtime' interval, and you need 'enable realtime' selected for that. The third one is executed just after midnight, and again needs 'auto update' selected.
Second.. “ If you don't supply an ftp host name to Cumulus”… supplying it still didn’t cause the realtime.txt file to be (S)FTP’d
If you are not using Cumulus FTP (and you are not) you shouldn't supply any settings which would make it attempt an ftp connection/upload, i.e. don't supply a host name and don't tick either of the realtime FTP settings.

I'm afraid I know nothing about WinSCP. Hopefully someone who is using it will be able to offer assistance. I think you first need to establish whether Cumulus is actually executing the command; there's currently no debugging information that you could turn in Cumulus, so you would need to add something to your batch file and/or turn on debugging/tracing in WinSCP. If Cumulus gets an error back from Windows when trying to execute the command, it does log an error message to the current diags file.
Steve
User avatar
gluepack
Posts: 460
Joined: Tue 22 Jan 2013 9:20 pm
Weather Station: PCE-FWS 20
Operating System: Win 7 Pro
Location: Zlatina, Bulgaria

Re: PWSWeather daily precipitation

Post by gluepack »

Well, easy enough to see whether Cumulus was executing it. Changing the filetype of the bat file in the folder to xxx caused an error to be logged in the diags file "The system cannot find the file specified". Lol, although that doesn't necessarily mean that it is executing it even if it does find it.

I'll try and do some analysis on what is happening with WinSCP.

btw, I get a "FTP details are not configured within Cumulus message" in my Toolbox log following "Checking Rules" every time. Do you know if that is just a warning and "Checking Rules" is actually still checking for my lost sensor contact or is it failing?
Image

PWS links: WundergroundIVARNAPR3CWOP/APRSE(W)2048PWSWeatherZLATINABGAwekas10631Twitter@Zlatina_weather
Station type: PCE-FWS 20…Webcam link: View south to edge of Provadisko plateau
User avatar
steve
Cumulus Author
Posts: 26672
Joined: Mon 02 Jun 2008 6:49 pm
Weather Station: None
Operating System: None
Location: Vienne, France
Contact:

Re: PWSWeather daily precipitation

Post by steve »

gluepack wrote:Well, easy enough to see whether Cumulus was executing it. Changing the filetype of the bat file in the folder to xxx caused an error to be logged in the diags file "The system cannot find the file specified". Lol, although that doesn't necessarily mean that it is executing it even if it does find it.
It means it was calling Windows to execute it; the error message is from Windows, Cumulus doesn't actually check whether the file exists.
btw, I get a "FTP details are not configured within Cumulus message" in my Toolbox log following "Checking Rules" every time. Do you know if that is just a warning and "Checking Rules" is actually still checking for my lost sensor contact or is it failing?
I know as little about Toolbox as I do about WinSCP, but I did a quick test and it still did the check and notified me of the condition.
Steve
User avatar
gluepack
Posts: 460
Joined: Tue 22 Jan 2013 9:20 pm
Weather Station: PCE-FWS 20
Operating System: Win 7 Pro
Location: Zlatina, Bulgaria

Re: PWSWeather daily precipitation

Post by gluepack »

Oh well, me again. It is pretty obvious on reflection.

I discovered it by "echo"ing to a file and finding that it created it in the cumulus folder as opposed to the winscp folder.

I guess I was thinking that invoking the bat file from the winscp folder caused the current directory to change to there but of course not. Adding the full path in the bat file to the winscp invocation resolved the problem.

I guess you get no error condition, if the program invoked within the bat file doesn't exist (in the then current directory).

Mea Culpa is beginning to sound like my middle names.

Although..... your Wiki assumes WinSCP is in your cumulus folder and I'm not going to comment on how likely I think that would be.
Image

PWS links: WundergroundIVARNAPR3CWOP/APRSE(W)2048PWSWeatherZLATINABGAwekas10631Twitter@Zlatina_weather
Station type: PCE-FWS 20…Webcam link: View south to edge of Provadisko plateau
User avatar
steve
Cumulus Author
Posts: 26672
Joined: Mon 02 Jun 2008 6:49 pm
Weather Station: None
Operating System: None
Location: Vienne, France
Contact:

Re: PWSWeather daily precipitation

Post by steve »

gluepack wrote:Although..... your Wiki assumes WinSCP is in your cumulus folder and I'm not going to comment on how likely I think that would be.
Doesn't it just assume that WinSCP is on the search path? It's apparently an option on the installation, but not selected by default. The WinSCP installation instructions on their web site say it's useful to select that option if you are using scripting mode.
Steve
User avatar
gluepack
Posts: 460
Joined: Tue 22 Jan 2013 9:20 pm
Weather Station: PCE-FWS 20
Operating System: Win 7 Pro
Location: Zlatina, Bulgaria

Re: PWSWeather daily precipitation

Post by gluepack »

Yeah, of course you're right, but
a) you may not think of that, if you are installing it for other purposes originally, not just for use with Cumulus,
b) they seem to check everything else, by default, why not something that (appears to be that) significant and
c) I'm 66 and despite 34 years in IT, to the millenium, it's been 13 years since I really cared about the content of a bat file let alone the significance of something like %PATH%.
Things should be easy now, like built-in SFTP. When I was searching the forum, I seem to remember thread(s) from 2009 discussing it, (perhaps even 2008), but then you're having to answer my questions ;)
Thanks for helping resolve it, anyway. At least now I don't have to worry about anything other than Cumulus coming up, if I lose power, which is too common in this godforsaken country. Oh, except Toolbox I guess. Now, if only that alarm would sound.
Image

PWS links: WundergroundIVARNAPR3CWOP/APRSE(W)2048PWSWeatherZLATINABGAwekas10631Twitter@Zlatina_weather
Station type: PCE-FWS 20…Webcam link: View south to edge of Provadisko plateau
User avatar
steve
Cumulus Author
Posts: 26672
Joined: Mon 02 Jun 2008 6:49 pm
Weather Station: None
Operating System: None
Location: Vienne, France
Contact:

Re: PWSWeather daily precipitation

Post by steve »

gluepack wrote:Things should be easy now, like built-in SFTP.
The package I use for FTP supports FTPS (FTP over SSL/TLS) but not SFTP (SSH FTP). The support for FTPS is done using a separate component to the FTP component within the package, so implementing it would require duplicating lots of the existing code. So it's possible but tedious and time-consuming.

To support SFTP I will have to buy another package, and then write the code for it (requiring even more code to be written than is required for FTPS).

It will probably happen one day, but not soon.
Steve
User avatar
gluepack
Posts: 460
Joined: Tue 22 Jan 2013 9:20 pm
Weather Station: PCE-FWS 20
Operating System: Win 7 Pro
Location: Zlatina, Bulgaria

Re: PWSWeather daily precipitation

Post by gluepack »

I know as little about Toolbox as I do about WinSCP, but I did a quick test and it still did the check and notified me of the condition.
Well, seven days without "lost sensor contact" (or, at least since my post about it) and, a short time ago, Toolbox worked!!!!
I got an email.
However, this was after I had already discovered that it had happened and, fortunately, it was only a one-off (Cumulus continued) which appeared to occur as I was switching session from my partner's to the one I run Cumulus under (oh, and doing an Adobe update).

At least I know that it works now, thanks.
Image

PWS links: WundergroundIVARNAPR3CWOP/APRSE(W)2048PWSWeatherZLATINABGAwekas10631Twitter@Zlatina_weather
Station type: PCE-FWS 20…Webcam link: View south to edge of Provadisko plateau
User avatar
steve
Cumulus Author
Posts: 26672
Joined: Mon 02 Jun 2008 6:49 pm
Weather Station: None
Operating System: None
Location: Vienne, France
Contact:

Re: PWSWeather daily precipitation

Post by steve »

gluepack wrote:which appeared to occur as I was switching session from my partner's to the one I run Cumulus under (oh, and doing an Adobe update).
That's presumably a coincidence, as nothing you do on the PC should affect communication between the transmitter and the console. But who knows? These devices are temperamental...
Steve
User avatar
gluepack
Posts: 460
Joined: Tue 22 Jan 2013 9:20 pm
Weather Station: PCE-FWS 20
Operating System: Win 7 Pro
Location: Zlatina, Bulgaria

Re: PWSWeather daily precipitation

Post by gluepack »

Well, lol, I knew I should have added that, although it is relatively rare, given the number of times that I have to switch from her userid to mine when I want to access the system (you try telling her to lock, disconnect or logoff when she leaves the system), it has happened several times over the life of Cumulus (about 80 days now), when going through that process of switching, that Cumulus throws up some sort of error and, typically, it is "lost sensor contact". The good thing is that I am accessing the system at the time so I see the error and can check it and clear it.
Image

PWS links: WundergroundIVARNAPR3CWOP/APRSE(W)2048PWSWeatherZLATINABGAwekas10631Twitter@Zlatina_weather
Station type: PCE-FWS 20…Webcam link: View south to edge of Provadisko plateau
User avatar
gluepack
Posts: 460
Joined: Tue 22 Jan 2013 9:20 pm
Weather Station: PCE-FWS 20
Operating System: Win 7 Pro
Location: Zlatina, Bulgaria

Re: PWSWeather daily precipitation

Post by gluepack »

Well, spoke too soon. Three days later and I get "lost sensor contact" and no email.

If I hadn't stayed up until 3 am to watch the Boston bomber capture, I might have got up early enough to check the system. On the other hand, if I had stayed up later, I might have noticed before I went to bed.

5.15 am and Cumulus started reporting "lost sensor contact" but Toolbox didn't notify me (I wouldn't have got the email anyway until I got up and noticed the error) and I can see why as the tag is set to 0, i.e. Cumulus doesn't appear to be setting it despite the error.

So, I lost five hours of data but the annoying thing is that you don't appear to be able to restart Cumulus (or, rather, use it) once this occurs until you have actually reset the device, losing data. If you exit Cumulus (having, in theory, cleared the display of the error condition. Of course, you can't because it just recreates it again) and restart it Cumulus just continues to display the flashing red indicator and you are unable to access anything within the dialogue (Win error alarm sounds wherever you click).
Image

PWS links: WundergroundIVARNAPR3CWOP/APRSE(W)2048PWSWeatherZLATINABGAwekas10631Twitter@Zlatina_weather
Station type: PCE-FWS 20…Webcam link: View south to edge of Provadisko plateau
Post Reply