Welcome to the Cumulus Support forum.

Latest Cumulus MX V3 release 3.28.6 (build 3283) - 21 March 2024

Cumulus MX V4 beta test release 4.0.0 (build 4019) - 03 April 2024

Legacy Cumulus 1 release 1.9.4 (build 1099) - 28 November 2014
(a patch is available for 1.9.4 build 1099 that extends the date range of drop-down menus to 2030)

Download the Software (Cumulus MX / Cumulus 1 and other related items) from the Wiki

CMX crash and realtime retain failure

From build 3044 the development baton passed to Mark Crossley. Mark has been responsible for all the Builds since. He has made the code available on GitHub. It is Mark's hope that others will join in this development, but at the very least he welcomes your ideas for future developments (see Cumulus MX Development suggestions).

Moderator: mcrossley

User avatar
ConligWX
Posts: 1606
Joined: Mon 19 May 2014 10:45 pm
Weather Station: Davis vPro2+ w/DFARS + AirLink
Operating System: Ubuntu 22.04 LTS
Location: Bangor, NI
Contact:

Re: CMX crash and realtime retain failure

Post by ConligWX »

HansR wrote: Wed 07 Apr 2021 12:03 pm Yes it uses the same login as for CMX. CumulusUtils runs for a minute or so, CMX runs 24/7. So CMX is actually what I am focussing on.
I could give it a try but it would surprise me though.

I'm just wondering how the FTPS protocol allows multiple connections from two different programs from maybe the same source and at times they may login at the same time. I'm purely speculating as I dont use FTPS myself, but wondering how the crash is exactly happing.
Regards Simon

https://www.conligwx.org - @conligwx
Davis Vantage Pro2 Plus with Daytime FARS • WeatherLink Live • Davis AirLink • PurpleAir • CumulusMX v4.0.0

Image
User avatar
HansR
Posts: 5957
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: GW1100 (WS80/WH40)
Operating System: Raspberry OS/Bookworm
Location: Wagenborgen (NL)
Contact:

Re: CMX crash and realtime retain failure

Post by HansR »

A new FTP account does not resolve the issue.
Hans

https://meteo-wagenborgen.nl
CMX build 4017+ ● RPi 3B+ ● Raspbian Linux 6.1.21-v7+ armv7l ● dotnet 8.0.3
User avatar
HansR
Posts: 5957
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: GW1100 (WS80/WH40)
Operating System: Raspberry OS/Bookworm
Location: Wagenborgen (NL)
Contact:

Re: CMX crash and realtime retain failure

Post by HansR »

ConligWX wrote: Wed 07 Apr 2021 12:27 pm I'm just wondering how the FTPS protocol allows multiple connections from two different programs from maybe the same source and at times they may login at the same time. I'm purely speculating as I dont use FTPS myself, but wondering how the crash is exactly happing.
OK. I don't know but I do know that CMX is using different connections (under the same account) for the realtime upload and the other FTPs.
The crash I think is is more a result from earlier failure to connect (maybe in combi with the SQL failure). So I focus now on the FTP issue.
Hans

https://meteo-wagenborgen.nl
CMX build 4017+ ● RPi 3B+ ● Raspbian Linux 6.1.21-v7+ armv7l ● dotnet 8.0.3
freddie
Posts: 2471
Joined: Wed 08 Jun 2011 11:19 am
Weather Station: Davis Vantage Pro 2 + Ecowitt
Operating System: GNU/Linux Ubuntu 22.04 LXC
Location: Alcaston, Shropshire, UK
Contact:

Re: CMX crash and realtime retain failure

Post by freddie »

HansR wrote: Wed 07 Apr 2021 11:31 am @freddie: Yes, fine but this is something which suddenly failed. Both CMX as well as my CumulusUtils. So I asked them if they changed something. Nothing changed on my side and suddenly yesterday morning at 6h40 it started to fail. Then yesterday evening I restarted the whole thing with the new CMX version and everything worked like a shining sun until this morning when I tried something and it broke down again. Rebooted and reset everything two, three times and don't get it running again. SFTP is not an option at this moment.

I am not the evasive type, running around problems. If FTP(S) is offered as a service it needs to work and I need to understand.
Sudden failure is generally associated with a change somewhere. As you have control over your settings and have not changed anything then the change must have occurred at the other end or en route. Therefore I would contact the hosting company to see what has changed. Perhaps ask them to look in their server logs. Many of the hosting setups have an independent firewall between you and the firewall on your hosted resources.

I wouldn't see it (switching to SFTP) as running around a problem - more of a temporary solution to the immediate problem. I gave a good reason for permanent migration to SFTP, but of course that is up to you.
Freddie
Image
freddie
Posts: 2471
Joined: Wed 08 Jun 2011 11:19 am
Weather Station: Davis Vantage Pro 2 + Ecowitt
Operating System: GNU/Linux Ubuntu 22.04 LXC
Location: Alcaston, Shropshire, UK
Contact:

Re: CMX crash and realtime retain failure

Post by freddie »

ConligWX wrote: Wed 07 Apr 2021 12:27 pmI'm just wondering how the FTPS protocol allows multiple connections from two different programs from maybe the same source and at times they may login at the same time. I'm purely speculating as I dont use FTPS myself, but wondering how the crash is exactly happing.
The same way any server service does this (think about running multiple browsers looking at the same web page). Your software opens a local port to connect to the remote port. If it needs another connection then it will ask the operating system for another local port.

The only way this would become an issue is if the server (or firewall between you and the server) was configured to only accept a very limited number of connections from a single (external) IP address. Thank goodness that doesn't happen often in reality.
Freddie
Image
User avatar
HansR
Posts: 5957
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: GW1100 (WS80/WH40)
Operating System: Raspberry OS/Bookworm
Location: Wagenborgen (NL)
Contact:

Re: CMX crash and realtime retain failure

Post by HansR »

freddie wrote: Wed 07 Apr 2021 12:51 pm Sudden failure is generally associated with a change somewhere. As you have control over your settings and have not changed anything then the change must have occurred at the other end or en route. Therefore I would contact the hosting company to see what has changed.
I did and they point to the cable provider (Ziggo)
freddie wrote: Wed 07 Apr 2021 12:51 pm Perhaps ask them to look in their server logs. Many of the hosting setups have an independent firewall between you and the firewall on your hosted resources.
I did ask and (if they did) they said they did not change anything and have no problems.
freddie wrote: Wed 07 Apr 2021 12:51 pm I wouldn't see it (switching to SFTP) as running around a problem - more of a temporary solution to the immediate problem. I gave a good reason for permanent migration to SFTP, but of course that is up to you.
I did try that some time ago and did not get it started. I may try again but want to find the cause for this first.
And yes, I see it as walking around the hot issue. And yes its up to me how I handle it of course.
Hans

https://meteo-wagenborgen.nl
CMX build 4017+ ● RPi 3B+ ● Raspbian Linux 6.1.21-v7+ armv7l ● dotnet 8.0.3
User avatar
HansR
Posts: 5957
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: GW1100 (WS80/WH40)
Operating System: Raspberry OS/Bookworm
Location: Wagenborgen (NL)
Contact:

Re: CMX crash and realtime retain failure

Post by HansR »

Well, an update after some calls to providers and cable operators.

They claim it is because of a torn glass fibre cable close to Rotterdam.
They did not have a response to my question why the rest of my internet was still working, including WinSCP to that server.

But the ways of the Internet are wondrous so I believe everything.
Hans

https://meteo-wagenborgen.nl
CMX build 4017+ ● RPi 3B+ ● Raspbian Linux 6.1.21-v7+ armv7l ● dotnet 8.0.3
User avatar
ConligWX
Posts: 1606
Joined: Mon 19 May 2014 10:45 pm
Weather Station: Davis vPro2+ w/DFARS + AirLink
Operating System: Ubuntu 22.04 LTS
Location: Bangor, NI
Contact:

Re: CMX crash and realtime retain failure

Post by ConligWX »

HansR wrote: Wed 07 Apr 2021 2:48 pm Well, an update after some calls to providers and cable operators.

They claim it is because of a torn glass fibre cable close to Rotterdam.
They did not have a response to my question why the rest of my internet was still working, including WinSCP to that server.

But the ways of the Internet are wondrous so I believe everything.
Blame it on Brexit ,Covid, or AstraZeneca. you'll feel better now :lol:
Regards Simon

https://www.conligwx.org - @conligwx
Davis Vantage Pro2 Plus with Daytime FARS • WeatherLink Live • Davis AirLink • PurpleAir • CumulusMX v4.0.0

Image
User avatar
HansR
Posts: 5957
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: GW1100 (WS80/WH40)
Operating System: Raspberry OS/Bookworm
Location: Wagenborgen (NL)
Contact:

Re: CMX crash and realtime retain failure

Post by HansR »

:lol:
Hans

https://meteo-wagenborgen.nl
CMX build 4017+ ● RPi 3B+ ● Raspbian Linux 6.1.21-v7+ armv7l ● dotnet 8.0.3
User avatar
HansR
Posts: 5957
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: GW1100 (WS80/WH40)
Operating System: Raspberry OS/Bookworm
Location: Wagenborgen (NL)
Contact:

Re: CMX crash and realtime retain failure

Post by HansR »

So how do I generate a keypair for SSH.
I tried using MobaXterm and PuTTYgen. The resulting keys (RSA or SSH-1, no password) produce invalid key from CMX.
No Wiki on this subject.
Does it have to be a psk file? or is ppk also allowed (I assume yes)
Hans

https://meteo-wagenborgen.nl
CMX build 4017+ ● RPi 3B+ ● Raspbian Linux 6.1.21-v7+ armv7l ● dotnet 8.0.3
freddie
Posts: 2471
Joined: Wed 08 Jun 2011 11:19 am
Weather Station: Davis Vantage Pro 2 + Ecowitt
Operating System: GNU/Linux Ubuntu 22.04 LXC
Location: Alcaston, Shropshire, UK
Contact:

Re: CMX crash and realtime retain failure

Post by freddie »

Openssl
Freddie
Image
User avatar
HansR
Posts: 5957
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: GW1100 (WS80/WH40)
Operating System: Raspberry OS/Bookworm
Location: Wagenborgen (NL)
Contact:

Re: CMX crash and realtime retain failure

Post by HansR »

Just as an update and closure of this thread: apparently the cable fracture has been fixed and indeed the FTP works again.
Who would have thought this to be the cause. I didn't. But is was.

That was a major malfunction on FTP (more than 24hrs) while everything else on the internet worked perfectly. :groan:
Hans

https://meteo-wagenborgen.nl
CMX build 4017+ ● RPi 3B+ ● Raspbian Linux 6.1.21-v7+ armv7l ● dotnet 8.0.3
User avatar
ConligWX
Posts: 1606
Joined: Mon 19 May 2014 10:45 pm
Weather Station: Davis vPro2+ w/DFARS + AirLink
Operating System: Ubuntu 22.04 LTS
Location: Bangor, NI
Contact:

Re: CMX crash and realtime retain failure

Post by ConligWX »

I told you to blame it on something else! :lol: :lol:
Regards Simon

https://www.conligwx.org - @conligwx
Davis Vantage Pro2 Plus with Daytime FARS • WeatherLink Live • Davis AirLink • PurpleAir • CumulusMX v4.0.0

Image
User avatar
HansR
Posts: 5957
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: GW1100 (WS80/WH40)
Operating System: Raspberry OS/Bookworm
Location: Wagenborgen (NL)
Contact:

Re: CMX crash and realtime retain failure

Post by HansR »

Well it wasn't. Again not functioning :roll:
Anyway, I quit explaining and reporting...
Hans

https://meteo-wagenborgen.nl
CMX build 4017+ ● RPi 3B+ ● Raspbian Linux 6.1.21-v7+ armv7l ● dotnet 8.0.3
User avatar
mcrossley
Posts: 12756
Joined: Thu 07 Jan 2010 9:44 pm
Weather Station: Davis VP2/WLL
Operating System: Bullseye Lite rPi
Location: Wilmslow, Cheshire, UK
Contact:

Re: CMX crash and realtime retain failure

Post by mcrossley »

HansR wrote: Wed 07 Apr 2021 6:30 pm Well it wasn't. Again not functioning :roll:
Anyway, I quit explaining and reporting...
Hi Hans, that last post leaves me a bit confused - has the issue been resolved for you?
Post Reply