Page 1 of 1

May have to shut down website.

Posted: Wed 27 Apr 2022 6:16 am
by BeaumarisWX
So after retiring and moving up to the North East Coast Tasmania, I have been busy with the new house and setting up the new weather site for the last 3 years.
However when finally getting to a stage where I was nearly content with the site, my Host IP Netvirtue decide to sell and be taken over by Ventraip and overnight they they have migrated my site to new servers which are rather ftp strict to the point my numerous uploads are near on impossible to maintain or even upload.

They state:
The authentication issues you are getting (Sorry, cleartext sessions and weak ciphers are not accepted on this server) are due to TLS 1.2 enforcement on the server.

You will only be able to connect securely. Depending on which FTP client you are using follow the below guide to ensure you are connecting securely:

Connecting securely (TLS) to FileZilla
https://ventraip.com.au/faq/article/con ... filezilla/

Connecting securely via FTP using Cyberduck
https://ventraip.com.au/faq/article/con ... cyberduck/

Connecting with CuteFTP using TLS 1.2
https://ventraip.com.au/faq/article/con ... g-tls-1-2/

If your application is TLS 1.2 compliant you may need to select the connection type as either "FTP-TLS", "FTPS", "FTPS with TLS/SSL (AUTH TLS – Explicit)" OR "Require explicit FTP over TLS".
I have struggled to get bits of CumulusMX uploading again, only realtime but not 5 min updates which is strange. Can't even get my old text based bat files to upload local data or get ipTimelapse to upload either.

So I am thinking it may be time to go down the road of which my back has and call it a day.

Re: May have to shut down website.

Posted: Wed 27 Apr 2022 6:36 am
by HansR
Well, that would be a waste of such a beautiful site.

Surely there are issues with unprotected FTP and my provider is also pretty strict in the sense that I had to abandon FTP and FTPS. It seems to become a professional standard to move away from classic FTP. The TLS 1.2 issues with CMX mostly can be retraced to session reuse which seems not to be implemented (correctly?) in the library used.

But the use of SFTP with a key works fine and if a provider does not have SFTP but forbids you to use FTP or FTPS I think it is time to change, not to have your life ruled by some provider. It now has been my advise for more than a year that in case of FTP problems, change to SFTP. But check with your provider first if they provide it.

[EDIT:] btw: I see the site working fine, don't see an issue

Re: May have to shut down website.

Posted: Wed 27 Apr 2022 11:32 pm
by apple8
I am in a similar situation after the VentraIP migration overnight. No data being uploaded and unable to access the site with Safari on the iMac or iPad/iPhone even after their solution to clear caches. Clearing cache worked on a PC for Edge and Chrome but that is not much help if there is no updates. Can’t access with FileZilla either. Just when everything was ticking over nicely too.

Edit. Sorted the website page access by changing the DNS on the devices and FileZilla in the management console. I suspect the answer for the data not uploading will be the FTP in Cumulus1 not using FTP with TLS?

So now, will it be easier to upgrade to MX or use WINSCP

Re: May have to shut down website.

Posted: Fri 29 Apr 2022 8:45 am
by ConligWX
HansR wrote: Wed 27 Apr 2022 6:36 am [EDIT:] btw: I see the site working fine, don't see an issue
yep same here all good here.

BeaumarisWX wrote: Wed 27 Apr 2022 6:16 am So after retiring and moving up to the North East Coast Tasmania, I have been busy with the new house and setting up the new weather site for the last 3 years.
maybe the DNS propagation was still taking place and you may see some issues within a 24-48hr time frame but all 4 templates seem to be working from the UK fine.

Re: May have to shut down website.

Posted: Fri 29 Apr 2022 11:55 pm
by BeaumarisWX
Hi, Thanks for comments.
WoW what a nightmare, this migration commenced at 23:20 on the 26th Apr 22 and has taken me nearly 3 days to get it all uploading again (in a fashion).

CumulusMX (latest version) : see image below : I had to change the FTP Protocol to FTPS (port 990) nothing else worked.

Image

MySql updates, but if I edit say a monthly / Daily entry it does not update the host DB, as it used to.

In addition : although Realtime files upload, anything set to Normal Interval (say 5 mins) does not upload.
That includes chart .json files any FTP only (not realtime) files selected to upload in extra webfiles. The only way they will upload is if I select them to upload realtime (which is overkill) and I can not understand why.
I even had to add all chart .json file to extra webfiles at realtime in order to upload them, any midnight rollover files like daily monthly/reports etc do not get uploaded after midnight, again why I do not know. I am currently having to upload via .bat file scripts I had to write and schedule via windows scheduler, even fling will not work anymore.

And Simon it is now the 30th here and nothing has changed in that just now I changed some extra webfile uploads from realtime to normal ftp and they stopped uploading still. So way past being a server propagation time issue.

If you can imagine with my site the wxsim data and my fwi.calc data etc. etc. all have had to be descripted to new .bat files and scheduled.

Been fun nd games, totally unsure as to why cumulusMX is not uploading other than realtime only ?

Attached Logs from over night :
20220429-155000.zip
ftplog2.zip
Kindest Regards,

Re: May have to shut down website.

Posted: Sat 30 Apr 2022 10:21 pm
by mcrossley
There is so much going on with FTP that it is hard to see exactly what is happening.

However from the log snippet, it seems you have a real-time upload interval of 30 seconds? But the number of files involved is taking 34 seconds so your real-time FTPs are overlapping.


You also seem to be uploading all the files to two locations? e.g.

/public_html/data/realtime.txt
/public_html/realtime.txt

It would be more efficient to upload them once, and refer to that one location from different pages?

Every attempt by the interval FTP to connect fails with a timeout. It may be that your ISP only allows one FTP session to be connected, or there is something in the FTP component when using FTPS that only allows one active connection at a time and your real-time is always active with the overlapping intervals.

Could you try paring it back to something simple, like just having a couple of real-time files, then seeing if you can upload some interval files?

Re: May have to shut down website.

Posted: Sun 01 May 2022 9:19 pm
by BeaumarisWX
Hi Mark,
Sorry late reply, Gordon on another thread sent me a fix viewtopic.php?p=163418#p163418 changed host name to pure ip address and FTP Protocol to use 1 and port to 21.
All updating again even Normal 5 min updates and Charts .json files and midnight rollovers etc. etc.
Mark, yes was aware of dupe realtime uploads, they where from legacy templates and testing various scripts, all tidied up now.
Kindest Regards,

Re: May have to shut down website.

Posted: Sun 01 May 2022 9:42 pm
by Mapantz
Catching up with the posts on here... I was worried that you were going to shut up shop on your website, Tony :shock:

Glad you've got it all sorted and you're back in business!

Re: May have to shut down website.

Posted: Mon 02 May 2022 5:26 am
by BeaumarisWX
Mapantz wrote: Sun 01 May 2022 9:42 pm Catching up with the posts on here... I was worried that you were going to shut up shop on your website, Tony :shock:

Glad you've got it all sorted and you're back in business!
Hi matey, Thanks.
Yes must admit I came close especially after not much sleep in the first 48hrs while trying to get at least something updated.
Still ironing out some bits and bobs but looks a lot more stable for now.
Kindest Regards,