Page 1 of 1
Scheduled uploads for extra web files
Posted: Mon 28 Nov 2022 11:27 am
by broadstairs
As part of my move to being able to use CMX I would like to be able to upload extra web files at certain times rather than the current method which uploads at every FTP interval. Some of my files are not updated more than between 1 and 4 times per day and one or two are quite large so uploading every minute waste bandwidth and adds to the overhead in FTP processing.
Is this a possible addition to CMX either to the existing settings or a new one for these types of file?
Stuart
Re: Scheduled uploads for extra web files
Posted: Mon 28 Nov 2022 12:02 pm
by HansR
Is your FTP interval one (1) minute?
Because that is what you say if I read you well.
Re: Scheduled uploads for extra web files
Posted: Mon 28 Nov 2022 12:37 pm
by water01
For the ones that need to be uploaded only once you could use the "end of Day" setting in the Extra Web Files settings.
I would agree with Hans uploading every minute for normal files other than realtime files is a bit excessive, I would suggest 10 minutes is more than enough.
Re: Scheduled uploads for extra web files
Posted: Mon 28 Nov 2022 12:44 pm
by mcrossley
One option is to call a script that performs those uploads, you can then put in that whatever rules you like about intervals.
Re: Scheduled uploads for extra web files
Posted: Mon 28 Nov 2022 1:57 pm
by broadstairs
There are three issues, the first is I need 1 minutes for the CU-tags as it runs my website, second the daily upload is needed to run after midnight or the data is wrong. The third issue is that the command line ftp in Linux is NOT secure so I can't use a script and Filezilla has no command line options.
WD does provide this as an option.
Stuart
Re: Scheduled uploads for extra web files
Posted: Mon 28 Nov 2022 5:00 pm
by mcrossley
Is using lftp not an option?
Just thinking of how you can implement something now.
Re: Scheduled uploads for extra web files
Posted: Mon 28 Nov 2022 5:29 pm
by broadstairs
I obviously missed that lftp supports either SFTP or FTPS protocols. I was about to look into creating a PHP script to see if I could do it that way. Whatever I do use in the end has to be able to be created as a cron job so that I can upload the data when needed. I've been spoilt with WD which allows up to 3 independent FTP sessions to be run at differing timings, a very useful feature
Stuart
Re: Scheduled uploads for extra web files
Posted: Wed 30 Nov 2022 3:11 pm
by mcrossley
you could have script called every interval and it checks the time and determines if an upload is due - but it's probably easier to set it up in cron.

Re: Scheduled uploads for extra web files
Posted: Wed 30 Nov 2022 3:14 pm
by mcrossley
Don't forget WD is a paid for app with what was/is(?) a full-time (aiui) developer. It does lots of stuff CMX will probably never do, but it is a complex beast because of that.
Re: Scheduled uploads for extra web files
Posted: Wed 30 Nov 2022 5:09 pm
by broadstairs
mcrossley wrote: ↑Wed 30 Nov 2022 3:14 pm
Don't forget WD is a paid for app with what was/is(?) a full-time (aiui) developer. It does lots of stuff CMX will probably never do, but it is a complex beast because of that.
No I realise that Mark, but it was worth asking
Stuart