Cumulus Support

Hi Steve,

DAJ contacted me today as I was very close to exceeding my monthly storage space. He analysed the data and found I was updating all the data (including uploading the graphs) every 5 minutes. He suggested that by changing it to 10 it would half my uploaded filesize.

It's very useful for the numbers to be updated frequently but I don't think the graphs need updating as often. Every 30 minutes would be fine for me.

Would it be possible to have two upload frequency settings? One for the raw data and one for the graphs? That way I could revert to 5 mins for the raw stuff and I'm sure the graphs wouldn't suffer too much if they were updated less frequently.

Of course for those who still wanted to update everything every x minutes they could.

Thanks.

Firstly: Yes, it would be possible to offer a separate upload interval for graphs - you could perhaps create an enhancement request for it?

But I don't understand how that reduces your filestore usage. The graph files are very small - about 130kb in total, and it doesn't matter how often they get uploaded, they still occupy the same amount of space; the new files overwrite the old ones each time.

For "storage" read "bandwidth"

Uploading the graphs every 5 minutes consumes around 1.3Gb bandwidth per month

Ah, right. FTP counts towards the 2Gb allowance? Uploading realtime.txt at 3 second intervals uses about 1Gb (I think?), and the html pages at 5 minute intervals about 0.5GB. So the graph uploads and http access would need to come out of the remaining 0.5GB, so about 30 minutes between graph uploads is probably about right, I guess, leaving about 0.3GB for http. I've probably got the sums wrong, though

. ....I've probably got the sums wrong, though

Here's the figures I got to. (attached)

The realtime update is tiny and even although it is 28,800 times per day (3 second interval) is still not much over a month

daj wrote:For "storage" read "bandwidth"

Uploading the graphs every 5 minutes consumes around 1.3Gb bandwidth per month

Thanks for helping me out with the right words David. I hope it all makes sense now Steve. Would you still like me to raise it in 'enhancements'?

daj wrote:Here's the figures I got to. (attached)

The realtime update is tiny and even although it is 28,800 times per day (3 second interval) is still not much over a month

I think you're a factor of 10 out with realtime.txt: 234 * 28,800 = 6,739,200 bytes per day = 200 MB per month, so not huge, but significant.

RayProudfoot wrote:Would you still like me to raise it in 'enhancements'?

Yes please, if you'd still like me to do it. It's a big change as it will need a lot of code restructuring.

steve wrote:

RayProudfoot wrote:Would you still like me to raise it in 'enhancements'?

Yes please, if you'd still like me to do it. It's a big change as it will need a lot of code restructuring.

If the amount of work is disproportional to the requirement then I don't think it is worth it just now. However, when you come to C1.9 if you can introduce it then then that would be more sensible.

Uploading every 10 mins is hardly a problem.

steve wrote:I think you're a factor of 10 out with realtime.txt: 234 * 28,800 = 6,739,200 bytes per day = 200 MB per month, so not huge, but significant.

Oh yes, I see the daily real-time figure is slightly out (mis-typed a number). of course all that does is make the data figures even higher! (but only by 200Mb a month for realtime which relatively is not too bad)

New file attached just in case anyone is following/interested

RayProudfoot wrote:However, when you come to C1.9 if you can introduce it then then that would be more sensible.

Yes, it was in 1.9 that I was proposing to do it. I'm going to 'release' 1.8.9 some time soon, and then I'll start looking at the enhancement list for 1.9.

daj wrote:

steve wrote:I think you're a factor of 10 out with realtime.txt: 234 * 28,800 = 6,739,200 bytes per day = 200 MB per month, so not huge, but significant.

Oh yes, I see the daily real-time figure is slightly out (mis-typed a number). of course all that does is make the data figures even higher! (but only by 200Mb a month for realtime which relatively is not too bad)

New file attached just in case anyone is following/interested

Thanks David.