Page 1 of 1

Long time to load data at startup

Posted: Thu 31 Mar 2011 6:57 pm
by wradmore
Hi I'm running version 1.9.0
When it first starts it takes around 1 hour to load a months worth of data. I'm using the davis pro logger set to record every 10 minutes. Is there anyway of reducing the time to load data. Does the software not just update the records it does not already have sine last running of the software.
It seems to load the entire large file every time. It's just a bore to wait 1 hour before I can use the software.

Regards
Warren

Re: Long time to load data at startup

Posted: Thu 31 Mar 2011 6:59 pm
by steve

Re: Long time to load data at startup

Posted: Thu 31 Mar 2011 7:22 pm
by wradmore
Thanks Steve

I am running them both at 10 minutes intervals. Been about a week since I launched Cumulus though. Weatherlink seems to be quick at downloading data.

Warren

Re: Long time to load data at startup

Posted: Thu 31 Mar 2011 7:31 pm
by steve
It downloads about 3 entries per second on my not-very-fast PC, so it would only take about 15 minutes even to download the entire contents of the logger.

Please zip up the diags folder and attach it, and I'll see if I can see what's going on.

Re: Long time to load data at startup

Posted: Thu 31 Mar 2011 7:46 pm
by steve
Actually, it's more like 10 per second on my system.

Re: Long time to load data at startup

Posted: Thu 31 Mar 2011 10:08 pm
by wradmore
Ok will upload file tomorrow. Thanks

Re: Long time to load data at startup

Posted: Fri 01 Apr 2011 7:32 am
by wradmore
Here is the diags.zip file for you to look at
Thanks
Warren

Re: Long time to load data at startup

Posted: Fri 01 Apr 2011 8:04 am
by steve
It does seem quite slow, but not as slow as you've said. When you last started it up, not having run for over two weeks, it had almost a full logger to download - 2138 entries - and it took 28 minutes.

What spec is your system? Mine is 10 years old and has a Pentium 4, and seems to be about 5 or 10 times faster than yours.

Re: Long time to load data at startup

Posted: Fri 01 Apr 2011 8:53 am
by wradmore
Ha yes mine is around the same age. It's a 2.6ghz laptop. Perhaps I need a new one.
In the weatherlink it only seems to load data from the logger that already has not been downloaded. Seems Cumulus loads it all again.
Also if cumulus loads only data from the logger what has happened to the older data not on the logger?

Regards
Warren

Re: Long time to load data at startup

Posted: Fri 01 Apr 2011 9:10 am
by steve
wradmore wrote:In the weatherlink it only seems to load data from the logger that already has not been downloaded. Seems Cumulus loads it all again.
Cumulus only downloads the data that it missed while it wasn't running. Example:

You closed Cumulus just after 22:00 on 16th March:

16/03/2011 22:02:49.453 : Cumulus closing
16/03/2011 22:02:49.843 : Writing todayfile, LastUpdateTime = 16/03/2011 22:00:00 raindaystart = -21.6000080108643

You then started it again at 19:37 yesterday:

31/03/2011 19:37:03.249 : Cumulus 1.9.0 Build 958 startup

and it downloaded the data from the logger from the point where it was last closed on the 16th:

31/03/2011 19:37:08.557 : VP2: Downloading history from 16/03/2011 22:00:00
31/03/2011 19:37:08.557 : y=2011 m=3 d=16 h=22 m=0
31/03/2011 19:38:15.173 : VP2: DownloadData_V = 2138
31/03/2011 19:38:15.173 : VP2: GetNumberOfArchiveRecords_V = 2138
31/03/2011 19:38:15.173 : VP2: Number of history records = 2138
Also if cumulus loads only data from the logger what has happened to the older data not on the logger?
Sorry, I don't understand. It downloads data from the logger at start up. It then reads data 'live' while it's running. It creates its own data logs from both types of data, in the 'data' folder.

Re: Long time to load data at startup

Posted: Fri 01 Apr 2011 10:15 am
by wradmore
Many thanks Steve. You have answered all my questions.