Welcome to the Cumulus Support forum.

Latest Cumulus MX release 3.8.0 (build 3090) - 12 August 2020 (please see important announcement regarding releases since 3.5.0)
Legacy Cumulus 1 release v1.9.4 (build 1099) - 28 November 2014 (a patch is available for 1.9.4 build 1099 that extends the date range of the NOAA report and Snow Index drop-down menus to 2030)

Use this link to Download the Software (Cumulus MX / Cumulus 1 and other related items). Software

Graphs datepicker

Please DO NOT use this to publish your entire wish. This Forum is for specific suggestions to enhance the usability of Cumulus MX for all users, NOT your personal requirements. Please check this forum and the rejected forum to make sure you are NOT posting a DUPLICATE suggestion. It will be heavily monitored by Admin and Mark Crossley to determine the feasibility and the difficulty of the suggestion. Those Topics that are deemed inadmissible will moved to the rejected Forum. The remaining Topics will be the Accepted list of future developments, and when our voluntary development group adds it to a build, the build number will be added to the Topic title.
User avatar
mcrossley
Posts: 6771
Joined: Thu 07 Jan 2010 9:44 pm
Weather Station: Davis VP2
Operating System: Buster Lite rPi
Location: Wilmslow, Cheshire, UK
Contact:

Re: Graphs datepicker

Post by mcrossley »

HansR wrote:
Tue 21 Jul 2020 12:10 pm
But unfortunately my FF says: SyntaxError: JSON.parse: unexpected character at line 1 column 9 of the JSON data and I have to look at the RAW data.

And tbh, it makes me wonder why the editor takes so much time to read the data of the month files?
That's because the URL is missing a parameter, add "&draw=1" and it should be OK.
Atlas wrote:
Tue 21 Jul 2020 12:26 pm
Well..... MX on Windows 10 (latest updates), MSI windbox dc111 (5 years old) and logfile 1 minute interval MX running through VVP....VVP hanged and need to restart MX after It used a lot of CPU during minutes.

Both testing of you are in Raspberrys...some test on Windows ?

Just to check if It is a thing related to my system.
Windows 10 - 10,000 requested for 06-2020 = 0.13 seconds
Last edited by mcrossley on Tue 21 Jul 2020 4:22 pm, edited 1 time in total.

User avatar
HansR
Posts: 1204
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: Davis Vantage Pro 2+
Operating System: Raspbian GNU/Linux 10 (Buster)
Location: Wagenborgen (NL)
Contact:

Re: Graphs datepicker

Post by HansR »

mcrossley wrote:
Tue 21 Jul 2020 1:02 pm
That's because the URL is missing a parameter, add "&mark=1" and it should be OK.
Should be, but it isn't unfortunately.

Code: Select all

http://192.168.178.6:8998/api/data/logfile?month=07-2019&start=0&length=50000&mark=1
https://meteo-wagenborgen.nl / Cumulus 3.6.8 (build: 3084)
Davis Vantage Pro 2+ / Raspberry Pi 3 Model B Plus Rev 1.3
Raspbian Linux 10 (buster) / 4.19.118-v7+ armv7l
Mono JIT compiler version 6.8.0.123 (tarball Tue May 12 15:31:43 UTC 2020)

Atlas
Posts: 32
Joined: Wed 04 Jun 2014 3:36 pm
Weather Station: Davis Vantage Pro2 Plus
Operating System: Win 10 Pro x64 4 GB RAM
Location: Murcia, Spain

Re: Graphs datepicker

Post by Atlas »

Impossible for me....

1,000 requests to 06-2020 log ----- 195 kB ------- 19.4 seconds (Chrome developer tools), Cumulus MX CPU usage about 45% while processing

06-2020 log with 1 minute interval recording has 5,628 kB and 43,027 lines

Maybe the log size would be the problem....

P.D. mcrossley your 06-2020 logfile with 5 minutes interval must have around 8,640 lines (12 * 24 * 30)... and you have requested 10,000 lines... no problem about it ??
Image
Davis Vantage Pro 2 Plus
http://www.meteoarchena.es

freddie
Posts: 802
Joined: Wed 08 Jun 2011 11:19 am
Weather Station: Davis Vantage Pro 2
Operating System: GNU/Linux Ubuntu 18.04 LXC
Location: Alcaston, Shropshire, UK
Contact:

Re: Graphs datepicker

Post by freddie »

I see similar poor performance - /api/data/logfile?month=07-2020&start=0&length=20000&mark=1 returns all rows (my archive interval is 1 minute) but it took 20.34 seconds. If I request any more rows I run into a timeout (about 25 seconds): in Developer tools (Chrome) the status is given as net::ERR_CONNECTION_RESET.

TBF I am temporarily running Cumulus on a Windows 10 laptop - so it probably isn't optimised for "serving". I'll run the same test when my server is back on its feet.
Freddie
Image

User avatar
mcrossley
Posts: 6771
Joined: Thu 07 Jan 2010 9:44 pm
Weather Station: Davis VP2
Operating System: Buster Lite rPi
Location: Wilmslow, Cheshire, UK
Contact:

Re: Graphs datepicker

Post by mcrossley »

HansR wrote:
Tue 21 Jul 2020 1:21 pm
mcrossley wrote:
Tue 21 Jul 2020 1:02 pm
That's because the URL is missing a parameter, add "&mark=1" and it should be OK.
Should be, but it isn't unfortunately.

Code: Select all

http://192.168.178.6:8998/api/data/logfile?month=07-2019&start=0&length=50000&mark=1
Cranial flatulence strikes again, it should be "&draw=1" :bash:

User avatar
mcrossley
Posts: 6771
Joined: Thu 07 Jan 2010 9:44 pm
Weather Station: Davis VP2
Operating System: Buster Lite rPi
Location: Wilmslow, Cheshire, UK
Contact:

Re: Graphs datepicker

Post by mcrossley »

freddie wrote:
Tue 21 Jul 2020 3:06 pm
I see similar poor performance - /api/data/logfile?month=07-2020&start=0&length=20000&mark=1 returns all rows (my archive interval is 1 minute) but it took 20.34 seconds. If I request any more rows I run into a timeout (about 25 seconds): in Developer tools (Chrome) the status is given as net::ERR_CONNECTION_RESET.

TBF I am temporarily running Cumulus on a Windows 10 laptop - so it probably isn't optimised for "serving". I'll run the same test when my server is back on its feet.
Weird - how can it be soo different!?

Which version of MX?

freddie
Posts: 802
Joined: Wed 08 Jun 2011 11:19 am
Weather Station: Davis Vantage Pro 2
Operating System: GNU/Linux Ubuntu 18.04 LXC
Location: Alcaston, Shropshire, UK
Contact:

Re: Graphs datepicker

Post by freddie »

mcrossley wrote:
Tue 21 Jul 2020 4:24 pm
freddie wrote:
Tue 21 Jul 2020 3:06 pm
I see similar poor performance - /api/data/logfile?month=07-2020&start=0&length=20000&mark=1 returns all rows (my archive interval is 1 minute) but it took 20.34 seconds. If I request any more rows I run into a timeout (about 25 seconds): in Developer tools (Chrome) the status is given as net::ERR_CONNECTION_RESET.

TBF I am temporarily running Cumulus on a Windows 10 laptop - so it probably isn't optimised for "serving". I'll run the same test when my server is back on its feet.
Weird - how can it be soo different!?
I don't know. I usually use Linux and its performance is a bit crisper on there.
mcrossley wrote:
Tue 21 Jul 2020 4:24 pm
Which version of MX?
3.6.12 build 3088. I had been using the latest beta but forgot that in my panic/haste to get it up-and-running again on Sunday :D
Freddie
Image

User avatar
mcrossley
Posts: 6771
Joined: Thu 07 Jan 2010 9:44 pm
Weather Station: Davis VP2
Operating System: Buster Lite rPi
Location: Wilmslow, Cheshire, UK
Contact:

Re: Graphs datepicker

Post by mcrossley »

Atlas wrote:
Tue 21 Jul 2020 2:11 pm
P.D. mcrossley your 06-2020 logfile with 5 minutes interval must have around 8,640 lines (12 * 24 * 30)... and you have requested 10,000 lines... no problem about it ??
No problem asking for more lines than exist - it will just return all the lines it can.

User avatar
HansR
Posts: 1204
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: Davis Vantage Pro 2+
Operating System: Raspbian GNU/Linux 10 (Buster)
Location: Wagenborgen (NL)
Contact:

Re: Graphs datepicker

Post by HansR »

mcrossley wrote:
Tue 21 Jul 2020 4:23 pm
Cranial flatulence strikes again, it should be "&draw=1" :bash:
ROF :lol:
Working though! Cold start - so no cache - less than 3 seconds.
https://meteo-wagenborgen.nl / Cumulus 3.6.8 (build: 3084)
Davis Vantage Pro 2+ / Raspberry Pi 3 Model B Plus Rev 1.3
Raspbian Linux 10 (buster) / 4.19.118-v7+ armv7l
Mono JIT compiler version 6.8.0.123 (tarball Tue May 12 15:31:43 UTC 2020)

User avatar
mcrossley
Posts: 6771
Joined: Thu 07 Jan 2010 9:44 pm
Weather Station: Davis VP2
Operating System: Buster Lite rPi
Location: Wilmslow, Cheshire, UK
Contact:

Re: Graphs datepicker

Post by mcrossley »

OK, now I have restarted MX I am getting response times that are varying from 0.4 seconds to 7+ seconds (Windows 10, i5, local machine).

For all of the them the response time (to read the data and start sending it) is < 0.1 seconds, then the transmission time to the browser that is varying from 0.4 up to a couple of seconds.

But then the rendering time for the browser to interpret the JSON and display the data can take up to another 7 seconds, I think it is this rendering that is also slowing the data download as...

Running the query in Postman rather than a browser and the data is sent for the first query in <600ms then once the log file has been cached it is consistently being downloaded in 70-80ms.

Atlas
Posts: 32
Joined: Wed 04 Jun 2014 3:36 pm
Weather Station: Davis Vantage Pro2 Plus
Operating System: Win 10 Pro x64 4 GB RAM
Location: Murcia, Spain

Re: Graphs datepicker

Post by Atlas »

Well.... my previous tests have been with build 3086 but after upgrading to 3088 there have been a lot of improvements in performance because MX has almost instanly served the data.... Chrome has been a little bit lazy loading the whole json.... I've requested 50,000 lines and Chrome has served 28,000 in 1.4 minutes !!

So I think it is not a matter of PC specs but the 3088 version improvement... can you confirm that mcrossley ??

Anyway I am going to do some tests requiring the json data for the graph... asking for the whole json and selecting only the day I want.
Image
Davis Vantage Pro 2 Plus
http://www.meteoarchena.es

User avatar
mcrossley
Posts: 6771
Joined: Thu 07 Jan 2010 9:44 pm
Weather Station: Davis VP2
Operating System: Buster Lite rPi
Location: Wilmslow, Cheshire, UK
Contact:

Re: Graphs datepicker

Post by mcrossley »

3088 did have performance enhancements around constructing the JSON strings.

I've just made some additional performance tweaks to the API code for the next release.

Atlas
Posts: 32
Joined: Wed 04 Jun 2014 3:36 pm
Weather Station: Davis Vantage Pro2 Plus
Operating System: Win 10 Pro x64 4 GB RAM
Location: Murcia, Spain

Re: Graphs datepicker

Post by Atlas »

if it's not too much to ask for… could some of these tweaks include to ask for a specific day of the log ? the way http://127.0.0.1:8998/api/data/logfile? ... 020&day=23
for example ??

If not thank you anyway
Image
Davis Vantage Pro 2 Plus
http://www.meteoarchena.es

User avatar
galfert
Posts: 71
Joined: Tue 03 May 2016 2:57 pm
Weather Station: Ambient Weather WS-2000
Operating System: Linux Mint or Raspbian
Location: Orlando, FL

Re: Graphs datepicker

Post by galfert »

I second this request instead of having to construct URL manually.
WS-2000 & WS-2902A | Ecowitt GW1000 | Meteobridge (WeatherBridge)
WU: KFLWINTE111  |  PWSweather: KFLWINTE111
CWOP: FW3708  |  AWEKAS: 14814
Windy: pws-f075acbe
Tele-Pole flag pole

Post Reply