Welcome to the Cumulus Support forum.

Latest Cumulus MX V3 release 3.28.6 (build 3283) - 21 March 2024

Cumulus MX V4 beta test release 4.0.0 (build 4019) - 03 April 2024

Legacy Cumulus 1 release 1.9.4 (build 1099) - 28 November 2014
(a patch is available for 1.9.4 build 1099 that extends the date range of drop-down menus to 2030)

Download the Software (Cumulus MX / Cumulus 1 and other related items) from the Wiki

"startup" database update

Please DO NOT use this to publish your entire wish. This Forum is for specific suggestions to enhance the usability of Cumulus MX for all users, NOT your personal requirements. Please check this forum and the rejected forum to make sure you are NOT posting a DUPLICATE suggestion. It will be heavily monitored by Admin and Mark Crossley to determine the feasibility and the difficulty of the suggestion. Those Topics that are deemed inadmissible will moved to the rejected Forum. The remaining Topics will be the Accepted list of future developments, and when our voluntary development group adds it to a build, the build number will be added to the Topic title.
Post Reply
freddie
Posts: 2473
Joined: Wed 08 Jun 2011 11:19 am
Weather Station: Davis Vantage Pro 2 + Ecowitt
Operating System: GNU/Linux Ubuntu 22.04 LXC
Location: Alcaston, Shropshire, UK
Contact:

"startup" database update

Post by freddie »

To enhance the already-available database updates performed at the realtime interval, the logging interval and at rollover, I would like to have a database update performed at MX start-up. I would use this to store such (relatively) static data as release number, build number, latitude, longitude, units used, station name, etc. This would make database-driven websites a lot easier to keep current. It would also enable database-driven realtime.xml and the JSON files used by the new-style default website to be database-driven.
Freddie
Image
sfws
Posts: 1183
Joined: Fri 27 Jul 2012 11:29 am
Weather Station: Chas O, Maplin N96FY, N25FR
Operating System: rPi 3B+ with Buster (full)

Re: "startup" database update

Post by sfws »

freddie wrote: Fri 03 Jun 2022 7:19 pmTo enhance the already-available database updates performed at the realtime interval, the logging interval and at rollover, I would like to have a database update performed at MX start-up.
I would use this to store such (relatively) static data as release number, build number, latitude, longitude, units used, station name, etc.
I suspect in both Microsoft Windows and Linux environments, the start running as a service could be easily modified to initiate a batch process that could trigger the necessary update of just release number, and build number. Even these don't need to be updated every time MX starts as strictly they could be updated just when a restart shows the build has changed.
The remainder of static information virtually never changes (people rarely change location or units), and would be better treated as a one-off installation task, certainly not repeated on every restart.

MX currently can run SQL or external processes once a day (rollover), or at more frequent intervals (for Custom SQL it is already any number of seconds, or various numbers of minutes, not fixed as with standard SQL, and external processes, to just the realtime interval, or the logging interval). Your idea could be extended by implementing the ability to run SQL or external processes at end/start of month, end/start of year, start of a MX session, or once per MX installation? One could argue for even more, that MX could have a major redesign, to be totally data-driven, as I describe below.
freddie wrote: Fri 03 Jun 2022 7:19 pm the JSON files used by the new-style default website to be database-driven.
The majority of the content in JSON files used by the new-style default website is unchanged between successive uploads. In the case of data for graph plots a little is added and a little is dropped off, so in-between content apparently changes its position. For the data for tables, a comparatively small amount of the data actually changes despite the demand for frequent updates! So actually I think use of .json files could end, replaced with database table reads either programmed at various intervals, or just run when needed by a web page.

If any database options are enabled, then MX could assume people do indeed want a database driven approach, with all web site processes interrogating database tables. MX would become "intelligent" and only upload (to appropriate database table row/column) those items that have actually changed since last upload, so the whole system becomes data driven. Of course changing what gets uploaded also implies changing how the default web pages work, but that offers flexibility, web pages can plot/display information that can be picked on demand rather than predetermined.

I have made significant progress towards this objective by using my own schema for database tables for well over a decade, and the biggest step forward was implementing custom SQL updates by MX, and the related web page script changes.
freddie
Posts: 2473
Joined: Wed 08 Jun 2011 11:19 am
Weather Station: Davis Vantage Pro 2 + Ecowitt
Operating System: GNU/Linux Ubuntu 22.04 LXC
Location: Alcaston, Shropshire, UK
Contact:

Re: "startup" database update

Post by freddie »

freddie wrote: Fri 03 Jun 2022 7:19 pm To enhance the already-available database updates performed at the realtime interval, the logging interval and at rollover, I would like to have a database update performed at MX start-up. I would use this to store such (relatively) static data as release number, build number, latitude, longitude, units used, station name, etc. This would make database-driven websites a lot easier to keep current. It would also enable database-driven realtime.xml and the JSON files used by the new-style default website to be database-driven.
In a similar vein (unsure of the interval for this one), an update for astronomical data?
Freddie
Image
User avatar
mcrossley
Posts: 12756
Joined: Thu 07 Jan 2010 9:44 pm
Weather Station: Davis VP2/WLL
Operating System: Bullseye Lite rPi
Location: Wilmslow, Cheshire, UK
Contact:

Re: "startup" database update

Post by mcrossley »

freddie wrote: Sun 12 Jun 2022 11:45 am In a similar vein (unsure of the interval for this one), an update for astronomical data?
What, an trigger for when sun/moon rise/set times are recalculated?

They are recalculated once an hour on the hour along with the Moon image update.

The Moon phase angle is updated every 10 minutes.

The theoretical solar value every minute.
freddie
Posts: 2473
Joined: Wed 08 Jun 2011 11:19 am
Weather Station: Davis Vantage Pro 2 + Ecowitt
Operating System: GNU/Linux Ubuntu 22.04 LXC
Location: Alcaston, Shropshire, UK
Contact:

Re: "startup" database update

Post by freddie »

mcrossley wrote: Tue 14 Jun 2022 12:15 pm
freddie wrote: Sun 12 Jun 2022 11:45 am In a similar vein (unsure of the interval for this one), an update for astronomical data?
What, an trigger for when sun/moon rise/set times are recalculated?

They are recalculated once an hour on the hour along with the Moon image update.

The Moon phase angle is updated every 10 minutes.

The theoretical solar value every minute.
Okay, thanks, so that's already covered - catered for by the minutes interval. I will append the additional SQL to my pre-existing custom minutes query.
Freddie
Image
Post Reply