Page 1 of 1
A couple of questions from a CMX beginner
Posted: Tue 09 Feb 2021 9:15 pm
by VSWeather
Hi
I have searched around a bit in this forum and don't think I can find answers to my questions.
So here they come.
What are the benefits of using MySql as a data source?
Is Mark Crossley's template available for download, it seems very informative.
Is it possible to import data from any other datasources, if yes, any data description?
Thanks
Gert
Re: A couple of questions from a CMX beginner
Posted: Tue 09 Feb 2021 11:03 pm
by jlmr731
As far as SQL its not a data source for CumulusMX, Its a storage base. There may be many reasons to why, so the best would be a its searchable, works well with web site to pull data from and im sure there are many other use cases. yes CMX does store all the data in text files so a database is not needed some just may prefer to have a second way to retrieve data.
Only Mark can tell you, but with a bit of work you can customize your own.
What data source do you want to import from? This would be easier to answer if we knew.
Re: A couple of questions from a CMX beginner
Posted: Wed 10 Feb 2021 5:07 am
by VSWeather
Hi
Thanks for the prompt answer.
I can export to .csv files.
Rgds
Gert
Re: A couple of questions from a CMX beginner
Posted: Wed 10 Feb 2021 1:50 pm
by mcrossley
VSWeather wrote: ↑Tue 09 Feb 2021 9:15 pm
Is Mark Crossley's template available for download, it seems very informative.
No, but the source for many of the pages are available either from my web site scripts page, or posts on this forum.
Re: A couple of questions from a CMX beginner
Posted: Sat 13 Feb 2021 6:51 am
by VSWeather
Hi
If I look in the data folder, many files are updated frequently, so maybe it's not so easy to import into thes files.
Is it more easy to convert to MySQL and then import to the database from the .csv file?
Thanks
Re: A couple of questions from a CMX beginner
Posted: Sat 13 Feb 2021 8:03 am
by HansR
@VSWeather: whatever you choose or whatever you do with the data, the only datastore with high integrity is the logfiles. As soon as the MySQL database becomes unreachable, data are no longer stored there and you need to refill missing data from the logfiles with one of existing tools. In several ways the SQL as a data source for presentation is flawed and requires constant (technical) attention.
Re: A couple of questions from a CMX beginner
Posted: Sat 13 Feb 2021 8:49 am
by VSWeather
Hi HansR
Thanks for the answer, it is good to know.
I’ll stay with the the logfiles as the primary datasource and try to see if I can import into MySql. Then I can use Grafana as an additional presentation.
I also guess that there is no easy Way to import into the logfiles from a CSC file?
Gert
Re: A couple of questions from a CMX beginner
Posted: Sat 13 Feb 2021 9:04 am
by HansR
VSWeather wrote: ↑Sat 13 Feb 2021 8:49 am
I also guess that there is no easy Way to import into the logfiles from a CSC file?
I would not import external data (where does the CSC file come from?) straight into the logfiles unless you really know what you are doing. Check the Wiki for the format of the logfiles. Any error will break the reading of the logfiles. Especially the Dayfile will cause problems. The Monthly file will only cause problems in the current month and for any (third Party) software using those files.
With respect to import there are two tools to check out. Look into the Wiki or this
recent thread where also
@sutne points to his solution.