docker cutils recent release not updating

[Nossie]

Hi Hans,

I've done a little digging and asking around a few docker people and ...

Running the app in a container vs a vm/server isn't much difference. If you have the issue I'd bet it's happening if you used a vm as well.

It's something code wise that's causing an issue, it sounds more like a weird race condition that's happening

Main.cs line 343 may be line above it that's the issue

To be honest, race conditions are above me Hans but do you mind telling me what's above line 343?

[HansR]

Hi Hans,

I've done a little digging and asking around a few docker people and ...

Running the app in a container vs a vm/server isn't much difference. If you have the issue I'd bet it's happening if you used a vm as well.

Remember that there is nobody else who has this issue (others are running Windows or Linux). Not sure of anybody running this in vm.

It's something code wise that's causing an issue, it sounds more like a weird race condition that's happening

A race condition... see the wiki.
If true, could be related to the next point.

Main.cs line 343 may be line above it that's the issue

See screenshot:

Schermafbeelding 2024-10-15 082259.png

To be honest, race conditions are above me Hans but do you mind telling me what's above line 343?

What is happening in line 343 is that it creates the main thread to run the different modules as asynchronous tasks. A relatively simple explanation of asynchronous programming is given here.

It could be some timing issue related to the usage of async but because it used to work on your system and the only thing which has been added is the SQLite libraries (which reside in the runtimes) the problem must be related to those. And that leads me to the remark that the diary module is NOT (currently) run async. It may in future.

Afaiac, these remarks are guesses and I do not see a reason why any of the remarks should be valid without additional proof.
I'll think about proving a timing point.

Anybody with a suggestion is invited to propose something!

[HansR]

And btw I checked your original logfile in the firsst post of this thread. It says:

Code: Select all

2024-09-12 03:12:23.912 Information Diary constructor: starting
2024-09-12 03:12:23.937 Error Exception Unknown : The type initializer for 'Microsoft.Data.Sqlite.SqliteConnection' threw an exception.
2024-09-12 03:12:23.939 Error Data (cont): Microsoft.Data.Sqlite
2024-09-12 03:12:23.975 Error Data:    at Microsoft.Data.Sqlite.SqliteConnection..ctor(String connectionString)
   at CumulusUtils.Diary.GetDiaryDatabase() in C:\Users\hansr\Documents\GitHub\CutilsFramework\CUtilsNET8\Diary.cs:line 99
   at CumulusUtils.Diary..ctor(CuSupport s) in C:\Users\hansr\Documents\GitHub\CutilsFramework\CUtilsNET8\Diary.cs:line 61
   at CumulusUtils.CUtils.RealMainAsync(String[] args) in C:\Users\hansr\Documents\GitHub\CutilsFramework\CUtilsNET8\Main.cs:line 609
   at CumulusUtils.CUtils.Main(String[] args) in C:\Users\hansr\Documents\GitHub\CutilsFramework\CUtilsNET8\Main.cs:line 343
2024-09-12 03:12:23.977 Error Exiting - check log file

So this is likely the reason your friend comes up with the question about line 343. But you need to remember this is just the stackdump of the exception occurring. It is not the line of the error. I read the error still that the library has a problem with the connectionString. The SQLite libraries apparently do load but they fail to initialise.

[Nossie]

Thanks Hans,

I've temporarily reverted back to the older version while I have a think, although I did upgrade cmx to 4.2.1 (build: 4040) and that works so that's something

I'm thinking of putting it on real hardware or atleast a VM - but I haven't tried to export it yet.

Some remarks of my own, it was very kind of you to add the option of specifying the DB location, however in my tests I think only once did it ever add [Diary] to the cumulusutils.ini, accordingg to notepad++ the file gets updated but that new section is not added and if I do add it directly it looks like it gets ignored. If you are saying that the error may be occurring before diary is executed and not part of the issue pointed out before - is it possible it's something to do with that config generation/append? I have checked write permissions etc and everything does appear to save.

- thanks.

[HansR]

Thanks Hans,

You're welcome, we'll have to find the solution together!

I've temporarily reverted back to the older version while I have a think, although I did upgrade cmx to 4.2.1 (build: 4040) and that works so that's something

I think it will work fine with 4.2.1 but please check the CUtils log on errors

I'm thinking of putting it on real hardware or atleast a VM - but I haven't tried to export it yet.

That would be a good test.

Some remarks of my own, it was very kind of you to add the option of specifying the DB location, however in my tests I think only once did it ever add [Diary] to the cumulusutils.ini, accordingg to notepad++ the file gets updated but that new section is not added and if I do add it directly it looks like it gets ignored. If you are saying that the error may be occurring before diary is executed and not part of the issue pointed out before - is it possible it's something to do with that config generation/append? I have checked write permissions etc and everything does appear to save.

No, I don't think your issue has something to do with that config generation/append because you also had the problem before I made that modification for you.

BTW: it is a modification which did not make it to a final version so if you would like to progress to a next beta and would like to continue with that experiment I will have to add it again!

[HansR]

Hi Ian,

Thinking this all over again I just realise the runtimes have a library for all supported possible environments. Is it likely docker does not select - or does not pass a parameter - to select the proper system? How does it handle that?

On the other hand, CMX is running under the same docker I presume. Please note that the runtimes of CUtils is missing the win and the unix directories but the contents of those is for libraries CUtils does not use.

[Nossie]

Hi Ian,

Thinking this all over again I just realise the runtimes have a library for all supported possible environments. Is it likely docker does not select - or does not pass a parameter - to select the proper system? How does it handle that?

That's originally why I asked what modules were needed - lsb-release appears to work with sysinfo and was required in the build previously - from what I understand the fact it's docker should make no difference, it's just a linux distro running within the environment - so whatever a metal install uses to identify the runtime should be used in the same way.

[HansR]

OK, fwiw... I can reproduce exactly your error:

Code: Select all

2024-10-21 16:18:26.421 Information Diary constructor: starting
2024-10-21 16:18:26.434 Error Exception Unknown : The type initializer for 'Microsoft.Data.Sqlite.SqliteConnection' threw an exception.
2024-10-21 16:18:26.435 Error Data (cont): Microsoft.Data.Sqlite
2024-10-21 16:18:26.476 Error Data:    at Microsoft.Data.Sqlite.SqliteConnection..ctor(String connectionString)
   at CumulusUtils.Diary.GetDiaryDatabase() in C:\Users\hansr\Documents\GitHub\CutilsFramework\CUtilsNET8\Diary.cs:line 104
   at CumulusUtils.Diary..ctor(CuSupport s) in C:\Users\hansr\Documents\GitHub\CutilsFramework\CUtilsNET8\Diary.cs:line 60
   at CumulusUtils.CUtils.RealMainAsync(String[] args) in C:\Users\hansr\Documents\GitHub\CutilsFramework\CUtilsNET8\Main.cs:line 609
   at CumulusUtils.CUtils.Main(String[] args) in C:\Users\hansr\Documents\GitHub\CutilsFramework\CUtilsNET8\Main.cs:line 343
2024-10-21 16:18:26.476 Error Exiting - check log file

This happens after I delete the files:

Code: Select all

SQLitePCLRaw.batteries_v2.dll
SQLitePCLRaw.core.dll
SQLitePCLRaw.provider.e_sqlite3.dll

Are you sure those files are there, valid rights, can be found, have no typo's or whatever...?
I assume you already re-copied the runtimes from the distro after complete removal?

[Nossie]

I'm currently rebuilding the container with some modifications and see what happens with that but yes those files exist and have the correct permissions etc.

[Nossie]

hmmm it's still not updating

what program or part of cutils calls those files? are there any packages that should be installed for this to be done?

[HansR]

hmmm it's still not updating

what program or part of cutils calls those files? are there any packages that should be installed for this to be done?

It's only the diary which calls SQLite. If there is data in the database the module is generated and displayed. Without data the process of the diary stops. But SQLite is always required to read the database.

[HansR]

@Anybody: do you have any idea what could be a cause of Ian's problem? Cutils is working everywhere but not in Ian's docker environment where CMX (which also has SQLite) is running fine.

[Nossie]

Hans,

when you do

dotnet --list-runtimes

what is your output? thanks.

[HansR]

Hi Ian,

Currently away walking in the Ardennes so this has to wait until next monday (earliest).

[Nossie]

thanks for getting back to me

do enjoy, I'm jealous!