CUtils v 6.17.0 beta

[HansR]

For the coming CMX 3.24.0 this is the CumulusUtils 6.17.0 beta which makes use of the Upload.PHP, the new upload method.
If you are testing that CMX version, I would appreciate testing this CUtils version.
Anybody interested in CUtils and lower bandwidth should use this.

beta 6: added the Print menu option for printing the ReportView.

Known issues:

1. Incremental Airlink JSON is not good for the windbarbs fixed in beta 2
2. Initial setting of LastUploadTime is not correct and may cause error
3. Something wrong with the ALL user datafiles fixed in beta 2
4. Windbarbs with AirLink does not work correctly and generates very large json (see here). Solved in beta 4 (I think)
5. Work on the AirLink Windbarbs again. Solved in beta 5
6. New menu Print causes large dots when not at the end of the menu line Solved in beta 7
7. Issues with External Extra Sensors and additional map failing Solved in beta 8

See Release Notes

(if you do not test CMX 3.24.0 you can still run this as usual and use the RecordsBeganDate)

[PaulMy]

Hi Hans,
It seems ok in my v3.23.1-b3221 and cumulusutils.exe website took quite a while to finish its run - seemed a bit longer than the normal of perhaps 3 to 4 minutes but not sure on exact time. www. komokaweather.com/cumulusmx/index.html
Also installed it in b3228 with PHP but have forgotten what all I need for CUtils on my remote. The cumulusutils.exe website run took 18 seconds (way quicker). Looks ok in local \CumulusMX\utils folder but upload failed.
I'll need to refresh my CUtils installation as I hadn't done that in what 3 or 4 years... so may not be complete. Attached is the utilslog.

Enjoy,
Paul

[HansR]

Hi Paul,

Thanks for trying this version.

I have the following observations:

1. You are using CumulusUtils version: 6.7.10 against CumulusMX Version: 3.23.1 build 3221 so it seems you did not install the new CUtils here correctly.
2. On the other hand I don't understand how CUtils can get protocol nr 3 (PHP Upload) from CMX while CMX b3221 does not have that yet (the wrong protocol info is read from the CMX ini file).
3. CMX apparently uses the PHP Upload procedure but CUtils 6.7.1 of course can't handle that:

   Code: Select all

   Error InetSupport: Protocol not implemented 3. Files will not be transferred

   so no uploads are taking place.
4. All individual module timings are not exceptional and do not add up to 3 to 4 minutes. I am not sure why you think that. I come to a total time of 21 seconds in this logfile: start 16:59:29.118 until end 16:59:49.913

So in summary: I think some things got mixed up here, versions but also CMX inifiles in the wrong place (note PHP protocol/CMX version combination is impossible). It should simply run on any old CMX version / (S)FTP(S) protocol combination.

[AndyKF650]

Hi Hans

For information I am not testing the new CMX but I have downloaded and tried to install the new CUtils 6.17.0 Beta2 which does seem to work. It just reverts to 6.16.0. Is this correct?

Running the cmd website appears to work with no issues but the logfile shows that version 6.16.0 is being used despite overwriting the version 6.17.0 Beta2

[HansR]

That seems strange. I currently have beta 2 uploaded, you might try that one but it seems you are running the previous version for one reason or another (the website command creates a new index.html with the new version inscribed so no misunderstanding is possible). You only need to copy the contents of the zip to the utils/bin directory!

And indeed checking it works correctly with the previous versions of CMX is just as important so testing this is also highly appreciated!

[Dador]

Everything looks fine to me. Files and utilslog are created. No errors occurred. The RecordsBeganDate parameter works fine.

[AndyKF650]

Hi Hans

Breakfast helped! As you said I should have just copied the zip file contents to the bin folder and then run the cmd website.

All works fine

[HansR]

Great. But I found some other issues so stay tuned

[HansR]

@Andy, @Dador, @Paul: beta3 is the thing, might call it a release candidate as I am out of issues. Maybe you find some

When CMX 3.24.0 will be released, CUtils will stay in beta a bit longer for everybody to confirm and get confidence as quite some changes are made.

[AndyKF650]

Hi Hans

Beta 3 works for me

[Dador]

Hans,

beta 3 works quite well.

There is a small issue though. I entered a date for RecordsBeganDate=04/05/22. But then I deleted it, because I saw in top10Table.txt that it basically didn't change anything. However, in the footer of top10Table.txt, the date for the beginning of the data was entered. It didn't go back to the original version.

I hope I'm writing clearly, I'm using a translator to help .

[HansR]

@Andy: Good.

@Dador: Indeed I don't fully understand what you are saying. Anyway, changes in the startdate of the data - normally one would take 01/01/<yy> - will always need to rerun that module. But if your data without such startdate already start on 4/5/22 then indeed nothing will happen. Your problem was the start of the rain sensors which was later than the rest, so you will need to set it to the day of introduction of the rain sensor. As I warned, after reading you asking this feature, it will not be a per device date.

Hope this helps?

[Dador]

Hans,

ok, sorry for the confusion, my mistake.

I checked by entering different starting dates, then deleted them. Everything works. I just suggested bad data.

[Nossie]

I just wrote over my existing and reran, appears to be ok although the php upload option sound very appealing! should be great for those on more limited data.

[PaulMy]

Hi Hans,
In my haste I installed an old v6.7.10 yesterday, and sorry for the confusion that caused.

I tried v6.17.0 today in both a CMX release v3.23.1-b3221 and that worked ok and updated to the /cumulusmx website.
I did not try it on the other b3221 and will update that later /cumulusmxwll.

You asked if v3.24.0 tester with PHP could try v6.17.0 beta so I did that this morning as well. This CMX test install also had CUtils installed quite a while ago which I had not updated since perhaps summer of 2022. I copied in all the v6.17.0 unzipped files and did a website run. Seemed ok in the \utils folder but nothing uploaded to website. There are some errors in the utilslog file and that is attached. I haven't taken the time yet to double check the CUtils install, just wanted to correct the wrong version of yesterday.

I have done a time compare of the cumulusutils.exe website runs:
CMX v3.23.1-b3221 CUtils v6.17.0 started at 10:37:02 and finished 10:39:35 as recorded in the log file so about 2.5 minutes (my guess of 3 to 4 minutes yesterday was off a bit but then time seems to take forever when watching the PC time, and that is about the same time that I have observed in previous website runs after installing a new version) website is /cumulusmx/index.html
CMX v3.23.1-b3221 CUtils v6.16.0 started at 10:02:02 and finished 10:04:20 so about the same 2 plus minutes to run website /cumulusmxwll/index.html
CMX v3.24.0-b3228 CUtils v6.17.0 started at 10:44:02 and finished 10:44:24 so at about 22 seconds a lot quicker than with v3.21.1 but then this did not have any actual uploads.

Some more work to do on my part to get CUtils installed properly on the test install.

Enjoy,
Paul