Welcome to the Cumulus Support forum.

Latest Cumulus MX V4 release 4.4.2 (build 4085) - 12 March 2025

Latest Cumulus MX V3 release 3.28.6 (build 3283) - 21 March 2024

Legacy Cumulus 1 release 1.9.4 (build 1099) - 28 November 2014
(a patch is available for 1.9.4 build 1099 that extends the date range of drop-down menus to 2030)

Download the Software (Cumulus MX / Cumulus 1 and other related items) from the Wiki

If you are posting a new Topic about an error or if you need help PLEASE read this first viewtopic.php?p=164080#p164080

cutils extra sensors

Discussion of the Cumulusutils tool and website generator.

Moderator: HansR

Nossie
Posts: 424
Joined: Tue 16 Aug 2022 8:01 pm
Weather Station: Ecowitt 2551
Operating System: Raspberry Pi5 Debian Bookworm
Location: Stewarton, East Ayrshire UK
Contact:

cutils extra sensors

Post by Nossie »

Hi

Bit of housekeeping really - I used to have my extra sensors with a few extra options - but since reverting back in the summer and setting it up again I don't have that config to hand. I think it was just comparing figures to the 'outside' temperature or something - I'm sure I can add that, but if you

I also notice it's only showing a few hours of data - have I missed a setting to allow it to show saved views of 18hrs, 36hours etc

I had a look through the wiki but didn't have much joy - any other suggestions of any easy fixes or QOL changes I could make?


cheers,
Ian.
Ian.

http://www.StewartonWeather.com
Containerised Cumulus[MX] 4.2.1 (build: 4040) ● CumulusUtils Version 7.1.1● Ecowitt 2551/WH65/T&HP/WH57/WH45/3x WH51 ● Pi 5 8GB ● Debian Bookworm ● Ubuntu Server Host
User avatar
HansR
Posts: 6926
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: GW1100 (WS80/WH40)
Operating System: Raspberry OS/Bookworm
Location: Wagenborgen (NL)
Contact:

Re: cutils extra sensors

Post by HansR »

Hi Ian,
Nossie wrote: Sat 06 Jan 2024 10:13 am Bit of housekeeping really - I used to have my extra sensors with a few extra options - but since reverting back in the summer and setting it up again I don't have that config to hand. I think it was just comparing figures to the 'outside' temperature or something - I'm sure I can add that, but if you
That question seems incomplete, I am not sure what you want to achieve so could you be a bit more specific?
Nossie wrote: Sat 06 Jan 2024 10:13 am I also notice it's only showing a few hours of data - have I missed a setting to allow it to show saved views of 18hrs, 36hours etc
The Extra Sensors Charts display as RECENT data i.e. you get a time series for the standard CMX defined nr of hours (Display Options=>Chart hours. If some kind of reset occurred or it loses trach somewhere it restarts filling the JSON's from the beginning. So in your case apparently you did something at 12h31 and now it is 13h38 so you only see 1 hour. It will grow again to three days (like your home charts).

Modifying your Extra or CustomLogs charts resets them.
Nossie wrote: Sat 06 Jan 2024 10:13 am I had a look through the wiki but didn't have much joy - any other suggestions of any easy fixes or QOL changes I could make?
What is QOL?

I will add a line in the wiki about the reset and re-initialisation of the charts
Hans

https://meteo-wagenborgen.nl
CMX build 4070+ ● RPi 4B ● Linux 6.6.62+rpt-rpi-v8 aarch64 (bookworm) ● dotnet 8.0.1
BlueSky: https://bsky.app/profile/wagenborgenwx.bsky.social
User avatar
HansR
Posts: 6926
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: GW1100 (WS80/WH40)
Operating System: Raspberry OS/Bookworm
Location: Wagenborgen (NL)
Contact:

Re: cutils extra sensors

Post by HansR »

And it seems it wants to read Lightning as a timeseries which is kind of strange.
Could you post your CutilsCharts.def (and make sure it is the most recent one generated by the 6.23.1 - so check the filetime)?

And what is the setting of the parameter UserModificationExtraSensorCharts?
Hans

https://meteo-wagenborgen.nl
CMX build 4070+ ● RPi 4B ● Linux 6.6.62+rpt-rpi-v8 aarch64 (bookworm) ● dotnet 8.0.1
BlueSky: https://bsky.app/profile/wagenborgenwx.bsky.social
Nossie
Posts: 424
Joined: Tue 16 Aug 2022 8:01 pm
Weather Station: Ecowitt 2551
Operating System: Raspberry Pi5 Debian Bookworm
Location: Stewarton, East Ayrshire UK
Contact:

Re: cutils extra sensors

Post by Nossie »

Hi Hans,

Apologies I have been working today so didn't really get a chance to respond.

Code: Select all

;
; ChartsCompiler definitions - Part of CumulusUtils
;
; © Copyright 2019 - 2021 Hans Rottier <hans.rottier@gmail.com>
;
; 
; Author:      Hans Rottier <hans.rottier@gmail.com>
; Project:     CumulusUtils meteo-wagenborgen.nl
; Date:        04-09-2021
;
; This file is  part of the distribution. Users may modify this file up to the indicator line
; Anything beyond that line will be removed at generation time (by the ExtraSensors module)
;
; The first set goes to cumuluscharts.txt and is seen as standard charts and obligatory
; These charts may be modified and charts may be added. 
; cumuluscharts.txt is userdefinable but must be present.
;
; The user can create multiple output files. Checkout the Wiki for this.
;
; The bottom part, below the Demarcation line: ExtraSensorCharts
; is filled  in by CumulusUtils and will be replaced every run so don't modify
; unless you set the right to modify through the parameter 'UserModificationExtraSensorCharts' (see Wiki)
;

Chart Overview Title Overview of the  current weather status ConnectsTo 2 4 15 20
  PLOT Temperature Colour #058DC7 zindex 90
  PLOT DewPoint Colour #50B432 zindex 80
  PLOT pressure Colour red zindex 70
  Plot Humidity Colour #64E572 zindex 60
  Plot CurrentSolarRad As Area Opacity 0.2 Colour Orange zindex 20
  Plot RainFall As Area colour #33B4FF opacity 0.2 zindex 10
EndChart

Chart Temperature Title Temperature and derivatives ConnectsTo 1 13 14
  Plot InsideTemp As Spline Colour #DDDF00 zIndex 100
  PLOT Temperature As SPline Colour #058DC7 zindex 90
  PLOT FeelsLike As SPline Colour #ED561B zindex 80
  PLOT DewPoint As SPline Colour #50B432 zindex 70
EndCHART

Chart Wind Title Wind ConnectsTo 5 8
	Plot WindGust
	Plot WindSpeed
EndCHART

Chart WindDirection Title Wind Direction ConnectsTo 6 7 
	Plot Bearing As Scatter
	Plot AverageBearing As Scatter
EndCHART

Chart Rain Title Rain and Rainspeed ConnectsTo 3 21 22
  Plot RainFall As Area Colour green Opacity 0.2
  Plot RainRate zIndex 100
EndChart

Chart Humidity Title Relative Humidity ConnectsTo 11 16
  Plot Humidity
  Plot InsideHumidity
EndChart

Chart Solar Title (Max) Radiation en UV ConnectsTo 12 23 24
	Plot	UV	zIndex 100
	Plot 	CurrentSolarRad As Area Opacity 0.4 Colour Orange zIndex 50 
	Plot	TheoreticalSolarMax As Area Colour Gold zIndex 10 Opacity 0.2
EndChart

CHART DailyTemp TITLE Daily average Temperature with column range
  PLOT DAILY AverageTemp colour green As ColumnRange
  PLOT DAILY AverageTemp colour black As spline
EndChart

CHART DailyPressure TITLE Daily average Barometer with column range
  PLOT DAILY MinBarometer colour Crimson As ColumnRange
  PLOT DAILY AverageBarometer EVAL [ (MinBarometer + MaxBarometer)/2 ] colour black As spline Axis Pressure
EndChart

; DO NOT CHANGE ANYTHING BELOW THIS INDICATOR LINE

When I reinstalled in the summer - I just kept the default settings for this - I have added sensors to it recently but this file was generated at 1pm today.

Code: Select all

[ExtraSensors]
ExtraSensors=true
ParticipatesSensorCommunity=true
ExternalExtraSensors=
UserModificationExtraSensorCharts=false
CleanupExtraSensorslog=true
ExtraTemp=1,2,3,4,5
ExtraHum=1,3,5
ExtraDP=1,3,5
SoilTemp=1
SoilMoisture=1,2,3
AirQuality=
UserTemp=
LeafTemp=
LeafWetness=1
SoilTemperature=1
CO2=1
LightningSensor=true
Regarding high frequency of extra sensors....
My crontab is set to run these modules at the times below

Code: Select all

0 1-23/6 * * * sudo docker exec -i MXWeather mono utils/bin/cumulusutils.exe website
*/10 * * * *   sudo docker exec -i MXWeather mono utils/bin/cumulusutils.exe useraskeddata
*/15 * * * *   sudo docker exec -i MXWeather mono utils/bin/cumulusutils.exe sysinfo
sorry also I just realized how sketchy my initial post was - atleast my boss will be happy I was paying more attention to my job than here :mrgreen:

QOL = Quality of life --- Like I will add the outside temperature etc to contrast the temp, humidity, pressure etc - but I was wondering if there was anything that you could think of I could change to make the data better - thanks.
Ian.

http://www.StewartonWeather.com
Containerised Cumulus[MX] 4.2.1 (build: 4040) ● CumulusUtils Version 7.1.1● Ecowitt 2551/WH65/T&HP/WH57/WH45/3x WH51 ● Pi 5 8GB ● Debian Bookworm ● Ubuntu Server Host
User avatar
HansR
Posts: 6926
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: GW1100 (WS80/WH40)
Operating System: Raspberry OS/Bookworm
Location: Wagenborgen (NL)
Contact:

Re: cutils extra sensors

Post by HansR »

Hi Ian,

Than there is something strange going on.

What I expect to see in the CutilsCharts.def - below the line ; DO NOT CHANGE ANYTHING BELOW THIS INDICATOR LINE - is the charts generated for the Extra Sensors. And apparently something worked because I do see charts appearing and disappearing every half an hour.

I believe your crontab is OK (you may combine the lines for UserAskedData and SysInof if you like btw.

But the important thing is that UserModificationExtraSensorCharts=false which means every time you run the ExtraSensors charts are recreated.

Now I am not sure what the

Code: Select all

0 1-23/6 * * * sudo docker exec -i MXWeather mono utils/bin/cumulusutils.exe website
does. What is your intention here? I think this runs every 6 hours or so. And as it seems, the whole thing resets every half hour or so, I don't know why. The website command should at least run with thrifty.

Now, if the charts are what you want to see, you set UserModificationExtraSensorCharts=true which won't let the system change the charts anymore and you may modify them yourself (change colour, add a ref temperature or whatever etc...). Point is that in the CutilsCharts.def you show, there are no Extra Sensors charts at all. So what file did you show me?

It also tries to load a lightning series which is impossible. This indicates you load an old ExtraSensorsCharts, most likely because it does not create the correct CutilsCharts.def, I don't know why not.

But try the website command with the following line in the crontab:

Code: Select all

6 0 * * * sudo docker exec -i MXWeather mono utils/bin/cumulusutils.exe thrifty website
This will run the website command at 6 minutes past midnight. That should do it.

For now, can you run

Code: Select all

sudo docker exec -i MXWeather mono utils/bin/cumulusutils.exe ExtraSensors
and send me the corresponding logfile and CutilsCharts.def? Thanks
Hans

https://meteo-wagenborgen.nl
CMX build 4070+ ● RPi 4B ● Linux 6.6.62+rpt-rpi-v8 aarch64 (bookworm) ● dotnet 8.0.1
BlueSky: https://bsky.app/profile/wagenborgenwx.bsky.social
Nossie
Posts: 424
Joined: Tue 16 Aug 2022 8:01 pm
Weather Station: Ecowitt 2551
Operating System: Raspberry Pi5 Debian Bookworm
Location: Stewarton, East Ayrshire UK
Contact:

Re: cutils extra sensors

Post by Nossie »

Output of extra sensors

Code: Select all

 pi  Europa  SSH  ~  IOTstack  master  25?  $  sudo docker exec -i MXWeather mono utils/bin/cumulusutils.exe ExtraSensors
2024-01-06 19:34:23.446 CumulusUtils Initial: Shutting down the default listener
2024-01-06 19:34:23.456  CUstrings[xx].ini : CUstringsEN.ini looked for.
2024-01-06 19:34:23.460  CumulusUtils version: 6.23.1
2024-01-06 19:34:23.462  CuSupport constructor : Unit Wind (m/s, mph, km/h, kts): mph
2024-01-06 19:34:23.464  CuSupport constructor : Unit Pressure (mb,hPa,inHg): hPa
2024-01-06 19:34:23.465  CuSupport constructor : Unit Rain (mm,in): mm
2024-01-06 19:34:23.467  CuSupport constructor : Unit T (C,F): ?C
2024-01-06 19:34:23.468  CuSupport constructor : Unit Distance (m, mi, km, kn): mi
2024-01-06 19:34:23.470  CuSupport constructor : Unit Height (m, ft): ft
2024-01-06 19:34:23.476 InetSupport: Constructor start
2024-01-06 19:34:23.482 CumulusUtils : ----------------------------
2024-01-06 19:34:23.483 CumulusUtils : Entering Main
2024-01-06 19:34:23.486 HelpTexts Contructor: start
2024-01-06 19:34:23.499 Checking Mono Version on Linux/Unix
2024-01-06 19:34:23.529 CheckMonoVersion: detected MONO major version: 6 (Mono JIT compiler version 6.8.0.105 (Debian 6.8.0.105+dfsg-2 Wed Feb 26 23:41:24 UTC 2020))
2024-01-06 19:34:23.550 CommandLineArgs : starting
2024-01-06 19:34:23.552  CommandLineArgs : handling arg: ExtraSensors
2024-01-06 19:34:23.554 CommandLineArgs : End
2024-01-06 19:34:23.555 Dayfile: Reading the dayfile.txt...
2024-01-06 19:34:23.559 Dayfile: Detecting Separators...
2024-01-06 19:34:23.561 DetectSeparators: date: / | Field: , | Decimal .
2024-01-06 19:34:23.777 DoExtraSensors - Start
2024-01-06 19:34:23.781 GenerateExtraSensorsRealtime: Writing the ExtraSensors realtime file for the actual sensors found
2024-01-06 19:34:23.783 GenerateExtraSensorsRealtime: <#ExtraTemp1 rc=y> <#ExtraTemp2 rc=y> <#ExtraTemp3 rc=y> <#ExtraTemp4 rc=y> <#ExtraTemp5 rc=y> <#ExtraHum1 rc=y> <#ExtraHum3 rc=y> <#ExtraHum5 rc=y> <#ExtraDP1 rc=y> <#ExtraDP3 rc=y> <#ExtraDP5 rc=y> <#SoilTemp1 rc=y> <#SoilMoisture1 rc=y> <#SoilMoisture2 rc=y> <#SoilMoisture3 rc=y> <#LeafWetness1 rc=y> <#CO2 rc=y> <#CO2-24h rc=y> <#CO2-pm2p5 rc=y> <#CO2-pm2p5-24h rc=y> <#CO2-pm10 rc=y> <#CO2-pm10-24h rc=y> <#CO2-temp rc=y> <#CO2-hum rc=y> <#LightningStrikesToday> <#LightningTime format="g"> <#LightningDistance rc=y>
2024-01-06 19:34:23.788 GenerateExtraSensorsCharts: Generating the ExtraSensor Charts CDL code into utils/CutilsCharts.def...
2024-01-06 19:34:23.790 GenerateExtraSensorsCharts: Testing UserModificationExtraSensorCharts: false
2024-01-06 19:34:23.847 GenerateExtraSensorsCharts: Writing the CutilsCharts.def
2024-01-06 19:34:23.868 GenerateExtraSensorsModule: Generating the Module Javascript code...
2024-01-06 19:34:23.886 DoExtraSensors - Stop
2024-01-06 19:34:23.925 DefineUsercharts: Parsing User charts definitions - start
2024-01-06 19:34:23.969 Compiler - CodeGen: cumuluscharts.txt
2024-01-06 19:34:24.034 Compiler - Creating Axis for Overview
2024-01-06 19:34:24.039 Compiler - Creating Axis for Overview
2024-01-06 19:34:24.067 Compiler - Creating Axis for Temperature
2024-01-06 19:34:24.070 Compiler - Creating Axis for Temperature
2024-01-06 19:34:24.082 Compiler - Creating Axis for Wind
2024-01-06 19:34:24.085 Compiler - Creating Axis for Wind
2024-01-06 19:34:24.092 Compiler - Creating Axis for WindDirection
2024-01-06 19:34:24.096 Compiler - Creating Axis for WindDirection
2024-01-06 19:34:24.102 Compiler - Creating Axis for Rain
2024-01-06 19:34:24.106 Compiler - Creating Axis for Rain
2024-01-06 19:34:24.114 Compiler - Creating Axis for Humidity
2024-01-06 19:34:24.117 Compiler - Creating Axis for Humidity
2024-01-06 19:34:24.124 Compiler - Creating Axis for Solar
2024-01-06 19:34:24.127 Compiler - Creating Axis for Solar
2024-01-06 19:34:24.137 Compiler - Creating Axis for DailyTemp
2024-01-06 19:34:24.141 Compiler - Creating Axis for DailyTemp
2024-01-06 19:34:24.147 Compiler - Creating Axis for DailyPressure
2024-01-06 19:34:24.151 Compiler - Creating Axis for DailyPressure
2024-01-06 19:34:24.174 Compiler - CodeGen: cumuluscharts.txt Finished
2024-01-06 19:34:24.189 Testing PHP upload compression on http://stewartonweather.com/upload.php
2024-01-06 19:34:24.396 Compiler - CodeGen: extrasensorscharts.txt
2024-01-06 19:34:24.442 Compiler - Creating Axis for ExtraTemperature
2024-01-06 19:34:24.446 Compiler - Creating Axis for ExtraTemperature
2024-01-06 19:34:24.457 Compiler - Creating Axis for ExtraHumidity
2024-01-06 19:34:24.460 Compiler - Creating Axis for ExtraHumidity
2024-01-06 19:34:24.468 Compiler - Creating Axis for ExtraDewPoint
2024-01-06 19:34:24.472 Compiler - Creating Axis for ExtraDewPoint
2024-01-06 19:34:24.480 Compiler - Creating Axis for ExtraSoilTemp
2024-01-06 19:34:24.483 Compiler - Creating Axis for ExtraSoilTemp
2024-01-06 19:34:24.488 Compiler - Creating Axis for ExtraSoilMoisture
2024-01-06 19:34:24.491 Compiler - Creating Axis for ExtraSoilMoisture
2024-01-06 19:34:24.499 Compiler - Creating Axis for ExtraLeafWetness
2024-01-06 19:34:24.502 Compiler - Creating Axis for ExtraLeafWetness
2024-01-06 19:34:24.507 Compiler - Creating Axis for ExtraCO2
2024-01-06 19:34:24.510 Compiler - Creating Axis for ExtraCO2
2024-01-06 19:34:24.556 Compiler - CodeGen: extrasensorscharts.txt Finished
2024-01-06 19:34:24.692 All done, Entering the finally section...; Closing down.
2024-01-06 19:34:24.693 Disposing Isup...
2024-01-06 19:34:24.695 Disposing Sup...
2024-01-06 19:34:24.699 Ready...
checking the def files again to see , No - double checked in the utils folder from here, and I logged into the container and checked there too - both files have the same output

Oh I changed the crontab to use your interval and thrifty
Ian.

http://www.StewartonWeather.com
Containerised Cumulus[MX] 4.2.1 (build: 4040) ● CumulusUtils Version 7.1.1● Ecowitt 2551/WH65/T&HP/WH57/WH45/3x WH51 ● Pi 5 8GB ● Debian Bookworm ● Ubuntu Server Host
User avatar
HansR
Posts: 6926
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: GW1100 (WS80/WH40)
Operating System: Raspberry OS/Bookworm
Location: Wagenborgen (NL)
Contact:

Re: cutils extra sensors

Post by HansR »

Nossie wrote: Sat 06 Jan 2024 7:35 pm Output of extra sensors

Code: Select all

 pi  Europa  SSH  ~  IOTstack  master  25?  $  sudo docker exec -i MXWeather mono utils/bin/cumulusutils.exe ExtraSensors
2024-01-06 19:34:23.446 CumulusUtils Initial: Shutting down the default listener
2024-01-06 19:34:23.456  CUstrings[xx].ini : CUstringsEN.ini looked for.
2024-01-06 19:34:23.460  CumulusUtils version: 6.23.1
2024-01-06 19:34:23.462  CuSupport constructor : Unit Wind (m/s, mph, km/h, kts): mph
2024-01-06 19:34:23.464  CuSupport constructor : Unit Pressure (mb,hPa,inHg): hPa
2024-01-06 19:34:23.465  CuSupport constructor : Unit Rain (mm,in): mm
2024-01-06 19:34:23.467  CuSupport constructor : Unit T (C,F): ?C
2024-01-06 19:34:23.468  CuSupport constructor : Unit Distance (m, mi, km, kn): mi
2024-01-06 19:34:23.470  CuSupport constructor : Unit Height (m, ft): ft
2024-01-06 19:34:23.476 InetSupport: Constructor start
2024-01-06 19:34:23.482 CumulusUtils : ----------------------------
2024-01-06 19:34:23.483 CumulusUtils : Entering Main
2024-01-06 19:34:23.486 HelpTexts Contructor: start
2024-01-06 19:34:23.499 Checking Mono Version on Linux/Unix
2024-01-06 19:34:23.529 CheckMonoVersion: detected MONO major version: 6 (Mono JIT compiler version 6.8.0.105 (Debian 6.8.0.105+dfsg-2 Wed Feb 26 23:41:24 UTC 2020))
2024-01-06 19:34:23.550 CommandLineArgs : starting
2024-01-06 19:34:23.552  CommandLineArgs : handling arg: ExtraSensors
2024-01-06 19:34:23.554 CommandLineArgs : End
2024-01-06 19:34:23.555 Dayfile: Reading the dayfile.txt...
2024-01-06 19:34:23.559 Dayfile: Detecting Separators...
2024-01-06 19:34:23.561 DetectSeparators: date: / | Field: , | Decimal .
2024-01-06 19:34:23.777 DoExtraSensors - Start
2024-01-06 19:34:23.781 GenerateExtraSensorsRealtime: Writing the ExtraSensors realtime file for the actual sensors found
2024-01-06 19:34:23.783 GenerateExtraSensorsRealtime: <#ExtraTemp1 rc=y> <#ExtraTemp2 rc=y> <#ExtraTemp3 rc=y> <#ExtraTemp4 rc=y> <#ExtraTemp5 rc=y> <#ExtraHum1 rc=y> <#ExtraHum3 rc=y> <#ExtraHum5 rc=y> <#ExtraDP1 rc=y> <#ExtraDP3 rc=y> <#ExtraDP5 rc=y> <#SoilTemp1 rc=y> <#SoilMoisture1 rc=y> <#SoilMoisture2 rc=y> <#SoilMoisture3 rc=y> <#LeafWetness1 rc=y> <#CO2 rc=y> <#CO2-24h rc=y> <#CO2-pm2p5 rc=y> <#CO2-pm2p5-24h rc=y> <#CO2-pm10 rc=y> <#CO2-pm10-24h rc=y> <#CO2-temp rc=y> <#CO2-hum rc=y> <#LightningStrikesToday> <#LightningTime format="g"> <#LightningDistance rc=y>
2024-01-06 19:34:23.788 GenerateExtraSensorsCharts: Generating the ExtraSensor Charts CDL code into utils/CutilsCharts.def...
2024-01-06 19:34:23.790 GenerateExtraSensorsCharts: Testing UserModificationExtraSensorCharts: false
2024-01-06 19:34:23.847 GenerateExtraSensorsCharts: Writing the CutilsCharts.def
2024-01-06 19:34:23.868 GenerateExtraSensorsModule: Generating the Module Javascript code...
2024-01-06 19:34:23.886 DoExtraSensors - Stop
2024-01-06 19:34:23.925 DefineUsercharts: Parsing User charts definitions - start
2024-01-06 19:34:23.969 Compiler - CodeGen: cumuluscharts.txt
2024-01-06 19:34:24.034 Compiler - Creating Axis for Overview
2024-01-06 19:34:24.039 Compiler - Creating Axis for Overview
2024-01-06 19:34:24.067 Compiler - Creating Axis for Temperature
2024-01-06 19:34:24.070 Compiler - Creating Axis for Temperature
2024-01-06 19:34:24.082 Compiler - Creating Axis for Wind
2024-01-06 19:34:24.085 Compiler - Creating Axis for Wind
2024-01-06 19:34:24.092 Compiler - Creating Axis for WindDirection
2024-01-06 19:34:24.096 Compiler - Creating Axis for WindDirection
2024-01-06 19:34:24.102 Compiler - Creating Axis for Rain
2024-01-06 19:34:24.106 Compiler - Creating Axis for Rain
2024-01-06 19:34:24.114 Compiler - Creating Axis for Humidity
2024-01-06 19:34:24.117 Compiler - Creating Axis for Humidity
2024-01-06 19:34:24.124 Compiler - Creating Axis for Solar
2024-01-06 19:34:24.127 Compiler - Creating Axis for Solar
2024-01-06 19:34:24.137 Compiler - Creating Axis for DailyTemp
2024-01-06 19:34:24.141 Compiler - Creating Axis for DailyTemp
2024-01-06 19:34:24.147 Compiler - Creating Axis for DailyPressure
2024-01-06 19:34:24.151 Compiler - Creating Axis for DailyPressure
2024-01-06 19:34:24.174 Compiler - CodeGen: cumuluscharts.txt Finished
2024-01-06 19:34:24.189 Testing PHP upload compression on http://stewartonweather.com/upload.php
2024-01-06 19:34:24.396 Compiler - CodeGen: extrasensorscharts.txt
2024-01-06 19:34:24.442 Compiler - Creating Axis for ExtraTemperature
2024-01-06 19:34:24.446 Compiler - Creating Axis for ExtraTemperature
2024-01-06 19:34:24.457 Compiler - Creating Axis for ExtraHumidity
2024-01-06 19:34:24.460 Compiler - Creating Axis for ExtraHumidity
2024-01-06 19:34:24.468 Compiler - Creating Axis for ExtraDewPoint
2024-01-06 19:34:24.472 Compiler - Creating Axis for ExtraDewPoint
2024-01-06 19:34:24.480 Compiler - Creating Axis for ExtraSoilTemp
2024-01-06 19:34:24.483 Compiler - Creating Axis for ExtraSoilTemp
2024-01-06 19:34:24.488 Compiler - Creating Axis for ExtraSoilMoisture
2024-01-06 19:34:24.491 Compiler - Creating Axis for ExtraSoilMoisture
2024-01-06 19:34:24.499 Compiler - Creating Axis for ExtraLeafWetness
2024-01-06 19:34:24.502 Compiler - Creating Axis for ExtraLeafWetness
2024-01-06 19:34:24.507 Compiler - Creating Axis for ExtraCO2
2024-01-06 19:34:24.510 Compiler - Creating Axis for ExtraCO2
2024-01-06 19:34:24.556 Compiler - CodeGen: extrasensorscharts.txt Finished
2024-01-06 19:34:24.692 All done, Entering the finally section...; Closing down.
2024-01-06 19:34:24.693 Disposing Isup...
2024-01-06 19:34:24.695 Disposing Sup...
2024-01-06 19:34:24.699 Ready...
Ok, this looks good and apparently the CutilsCharts is now written correctly.
Nossie wrote: Sat 06 Jan 2024 7:35 pm checking the def files again to see , No - double checked in the utils folder from here, and I logged into the container and checked there too - both files have the same output
Well, that is strange as the file you posted in your first post definitely does not have any ExtraSensors charts so I am not sure what you are looking at.
Nossie wrote: Sat 06 Jan 2024 7:35 pm Oh I changed the crontab to use your interval and thrifty
OK.

Still, currently I do not see ExtraSensors Charts on your site so I think you are mixing up some things.

Back to the drawing board: Run your website command without thrifty and with the parameter TraceInfoLevel=info. When done send me the whole logfile as an attachment please.
Hans

https://meteo-wagenborgen.nl
CMX build 4070+ ● RPi 4B ● Linux 6.6.62+rpt-rpi-v8 aarch64 (bookworm) ● dotnet 8.0.1
BlueSky: https://bsky.app/profile/wagenborgenwx.bsky.social
Nossie
Posts: 424
Joined: Tue 16 Aug 2022 8:01 pm
Weather Station: Ecowitt 2551
Operating System: Raspberry Pi5 Debian Bookworm
Location: Stewarton, East Ayrshire UK
Contact:

Re: cutils extra sensors

Post by Nossie »

Thanks for the message Hans,

here are those files - cheers.
You do not have the required permissions to view the files attached to this post.
Ian.

http://www.StewartonWeather.com
Containerised Cumulus[MX] 4.2.1 (build: 4040) ● CumulusUtils Version 7.1.1● Ecowitt 2551/WH65/T&HP/WH57/WH45/3x WH51 ● Pi 5 8GB ● Debian Bookworm ● Ubuntu Server Host
User avatar
HansR
Posts: 6926
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: GW1100 (WS80/WH40)
Operating System: Raspberry OS/Bookworm
Location: Wagenborgen (NL)
Contact:

Re: cutils extra sensors

Post by HansR »

So far I cannot really explain what is going on. The only really weird thing is that it tries to create a timeseries for the Lightning sensor (which it can't according to the code because if the ExtraSensor type is 'Lightning' it skips the generation of the Chart. But in your case it does not.

The second point is that you do a cleanup of the ExtraSensor logs, that may be causing an issue.

So I suggest:
  1. Set LightningSensor=false
  2. Set CleanupExtraSensorslog=false
Run again and post the logfile (and check if the charts go beyond an hour).

Could you post the CutilsCharts.def as well (rename it to CutilsCharts.def.txt to be able to post)
Hans

https://meteo-wagenborgen.nl
CMX build 4070+ ● RPi 4B ● Linux 6.6.62+rpt-rpi-v8 aarch64 (bookworm) ● dotnet 8.0.1
BlueSky: https://bsky.app/profile/wagenborgenwx.bsky.social
Nossie
Posts: 424
Joined: Tue 16 Aug 2022 8:01 pm
Weather Station: Ecowitt 2551
Operating System: Raspberry Pi5 Debian Bookworm
Location: Stewarton, East Ayrshire UK
Contact:

Re: cutils extra sensors

Post by Nossie »

done what you asked and have updated - will wait a few hours and see what happens, thanks!
You do not have the required permissions to view the files attached to this post.
Ian.

http://www.StewartonWeather.com
Containerised Cumulus[MX] 4.2.1 (build: 4040) ● CumulusUtils Version 7.1.1● Ecowitt 2551/WH65/T&HP/WH57/WH45/3x WH51 ● Pi 5 8GB ● Debian Bookworm ● Ubuntu Server Host
User avatar
HansR
Posts: 6926
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: GW1100 (WS80/WH40)
Operating System: Raspberry OS/Bookworm
Location: Wagenborgen (NL)
Contact:

Re: cutils extra sensors

Post by HansR »

OK, it still does not cross the hour boundary apparently.

Could you post the UserAskedData log please? (on info level)
Hans

https://meteo-wagenborgen.nl
CMX build 4070+ ● RPi 4B ● Linux 6.6.62+rpt-rpi-v8 aarch64 (bookworm) ● dotnet 8.0.1
BlueSky: https://bsky.app/profile/wagenborgenwx.bsky.social
Nossie
Posts: 424
Joined: Tue 16 Aug 2022 8:01 pm
Weather Station: Ecowitt 2551
Operating System: Raspberry Pi5 Debian Bookworm
Location: Stewarton, East Ayrshire UK
Contact:

Re: cutils extra sensors

Post by Nossie »

Code: Select all

 pi  Europa  SSH  ~  $  sudo docker exec -i MXWeather mono utils/bin/cumulusutils.exe useraskeddata
2024-01-07 10:37:49.947 CumulusUtils Initial: Shutting down the default listener
2024-01-07 10:37:49.958  CUstrings[xx].ini : CUstringsEN.ini looked for.
2024-01-07 10:37:49.962  CumulusUtils version: 6.23.1
2024-01-07 10:37:49.964  CuSupport constructor : Unit Wind (m/s, mph, km/h, kts): mph
2024-01-07 10:37:49.965  CuSupport constructor : Unit Pressure (mb,hPa,inHg): hPa
2024-01-07 10:37:49.967  CuSupport constructor : Unit Rain (mm,in): mm
2024-01-07 10:37:49.969  CuSupport constructor : Unit T (C,F): ?C
2024-01-07 10:37:49.971  CuSupport constructor : Unit Distance (m, mi, km, kn): mi
2024-01-07 10:37:49.972  CuSupport constructor : Unit Height (m, ft): ft
2024-01-07 10:37:49.979 InetSupport: Constructor start
2024-01-07 10:37:49.985 CumulusUtils : ----------------------------
2024-01-07 10:37:49.987 CumulusUtils : Entering Main
2024-01-07 10:37:49.989 HelpTexts Contructor: start
2024-01-07 10:37:50.007 Checking Mono Version on Linux/Unix
2024-01-07 10:37:50.039 CheckMonoVersion: detected MONO major version: 6 (Mono JIT compiler version 6.8.0.105 (Debian 6.8.0.105+dfsg-2 Wed Feb 26 23:41:24 UTC 2020))
2024-01-07 10:37:50.058 CommandLineArgs : starting
2024-01-07 10:37:50.060  CommandLineArgs : handling arg: useraskeddata
2024-01-07 10:37:50.062 CommandLineArgs : End
2024-01-07 10:37:50.064 Dayfile: Reading the dayfile.txt...
2024-01-07 10:37:50.066 Dayfile: Detecting Separators...
2024-01-07 10:37:50.068 DetectSeparators: date: / | Field: , | Decimal .
2024-01-07 10:37:50.096 MapsOn: Start
2024-01-07 10:37:50.122 DateIsToday: thisSpan: 13:37:49.1201000 | thisSpan.TotalDays = 0.567929630787037
2024-01-07 10:37:50.124 DateIsToday returning True
2024-01-07 10:37:50.485 DefineUsercharts: Parsing User charts definitions - start
2024-01-07 10:37:50.522 Generating Compiler UserAskedData: Start
2024-01-07 10:37:50.526 Monthfile constructor: Using fixed path: | data/ |; file: | *log.txt
2024-01-07 10:37:50.742 DetectSeparators: date: / | Field: , | Decimal .
2024-01-07 10:37:50.750 ReadPartialMonthlyLogs: start.
2024-01-07 10:37:50.884 DateIsToday: thisSpan: 13:37:47.8814280 | thisSpan.TotalDays = 0.567915294305556
2024-01-07 10:37:50.887 DateIsToday returning True
2024-01-07 10:37:50.948 DoAirLink / AirQualitySensor  = False / False
2024-01-07 10:37:51.247 DetectSeparators: date: / | Field: , | Decimal .
2024-01-07 10:37:51.396 Testing PHP upload compression on http://stewartonweather.com/upload.php
2024-01-07 10:37:51.584 All done, Entering the finally section...; Closing down.
2024-01-07 10:37:51.585 Disposing Isup...
2024-01-07 10:37:51.587 Disposing Sup...
2024-01-07 10:37:51.597 Ready...
This you mean sorry?
Ian.

http://www.StewartonWeather.com
Containerised Cumulus[MX] 4.2.1 (build: 4040) ● CumulusUtils Version 7.1.1● Ecowitt 2551/WH65/T&HP/WH57/WH45/3x WH51 ● Pi 5 8GB ● Debian Bookworm ● Ubuntu Server Host
User avatar
HansR
Posts: 6926
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: GW1100 (WS80/WH40)
Operating System: Raspberry OS/Bookworm
Location: Wagenborgen (NL)
Contact:

Re: cutils extra sensors

Post by HansR »

And while we are at it: can you explain the CO2 24hr avg dip every now and then?
Hans

https://meteo-wagenborgen.nl
CMX build 4070+ ● RPi 4B ● Linux 6.6.62+rpt-rpi-v8 aarch64 (bookworm) ● dotnet 8.0.1
BlueSky: https://bsky.app/profile/wagenborgenwx.bsky.social
User avatar
HansR
Posts: 6926
Joined: Sat 20 Oct 2012 6:53 am
Weather Station: GW1100 (WS80/WH40)
Operating System: Raspberry OS/Bookworm
Location: Wagenborgen (NL)
Contact:

Re: cutils extra sensors

Post by HansR »

Nossie wrote: Sun 07 Jan 2024 10:38 am This you mean sorry?
Yes, that's one of those :D
(I may be asking some other logs but this will doe for now... strange issue)

You can see from these lines:

Code: Select all

2024-01-07 10:37:50.058 CommandLineArgs : starting
2024-01-07 10:37:50.060  CommandLineArgs : handling arg: useraskeddata
2024-01-07 10:37:50.062 CommandLineArgs : End
I'll get back to you.

[EDIT:] Oh, and I prefer to have this info being attached as file if possible
Hans

https://meteo-wagenborgen.nl
CMX build 4070+ ● RPi 4B ● Linux 6.6.62+rpt-rpi-v8 aarch64 (bookworm) ● dotnet 8.0.1
BlueSky: https://bsky.app/profile/wagenborgenwx.bsky.social
Nossie
Posts: 424
Joined: Tue 16 Aug 2022 8:01 pm
Weather Station: Ecowitt 2551
Operating System: Raspberry Pi5 Debian Bookworm
Location: Stewarton, East Ayrshire UK
Contact:

Re: cutils extra sensors

Post by Nossie »

HansR wrote: Sun 07 Jan 2024 10:40 am And while we are at it: can you explain the CO2 24hr avg dip every now and then?
Nope - I noticed it starting to happen a month or so ago


also - future logs will be attachments.
You do not have the required permissions to view the files attached to this post.
Ian.

http://www.StewartonWeather.com
Containerised Cumulus[MX] 4.2.1 (build: 4040) ● CumulusUtils Version 7.1.1● Ecowitt 2551/WH65/T&HP/WH57/WH45/3x WH51 ● Pi 5 8GB ● Debian Bookworm ● Ubuntu Server Host
Post Reply