Welcome to the Cumulus Support forum.

Latest Cumulus MX V4 release 4.4.2 (build 4085) - 12 March 2025

Latest Cumulus MX V3 release 3.28.6 (build 3283) - 21 March 2024

Legacy Cumulus 1 release 1.9.4 (build 1099) - 28 November 2014
(a patch is available for 1.9.4 build 1099 that extends the date range of drop-down menus to 2030)

Download the Software (Cumulus MX / Cumulus 1 and other related items) from the Wiki

If you are posting a new Topic about an error or if you need help PLEASE read this first viewtopic.php?p=164080#p164080

FTP giving up with realtime.txt file

From build 3044 the development baton passed to Mark Crossley. Mark has been responsible for all the Builds since. He has made the code available on GitHub. It is Mark's hope that others will join in this development, but at the very least he welcomes your ideas for future developments (see Cumulus MX Development suggestions).

Moderator: mcrossley

Post Reply
kenthcwx
Posts: 7
Joined: Thu 03 Jun 2021 10:01 pm
Weather Station: Fine Offset/GW1000
Operating System: Raspberry Pi 4
Location: Herne Bay, Kent
Contact:
Contact kenthcwx

FTP giving up with realtime.txt file

Post by kenthcwx »

Hi all

Another issue seems to have arisen with the FTP of my realtime.txt file as it seems to 'give up' trying to send the data. Took 7 minutes after 10 am today to send its last signal before nothing else is seen in the ftplog. No update to the realtime.txt file on the website was seen after 10:07:10.

ftplog:
2022-11-01 10:07:10.850 Realtime[38]: Uploading - realtime.txt

2022-11-01 10:07:10.851 FTP[38]: Uploading realtime.txt to /cumulus/realtime.txt

# UploadFile("realtime.txt", "/cumulus/realtime.txt", Overwrite, False, None)

# FileExists("/cumulus/realtime.txt")
Command: SIZE /cumulus/realtime.txt
Response: 213 278

# DeleteFile("/cumulus/realtime.txt")
Command: DELE /cumulus/realtime.txt
Response: 250 Deleted /cumulus/realtime.txt

# OpenWrite("/cumulus/realtime.txt", Binary)

# GetFileSize("/cumulus/realtime.txt")
Command: SIZE /cumulus/realtime.txt
Response: 550 Can't check for file existence

# OpenPassiveDataStream(PASV, "STOR /cumulus/realtime.txt", 0)
Command: PRET STOR /cumulus/realtime.txt
Response: 200 Ready to proceed
Command: PASV
Response: 227 Entering Passive Mode (82,163,176,83,212,119)
Status: Connecting to 82.163.176.83:54391
Command: STOR /cumulus/realtime.txt
Response: 150 Accepted data connection
Status: FTPS Authentication Successful
Status: Time to activate encryption: 0h 0m 0s. Total Seconds: 0.097566.
Status: Disposing FtpSocketStream...
Response: 226-File successfully transferred
Response: 226 0.028 seconds (measured here), 9.67 Kbytes per second

I'll attach the MXdiags file from this morning, would have done the same for the ftplog but it was too big!
20221101-100023.txt
Can't seem to find anything giving a blatant error for the realtime.txt at all, might be another setting that I've forgotten to tick or something!

Any help is greatly appreciated
Jamie
You do not have the required permissions to view the files attached to this post.
Top
User avatar
PaulMy
Posts: 4355
Joined: Sun 28 Sep 2008 11:54 pm
Weather Station: Davis VP2 Plus 24-Hour FARS
Operating System: Windows8 and Windows10
Location: Komoka, ON Canada
Contact:
Contact PaulMy

Re: FTP giving up with realtime.txt file

Post by PaulMy »

Hi,

Code: Select all

2022-11-01 10:11:40.064 Realtime[65]: Start cycle
2022-11-01 10:11:40.064 Realtime[65]: Warning, a previous cycle is still processing local files. Skipping this interval.
2022-11-01 10:11:40.065 Realtime[65]: End cycle
2022-11-01 10:11:41.672 ProcessExtraData: Processing posted data
2022-11-01 10:11:41.679 ProcessExtraData: Payload = PASSKEY=<PassKey>&stationtype=GW1000A_V1.7.5&runtime=6637851&dateutc=2022-11-01+10:11:41&tempinf=64.04&humidityin=77&baromrelin=29.775&baromabsin=29.725&tempf=59.00&humidity=81&winddir=114&windspeedmph=2.01&windgustmph=6.93&maxdailygust=26.17&solarradiation=89.31&uv=0&rainratein=0.000&eventrainin=0.118&hourlyrainin=0.000&dailyrainin=0.008&weeklyrainin=0.189&monthlyrainin=0.008&yearlyrainin=13.268&totalrainin=13.268&temp1f=59.00&soilmoisture1=48&tf_ch1=58.28&wh65batt=0&wh40batt=1.5&wh26batt=0&batt1=1&soilbatt1=1.0&tf_batt1=1.62&freq=868M&model=GW1000A_Pro
2022-11-01 10:11:41.682 ApplyExtraData: Complete
2022-11-01 10:11:41.688 ProcessExtraData: Complete
2022-11-01 10:11:45.073 Realtime[64]: Error encountered during MySQL operation = Connect Timeout expired.
2022-11-01 10:11:45.074 Realtime[64]: Error - Object reference not set to an instance of an object.
2022-11-01 10:11:46.666 Reading live data
2022-11-01 10:11:46.690 DoCommand(CMD_GW1000_LIVEDATA): Valid response
2022-11-01 10:11:46.691 Received: FF-FF-27-00-49-01-00-B2-06-4D-08-27-52-09-27-63-02-00-96-07-51-0A-00-68-0B-00-0A-0C-00-0A-15-00-01-C6-B0-16-00-36-17-00-2C-30-1A-00-96-19-00-75-0E-00-00-10-00-02-11-00-30-12-00-00-00-02-13-00-00-0D-2A-0D-00-1E-63-00-92-51-D0
2022-11-01 10:11:46.692 LiveData: Wind Decode >> Last=2.2, LastDir=104, Gust=2.2, (MXAvg=3.2)
2022-11-01 10:11:46.713 Writing to Month.ini file
2022-11-01 10:11:46.716 End writing to Month.ini file
2022-11-01 10:11:46.717 Alarm (Battery Low): Trigger cleared
2022-11-01 10:11:50.064 Realtime[66]: Start cycle
2022-11-01 10:11:50.064 Realtime[66]: Warning, a previous cycle is still processing local files. Skipping this interval.
2022-11-01 10:11:50.065 Realtime[66]: End cycle
Many repeats of "Skipping this interval" and error messages.

Code: Select all

2022-11-01 10:06:33.730 Realtime[31]: Uploading extra web file[49] ./web/winddata.jsontmp to /saratoga/winddata.json
2022-11-01 10:06:33.731 FTP[31]: Uploading ./web/winddata.jsontmp to /saratoga/winddata.json
2022-11-01 10:06:34.335 Realtime[31]: End cycle
2022-11-01 10:06:35.581 Realtime[33]: Error encountered during MySQL operation = Connect Timeout expired.
2022-11-01 10:06:35.582 Realtime[33]: Error - Object reference not set to an instance of an object.
2022-11-01 10:06:40.046 Realtime[35]: Start cycle
2022-11-01 10:06:40.046 Realtime[35]: Creating realtime.txt
2022-11-01 10:06:40.047 Realtime[35]: Processing realtime file - realtimegauges.txt
2022-11-01 10:06:40.052 Realtime[35]: Processing extra file[2] - ./webfiles/WXtags-template-files/CUtags-comments.txt
2022-11-01 10:06:40.205 Realtime[35]: Processing extra file[3] - ./web/websitedataT.json
2022-11-01 10:06:40.245 Realtime[35]: Processing extra file[4] - ./web/realtimegaugesT.txt
2022-11-01 10:06:40.248 Realtime[35]: Processing extra file[5] - ./web/alldailytempdata.json
2022-11-01 10:06:40.266 Realtime[35]: Processing extra file[6] - ./web/alldailydegdaydata.json
2022-11-01 10:06:40.281 Realtime[35]: Processing extra file[7] - ./web/alldailyhumdata.json
2022-11-01 10:06:40.285 Realtime[35]: Processing extra file[8] - ./web/alldailyraindata.json
2022-11-01 10:06:40.289 Realtime[35]: Processing extra file[9] - ./web/alldailysolardata.json
2022-11-01 10:06:40.292 Realtime[35]: Processing extra file[10] - ./web/alldailywinddata.json
2022-11-01 10:06:40.295 Realtime[35]: Processing extra file[11] - ./web/availabledata.json
2022-11-01 10:06:40.297 Realtime[35]: Processing extra file[12] - ./web/alltempsumdata.json
2022-11-01 10:06:40.300 Realtime[35]: Processing extra file[13] - ./web/graphconfig.json
2022-11-01 10:06:40.302 Realtime[35]: Processing extra file[15] - ./web/dailyrain.json
2022-11-01 10:06:40.306 Realtime[35]: Processing extra file[16] - ./web/dailytemp.json
2022-11-01 10:06:40.307 Realtime[35]: Processing extra file[17] - ./web/humdata.json
2022-11-01 10:06:40.326 Realtime[35]: Processing extra file[18] - ./web/pressdata.json
2022-11-01 10:06:40.334 Realtime[35]: Processing extra file[19] - ./web/raindata.json
2022-11-01 10:06:40.349 Realtime[35]: Processing extra file[20] - ./web/solardata.json
2022-11-01 10:06:40.377 Realtime[35]: Processing extra file[21] - ./web/sunhours.json
2022-11-01 10:06:40.378 Realtime[35]: Processing extra file[22] - ./web/tempdata.json
2022-11-01 10:06:40.476 Realtime[35]: Processing extra file[23] - ./web/wdirdata.json
2022-11-01 10:06:40.496 Realtime[35]: Processing extra file[24] - ./web/winddata.json
2022-11-01 10:06:40.509 Realtime[35]: Processing extra file[25] - ./extra_sensors/extra_cu.txt
2022-11-01 10:06:40.512 Realtime[35]: Processing extra file[28] - ./realtime.txt
2022-11-01 10:06:40.513 Realtime[35]: Processing extra file[30] - ./web/alldailytempdata.json
2022-11-01 10:06:40.523 Realtime[35]: Processing extra file[31] - ./web/alldailydegdaydata.json
2022-11-01 10:06:40.528 Realtime[35]: Processing extra file[32] - ./web/alldailyhumdata.json
2022-11-01 10:06:40.532 Realtime[35]: Processing extra file[33] - ./web/alldailyraindata.json
2022-11-01 10:06:40.534 Realtime[35]: Processing extra file[34] - ./web/alldailysolardata.json
2022-11-01 10:06:40.536 Realtime[35]: Processing extra file[35] - ./web/alldailywinddata.json
2022-11-01 10:06:40.540 Realtime[35]: Processing extra file[36] - ./web/alltempsumdata.json
2022-11-01 10:06:40.542 Realtime[35]: Processing extra file[38] - ./web/realtimegaugesT.txt
2022-11-01 10:06:40.545 Realtime[35]: Processing extra file[40] - ./web/dailyrain.json
2022-11-01 10:06:40.546 Realtime[35]: Processing extra file[41] - ./web/dailytemp.json
2022-11-01 10:06:40.546 Realtime[35]: Processing extra file[42] - ./web/humdata.json
2022-11-01 10:06:40.573 Realtime[35]: Processing extra file[43] - ./web/pressdata.json
2022-11-01 10:06:40.589 Realtime[35]: Processing extra file[44] - ./web/raindata.json
2022-11-01 10:06:40.608 Realtime[35]: Processing extra file[45] - ./web/solardata.json
2022-11-01 10:06:40.630 Realtime[35]: Processing extra file[46] - ./web/sunhours.json
2022-11-01 10:06:40.631 Realtime[35]: Processing extra file[47] - ./web/tempdata.json
2022-11-01 10:06:40.722 Realtime[35]: Processing extra file[48] - ./web/wdirdata.json
2022-11-01 10:06:40.749 Realtime[35]: Processing extra file[49] - ./web/winddata.json
2022-11-01 10:06:40.770 Realtime[35]: Uploading - realtime.txt
2022-11-01 10:06:40.771 FTP[35]: Uploading realtime.txt to /cumulus/realtime.txt
2022-11-01 10:06:41.154 Realtime[35]: Uploading - realtimegauges.txt
2022-11-01 10:06:41.155 FTP[35]: Uploading web/realtimegauges.txt to /cumulus/realtimegauges.txt
2022-11-01 10:06:41.494 Realtime[35]: Uploading extra web file[2] ./webfiles/WXtags-template-files/CUtags-comments.txttmp to /saratoga/CUtags.php
2022-11-01 10:06:41.494 FTP[35]: Uploading ./webfiles/WXtags-template-files/CUtags-comments.txttmp to /saratoga/CUtags.php
Am I understanding correctly that you are sending all those extra web files at realtime, and if so, why? Not much time for the real realtime files to get updated.

Enjoy,
Paul
VP2+
C1 www.komokaweather.com/komokaweather-ca
MX https://komokaweather.com/cumulusmx/index.htm /index.html /index.php
MX https://komokaweather.com/cumulusmxwll/index.htm /index.html /index.php
MX https:// komokaweather.com/cumulusmx4/index.htm
Image
Top
kenthcwx
Posts: 7
Joined: Thu 03 Jun 2021 10:01 pm
Weather Station: Fine Offset/GW1000
Operating System: Raspberry Pi 4
Location: Herne Bay, Kent
Contact:
Contact kenthcwx

Re: FTP giving up with realtime.txt file

Post by kenthcwx »

PaulMy wrote: ↑Tue 01 Nov 2022 2:11 pm Hi,

Code: Select all

2022-11-01 10:11:40.064 Realtime[65]: Start cycle
2022-11-01 10:11:40.064 Realtime[65]: Warning, a previous cycle is still processing local files. Skipping this interval.
2022-11-01 10:11:40.065 Realtime[65]: End cycle
2022-11-01 10:11:41.672 ProcessExtraData: Processing posted data
2022-11-01 10:11:41.679 ProcessExtraData: Payload = PASSKEY=<PassKey>&stationtype=GW1000A_V1.7.5&runtime=6637851&dateutc=2022-11-01+10:11:41&tempinf=64.04&humidityin=77&baromrelin=29.775&baromabsin=29.725&tempf=59.00&humidity=81&winddir=114&windspeedmph=2.01&windgustmph=6.93&maxdailygust=26.17&solarradiation=89.31&uv=0&rainratein=0.000&eventrainin=0.118&hourlyrainin=0.000&dailyrainin=0.008&weeklyrainin=0.189&monthlyrainin=0.008&yearlyrainin=13.268&totalrainin=13.268&temp1f=59.00&soilmoisture1=48&tf_ch1=58.28&wh65batt=0&wh40batt=1.5&wh26batt=0&batt1=1&soilbatt1=1.0&tf_batt1=1.62&freq=868M&model=GW1000A_Pro
2022-11-01 10:11:41.682 ApplyExtraData: Complete
2022-11-01 10:11:41.688 ProcessExtraData: Complete
2022-11-01 10:11:45.073 Realtime[64]: Error encountered during MySQL operation = Connect Timeout expired.
2022-11-01 10:11:45.074 Realtime[64]: Error - Object reference not set to an instance of an object.
2022-11-01 10:11:46.666 Reading live data
2022-11-01 10:11:46.690 DoCommand(CMD_GW1000_LIVEDATA): Valid response
2022-11-01 10:11:46.691 Received: FF-FF-27-00-49-01-00-B2-06-4D-08-27-52-09-27-63-02-00-96-07-51-0A-00-68-0B-00-0A-0C-00-0A-15-00-01-C6-B0-16-00-36-17-00-2C-30-1A-00-96-19-00-75-0E-00-00-10-00-02-11-00-30-12-00-00-00-02-13-00-00-0D-2A-0D-00-1E-63-00-92-51-D0
2022-11-01 10:11:46.692 LiveData: Wind Decode >> Last=2.2, LastDir=104, Gust=2.2, (MXAvg=3.2)
2022-11-01 10:11:46.713 Writing to Month.ini file
2022-11-01 10:11:46.716 End writing to Month.ini file
2022-11-01 10:11:46.717 Alarm (Battery Low): Trigger cleared
2022-11-01 10:11:50.064 Realtime[66]: Start cycle
2022-11-01 10:11:50.064 Realtime[66]: Warning, a previous cycle is still processing local files. Skipping this interval.
2022-11-01 10:11:50.065 Realtime[66]: End cycle
Many repeats of "Skipping this interval" and error messages.

Code: Select all

2022-11-01 10:06:33.730 Realtime[31]: Uploading extra web file[49] ./web/winddata.jsontmp to /saratoga/winddata.json
2022-11-01 10:06:33.731 FTP[31]: Uploading ./web/winddata.jsontmp to /saratoga/winddata.json
2022-11-01 10:06:34.335 Realtime[31]: End cycle
2022-11-01 10:06:35.581 Realtime[33]: Error encountered during MySQL operation = Connect Timeout expired.
2022-11-01 10:06:35.582 Realtime[33]: Error - Object reference not set to an instance of an object.
2022-11-01 10:06:40.046 Realtime[35]: Start cycle
2022-11-01 10:06:40.046 Realtime[35]: Creating realtime.txt
2022-11-01 10:06:40.047 Realtime[35]: Processing realtime file - realtimegauges.txt
2022-11-01 10:06:40.052 Realtime[35]: Processing extra file[2] - ./webfiles/WXtags-template-files/CUtags-comments.txt
2022-11-01 10:06:40.205 Realtime[35]: Processing extra file[3] - ./web/websitedataT.json
2022-11-01 10:06:40.245 Realtime[35]: Processing extra file[4] - ./web/realtimegaugesT.txt
2022-11-01 10:06:40.248 Realtime[35]: Processing extra file[5] - ./web/alldailytempdata.json
2022-11-01 10:06:40.266 Realtime[35]: Processing extra file[6] - ./web/alldailydegdaydata.json
2022-11-01 10:06:40.281 Realtime[35]: Processing extra file[7] - ./web/alldailyhumdata.json
2022-11-01 10:06:40.285 Realtime[35]: Processing extra file[8] - ./web/alldailyraindata.json
2022-11-01 10:06:40.289 Realtime[35]: Processing extra file[9] - ./web/alldailysolardata.json
2022-11-01 10:06:40.292 Realtime[35]: Processing extra file[10] - ./web/alldailywinddata.json
2022-11-01 10:06:40.295 Realtime[35]: Processing extra file[11] - ./web/availabledata.json
2022-11-01 10:06:40.297 Realtime[35]: Processing extra file[12] - ./web/alltempsumdata.json
2022-11-01 10:06:40.300 Realtime[35]: Processing extra file[13] - ./web/graphconfig.json
2022-11-01 10:06:40.302 Realtime[35]: Processing extra file[15] - ./web/dailyrain.json
2022-11-01 10:06:40.306 Realtime[35]: Processing extra file[16] - ./web/dailytemp.json
2022-11-01 10:06:40.307 Realtime[35]: Processing extra file[17] - ./web/humdata.json
2022-11-01 10:06:40.326 Realtime[35]: Processing extra file[18] - ./web/pressdata.json
2022-11-01 10:06:40.334 Realtime[35]: Processing extra file[19] - ./web/raindata.json
2022-11-01 10:06:40.349 Realtime[35]: Processing extra file[20] - ./web/solardata.json
2022-11-01 10:06:40.377 Realtime[35]: Processing extra file[21] - ./web/sunhours.json
2022-11-01 10:06:40.378 Realtime[35]: Processing extra file[22] - ./web/tempdata.json
2022-11-01 10:06:40.476 Realtime[35]: Processing extra file[23] - ./web/wdirdata.json
2022-11-01 10:06:40.496 Realtime[35]: Processing extra file[24] - ./web/winddata.json
2022-11-01 10:06:40.509 Realtime[35]: Processing extra file[25] - ./extra_sensors/extra_cu.txt
2022-11-01 10:06:40.512 Realtime[35]: Processing extra file[28] - ./realtime.txt
2022-11-01 10:06:40.513 Realtime[35]: Processing extra file[30] - ./web/alldailytempdata.json
2022-11-01 10:06:40.523 Realtime[35]: Processing extra file[31] - ./web/alldailydegdaydata.json
2022-11-01 10:06:40.528 Realtime[35]: Processing extra file[32] - ./web/alldailyhumdata.json
2022-11-01 10:06:40.532 Realtime[35]: Processing extra file[33] - ./web/alldailyraindata.json
2022-11-01 10:06:40.534 Realtime[35]: Processing extra file[34] - ./web/alldailysolardata.json
2022-11-01 10:06:40.536 Realtime[35]: Processing extra file[35] - ./web/alldailywinddata.json
2022-11-01 10:06:40.540 Realtime[35]: Processing extra file[36] - ./web/alltempsumdata.json
2022-11-01 10:06:40.542 Realtime[35]: Processing extra file[38] - ./web/realtimegaugesT.txt
2022-11-01 10:06:40.545 Realtime[35]: Processing extra file[40] - ./web/dailyrain.json
2022-11-01 10:06:40.546 Realtime[35]: Processing extra file[41] - ./web/dailytemp.json
2022-11-01 10:06:40.546 Realtime[35]: Processing extra file[42] - ./web/humdata.json
2022-11-01 10:06:40.573 Realtime[35]: Processing extra file[43] - ./web/pressdata.json
2022-11-01 10:06:40.589 Realtime[35]: Processing extra file[44] - ./web/raindata.json
2022-11-01 10:06:40.608 Realtime[35]: Processing extra file[45] - ./web/solardata.json
2022-11-01 10:06:40.630 Realtime[35]: Processing extra file[46] - ./web/sunhours.json
2022-11-01 10:06:40.631 Realtime[35]: Processing extra file[47] - ./web/tempdata.json
2022-11-01 10:06:40.722 Realtime[35]: Processing extra file[48] - ./web/wdirdata.json
2022-11-01 10:06:40.749 Realtime[35]: Processing extra file[49] - ./web/winddata.json
2022-11-01 10:06:40.770 Realtime[35]: Uploading - realtime.txt
2022-11-01 10:06:40.771 FTP[35]: Uploading realtime.txt to /cumulus/realtime.txt
2022-11-01 10:06:41.154 Realtime[35]: Uploading - realtimegauges.txt
2022-11-01 10:06:41.155 FTP[35]: Uploading web/realtimegauges.txt to /cumulus/realtimegauges.txt
2022-11-01 10:06:41.494 Realtime[35]: Uploading extra web file[2] ./webfiles/WXtags-template-files/CUtags-comments.txttmp to /saratoga/CUtags.php
2022-11-01 10:06:41.494 FTP[35]: Uploading ./webfiles/WXtags-template-files/CUtags-comments.txttmp to /saratoga/CUtags.php
Am I understanding correctly that you are sending all those extra web files at realtime, and if so, why? Not much time for the real realtime files to get updated.

Enjoy,
Paul
Hi Paul

I forgot I had set these up for various templates in the past so I took them all off Realtime last night and it seems to still be working now so thank you.

Jamie
Top
Post Reply

Return to “Cumulus MX version 3 (since build 3043)”