Welcome to the Cumulus Support forum.

Latest Cumulus MX V3 release 3.28.6 (build 3283) - 21 March 2024

Cumulus MX V4 beta test release 4.0.0 (build 4017) - 17 March 2024

Legacy Cumulus 1 release v1.9.4 (build 1099) - 28 November 2014 (a patch is available for 1.9.4 build 1099 that extends the date range of drop-down menus to 2030)

Download the Software (Cumulus MX / Cumulus 1 and other related items) from the Wiki

migrating old data to cumulus MX

From build 3044 the development baton passed to Mark Crossley. Mark has been responsible for all the Builds since. He has made the code available on GitHub. It is Mark's hope that others will join in this development, but at the very least he welcomes your ideas for future developments (see Cumulus MX Development suggestions).

Moderator: mcrossley

Post Reply
GaxUser
Posts: 29
Joined: Thu 19 May 2022 9:26 pm
Weather Station: davis vp2
Operating System: windows
Contact:

migrating old data to cumulus MX

Post by GaxUser »

I'm trying to migrate data from legacy cumulus to cumulus MX. Everything seems to work with the exception of charts, reports, and records.

If I go to records each month looks correct but 'All time', 'This month' and 'This year' only show new data (e.g. data that has been recorded since starting to use MX). The same with 'Reports' and 'Charts).

Any ideas what I need to do?
water01
Posts: 3215
Joined: Sat 13 Aug 2011 9:33 am
Weather Station: Ecowitt HP2551
Operating System: Windows 10 64bit
Location: Burnham-on-Sea
Contact:

Re: migrating old data to cumulus MX

Post by water01 »

Have you set the "Records Began Date" (in Station Settings / General Settings / Advanced Options ) to the date that the data starts?
David
Image
GaxUser
Posts: 29
Joined: Thu 19 May 2022 9:26 pm
Weather Station: davis vp2
Operating System: windows
Contact:

Re: migrating old data to cumulus MX

Post by GaxUser »

That would make sense, but... The first line of data I have (in Apr17log.txt) is "18/03/17, ..." The "Records Began Data" is '18/03/17. In Cumulus.ini I have "StartDate=18/03/17" I tried to a fresh install of MX, now it doesn't show any monthly data at all; records, charts reports are still broken.

I can still browse the data logs via the web page.

The log file show a bunch of this:
2022-05-20 11:25:54.720 GetArchiveData: Reading archive page 336
2022-05-20 11:25:54.721 GetArchiveData: Waiting for response
2022-05-20 11:25:54.870 GetArchiveData: Reading response
2022-05-20 11:25:54.870 GetArchiveData: Loaded archive record for Page=336 Record=0 Timestamp=5/19/2022 8:40:00 PM
2022-05-20 11:25:54.870 GetArchiveData: Ignoring old archive data
2022-05-20 11:25:54.871 1679 archive entries processed
2022-05-20 11:25:54.871 GetArchiveData: Loaded archive record for Page=336 Record=1 Timestamp=5/19/2022 8:41:00 PM
2022-05-20 11:25:54.871 GetArchiveData: Ignoring old archive data
2022-05-20 11:25:54.872 1680 archive entries processed
2022-05-20 11:25:54.872 GetArchiveData: Loaded archive record for Page=336 Record=2 Timestamp=5/19/2022 8:42:00 PM
2022-05-20 11:25:54.872 GetArchiveData: Ignoring old archive data
2022-05-20 11:25:54.872 1681 archive entries processed
2022-05-20 11:25:54.872 GetArchiveData: Loaded archive record for Page=336 Record=3 Timestamp=5/19/2022 8:43:00 PM
2022-05-20 11:25:54.872 GetArchiveData: Ignoring old archive data
2022-05-20 11:25:54.872 1682 archive entries processed
2022-05-20 11:25:54.872 GetArchiveData: Loaded archive record for Page=336 Record=4 Timestamp=5/19/2022 8:44:00 PM
2022-05-20 11:25:54.873 GetArchiveData: Ignoring old archive data
2022-05-20 11:25:54.873 1683 archive entries processed
2022-05-20 11:25:54.873 GetArchiveData: Reading archive page 337
2022-05-20 11:25:54.874 GetArchiveData: Waiting for response

Ignoring old archive data yet 1683 archive entries processed?!
freddie
Posts: 2433
Joined: Wed 08 Jun 2011 11:19 am
Weather Station: Davis Vantage Pro 2 + Ecowitt
Operating System: GNU/Linux Ubuntu 22.04 LXC
Location: Alcaston, Shropshire, UK
Contact:

Re: migrating old data to cumulus MX

Post by freddie »

Is your Cumulus logging interval the same as your VP logging interval? If they're different that usually generates a load of archive messages in the logs.
Freddie
Image
GaxUser
Posts: 29
Joined: Thu 19 May 2022 9:26 pm
Weather Station: davis vp2
Operating System: windows
Contact:

Re: migrating old data to cumulus MX

Post by GaxUser »

yes logging intervals are the same.
GaxUser
Posts: 29
Joined: Thu 19 May 2022 9:26 pm
Weather Station: davis vp2
Operating System: windows
Contact:

Re: migrating old data to cumulus MX

Post by GaxUser »

I also notice while I can view historical data via the interface, the charts only show data from a few days ago. When I first started to try and get this to migrate. On top of that even though it was warmer a few days ago according to the chart according to the records page all of the records are for today?!?

most every time I run the program it says Downloading Archive Data blah blah runs through - processed 0% to 100% TWICE
sutne
Posts: 372
Joined: Sun 14 Oct 2012 4:23 pm
Weather Station: HP2553 (WS80) and HP2564 (WS90)
Operating System: Raspbian Bullseye and Bookworm
Location: Rjoanddalen and Kronstad, Norway
Contact:

Re: migrating old data to cumulus MX

Post by sutne »

"StartDate=18/03/17"
Timestamp=5/19/2022 8:40:00 PM
Do you have the same date format on the old and new installation?
GaxUser
Posts: 29
Joined: Thu 19 May 2022 9:26 pm
Weather Station: davis vp2
Operating System: windows
Contact:

Re: migrating old data to cumulus MX

Post by GaxUser »

as far as I know. as I said the format is the same in the data files, and in start date in the .ini file. new data is formatted the same as the historical data. I don't see any way to set the date format on the new installation.
sfws
Posts: 1183
Joined: Fri 27 Jul 2012 11:29 am
Weather Station: Chas O, Maplin N96FY, N25FR
Operating System: rPi 3B+ with Buster (full)

Re: migrating old data to cumulus MX

Post by sfws »

GaxUser wrote: Sat 21 May 2022 3:56 pm I don't see any way to set the date format on the new installation.
As @sutne hinted, the point is that the diagnostic file (see quote in earlier post) is showing your new installation dates are USA style, month, then day of month, then year, while your old data (as you keep mentioning) had international style with month in middle. Cumulus MX can't cope with more than one date format, Cumulus 1 was less fussy.

If you are using Microsoft Windows as your profile claims, then you need to go into the old fashioned control panel to set date format, the Settings interface does everything by a locale, and it defaults to USA I believe.
I'm not using Windows, so I can't give you a screen shot, but in control panel you should be able to find "Region" and date/time formats. The closest I have found is a screen shot re setting time here, just select date tab instead.
In there you should move away from Microsoft's USA default, to the date format that you used to use.

Once upon a time this was covered in the Wiki, but that has been extensively rewritten and no longer covers this sort of technical detail.
GaxUser
Posts: 29
Joined: Thu 19 May 2022 9:26 pm
Weather Station: davis vp2
Operating System: windows
Contact:

Re: migrating old data to cumulus MX

Post by GaxUser »

No change.

It really shouldn't matter since the old data is recorded using dd/mm/yy and the new data is recorded in the same fashion, Irregardless of culture. The only why that should effect anything is the parseing of the records begin day.

In any case here is the latest log file with Currect culture: English (United Kingdom) [en-GB]

2022-05-24 19:12:44.343 ========================== Cumulus MX starting ==========================
2022-05-24 19:12:44.344 Command line: "C:\Users\Kyle Kotwica\Desktop\CumulusMX\CumulusMX.exe"
2022-05-24 19:12:44.344 Cumulus MX v.3.17.0 build 3184
2022-05-24 19:12:44.346 Platform: Win32NT
2022-05-24 19:12:44.346 OS version: Microsoft Windows NT 6.2.9200.0
2022-05-24 19:12:44.353 Current culture: English (United Kingdom) [en-GB]
2022-05-24 19:12:49.100 Checking required folders
2022-05-24 19:12:49.150 Reading Cumulus.ini file
2022-05-24 19:12:49.158 AvgSpdMins=10 AvgSpdTime=00:10:00
2022-05-24 19:12:49.162 Cumulus start date: Friday, March 24, 2017
2022-05-24 19:12:49.290 Reading Cumulus.ini file completed
2022-05-24 19:12:49.290 Directory separator=[\] Decimal separator=[.] List separator=[,]
2022-05-24 19:12:49.290 Date separator=[/] Time separator=[:]
2022-05-24 19:12:49.290 Standard time zone name: Pacific Standard Time
2022-05-24 19:12:49.290 Daylight saving time name: Pacific Daylight Time
2022-05-24 19:12:49.290 Daylight saving time? True
2022-05-24 19:12:49.291 24/05/2022 19:12:49
2022-05-24 19:12:49.291 Stop second instance: No other running instances of Cumulus found
2022-05-24 19:12:49.291 No start-up delay - disabled
2022-05-24 19:12:49.291 No start-up PING
2022-05-24 19:12:49.295 Data path = data\
2022-05-24 19:12:49.334 BackupData: Creating backup folder backup\20220524191249\
2022-05-24 19:12:49.450 Created backup folder backup\20220524191249\
2022-05-24 19:12:49.450 Debug logging :enabled
2022-05-24 19:12:49.451 Data logging :disabled
2022-05-24 19:12:49.451 FTP logging :disabled
2022-05-24 19:12:49.451 Email logging :disabled
2022-05-24 19:12:49.451 Spike logging :enabled
2022-05-24 19:12:49.451 Logging interval = 1 mins
2022-05-24 19:12:49.451 Real time interval = 30 secs
2022-05-24 19:12:49.451 NoSensorCheck = 0
2022-05-24 19:12:49.486 Calculating sunrise and sunset times
2022-05-24 19:12:49.490 Sunrise: 05:36:35
2022-05-24 19:12:49.490 Sunset : 20:44:05
2022-05-24 19:12:49.490 Tomorrow sunrise: 05:35:47
2022-05-24 19:12:49.490 Tomorrow sunset : 20:45:05
2022-05-24 19:12:49.491 Tomorrow length diff: 108
2022-05-24 19:12:49.507 Generating new Moon image
2022-05-24 19:12:49.534 Station type: Davis Vantage Pro2
2022-05-24 19:12:49.535 WindUnit=mph RainUnit=in TempUnit=°F PressureUnit=mb
2022-05-24 19:12:49.535 YTDRain=0.000 Year=0
2022-05-24 19:12:49.535 RainDayThreshold=-1.000
2022-05-24 19:12:49.536 Roll over hour=0
2022-05-24 19:12:49.538 Offsets and Multipliers:
2022-05-24 19:12:49.538 PO=0.000 TO=0.000 HO=0 WDO=0 ITO=0.000 SO=0.000 UVO=0.000
2022-05-24 19:12:49.538 PM=1.000 WSM=1.000 WGM=1.000 TM=1.000 TM2=0.000 HM=1.000 HM2=0.000 RM=1.000 SM=1.000 UVM=1.000
2022-05-24 19:12:49.538 Spike removal:
2022-05-24 19:12:49.538 TD=999.000 GD=999.000 WD=999.000 HD=999.000 PD=999.000 MR=999.000 MH=999.000
2022-05-24 19:12:49.538 Limits:
2022-05-24 19:12:49.538 TH=60.0 TL=-60.0 DH=40.0 PH=1090.0 PL=870.0 GH=90.000
2022-05-24 19:12:49.538 Primary AQ Sensor = Undefined
2022-05-24 19:12:49.568 Cumulus Starting
2022-05-24 19:12:49.585 HTML root path = C:\Users\Kyle Kotwica\Desktop\CumulusMX\interface
2022-05-24 19:12:49.647 Cumulus running at: http://localhost:8998/
2022-05-24 19:12:49.649 Opening station
2022-05-24 19:12:49.669 Last update time from today.ini: 24/05/2022 19:10:00
2022-05-24 19:12:49.670 Read today file: Date = 5/24/2022, LastUpdateTime = 24/05/2022 19:10:00, Month = 5
2022-05-24 19:12:49.671 Sensor clock 00:00:00
2022-05-24 19:12:49.671 Station clock 00:00:00
2022-05-24 19:12:49.671 ET today = 0.000
2022-05-24 19:12:49.672 ReadTodayfile: Rain day start = 40.82
2022-05-24 19:12:49.672 ReadTodayfile: set initialiseRainCounterOnFirstData false
2022-05-24 19:12:49.680 C:\Users\Kyle Kotwica\Desktop\CumulusMX\data\alltime.ini
2022-05-24 19:12:49.683 Alltime.ini file read
2022-05-24 19:12:49.693 MonthlyAlltime.ini file read
2022-05-24 19:12:49.700 Month.ini file read
2022-05-24 19:12:49.707 Year.ini file read
2022-05-24 19:12:49.709 LoadDayFile: Attempting to load the day file
2022-05-24 19:12:49.709 LoadDayFile: No Dayfile found - No entries added to recent daily data list
2022-05-24 19:12:49.712 Finding raintoday from logfile data\May22log.txt
2022-05-24 19:12:49.712 Expecting listsep=, decimal=.
2022-05-24 19:12:50.236 Midnight rain found in the following entry:
2022-05-24 19:12:50.237 24/05/22,00:00,49.3,88,45.9,0.0,1.0,314,0.00,0.00,1021.64,40.82,73.4,47,0.0,49.3,49.3,0.0,0,0.000,0.000,48.3,0,0.0,360,0.00,0.00
2022-05-24 19:12:50.257 Midnight rain found, setting midnight rain count = 40.82
2022-05-24 19:12:50.257 Checking rain counter = 40.82
2022-05-24 19:12:50.257 Rain counter set to = 40.82
2022-05-24 19:12:50.259 Getting rain totals, rain season start = 10
2022-05-24 19:12:50.259 Today = 24/05/22
2022-05-24 19:12:50.260 Rainthismonth from dayfile: 0
2022-05-24 19:12:50.260 Rainthisyear from dayfile: 0
2022-05-24 19:12:50.262 Station type = Davis
2022-05-24 19:12:50.262 LOOP2 enabled
2022-05-24 19:12:50.262 Serial device = COM3
2022-05-24 19:12:50.262 Serial speed = 19200
2022-05-24 19:12:50.265 InitSerial: Connecting to the station
2022-05-24 19:12:50.839 InitSerial: Flushing input stream
2022-05-24 19:12:50.839 InitSerial: Sending TEST (1) command
2022-05-24 19:12:50.905 This Cumulus MX instance is running the latest version
2022-05-24 19:12:51.354 InitSerial: TEST (1) successful
2022-05-24 19:12:51.354 InitSerial: Connection confirmed
2022-05-24 19:12:51.354 Connected OK
2022-05-24 19:12:51.356 Reading firmware version
2022-05-24 19:12:51.357 WakeVP: Not required
2022-05-24 19:12:51.358 WaitForOK: Wait for OK
2022-05-24 19:12:51.370 WaitForOK: Found OK
2022-05-24 19:12:51.371 FW version = 3.63
2022-05-24 19:12:51.372 Reading reception stats
2022-05-24 19:12:51.373 WakeVP: Not required
2022-05-24 19:12:51.373 WaitForOK: Wait for OK
2022-05-24 19:12:51.385 WaitForOK: Found OK
2022-05-24 19:12:51.414 GetReceptionStats: 26539 420 0 494 163
2022-05-24 19:12:51.416 CheckLoggerInterval: Reading logger interval
2022-05-24 19:12:51.417 WakeVP: Not required
2022-05-24 19:12:51.418 WaitForACK: Wait for ACK
2022-05-24 19:12:51.430 WaitForACK: ACK received
2022-05-24 19:12:51.431 CheckLoggerInterval: Station logger interval is 1 minutes
2022-05-24 19:12:51.431 Last update time = 24/05/2022 19:10:00
2022-05-24 19:12:51.433 Reading console time
2022-05-24 19:12:51.433 WakeVP: Not required
2022-05-24 19:12:51.434 WaitForACK: Wait for ACK
2022-05-24 19:12:51.445 WaitForACK: ACK received
2022-05-24 19:12:51.446 Console clock: 24/05/2022 19:12:50
2022-05-24 19:12:51.446 Console clock: Accurate to +/- 30 seconds, no need to set it (diff=1s)
2022-05-24 19:12:51.447 Reading history data from log files
2022-05-24 19:12:51.447 Loading last N hour data from data logs: 24/05/2022 19:10:00
2022-05-24 19:12:51.450 LoadRecent: Attempting to load 7 days of entries to recent data list
2022-05-24 19:12:52.421 LoadRecent: Loaded 1 new entries to recent database
2022-05-24 19:12:52.430 LoadLast3Hour: Attempting to load 3 hour data list
2022-05-24 19:12:52.437 LoadLast3Hour: Loaded 181 entries to last 3 hour data list
2022-05-24 19:12:52.445 Reading archive data from logger
2022-05-24 19:12:52.445 Creating extra sensors
2022-05-24 19:12:52.487 855 web tags initialised
2022-05-24 19:12:52.489 Generating the daily graph data files
2022-05-24 19:12:52.554 GetArchiveData: Downloading Archive Data
2022-05-24 19:12:52.554 Roll-over hour = 0
2022-05-24 19:12:52.554 GetArchiveData: Last Archive Date: 24/05/2022 19:10:00
2022-05-24 19:12:52.554 GetArchiveData: Date: 11448
2022-05-24 19:12:52.554 GetArchiveData: Time: 1910
2022-05-24 19:12:52.554 WakeVP: Not required
2022-05-24 19:12:52.555 GetArchiveData: Sending DMPAFT
2022-05-24 19:12:52.555 WaitForACK: Wait for ACK
2022-05-24 19:12:52.561 WaitForACK: ACK received
2022-05-24 19:12:52.561 GetArchiveData: Received response to DMPAFT, sending start date and time
2022-05-24 19:12:52.562 WaitForACK: Wait for ACK
2022-05-24 19:12:52.571 WaitForACK: ACK received
2022-05-24 19:12:52.572 GetArchiveData: Waiting for response
2022-05-24 19:12:52.587 GetArchiveData: Reading data: 1 pages , offset = 1
2022-05-24 19:12:52.587 GetArchiveData: Reading archive page 0
2022-05-24 19:12:52.587 GetArchiveData: Waiting for response
2022-05-24 19:12:52.742 GetArchiveData: Reading response
2022-05-24 19:12:52.746 GetArchiveData: Loaded archive record for Page=0 Record=1 Timestamp=24/05/2022 19:11:00
2022-05-24 19:12:52.746 GetArchiveData: Processing archive record for 24/05/2022 19:11:00
2022-05-24 19:12:52.784 Writing to Month.ini file
2022-05-24 19:12:52.788 End writing to Month.ini file
2022-05-24 19:12:52.807 New all-time record: New time = 2022-05-24 19:11, new value = 2.383 "High daily windrun" prev time = 2022-05-24 19:10, prev value = 2.333
2022-05-24 19:12:52.826 New monthly record: month = 05: New time = 2022-05-24 19:11, new value = 2.383 "High daily windrun" prev time = 2022-05-24 19:10, prev value = 2.333
2022-05-24 19:12:52.840 GetArchiveData: Page=0 Record=1 Timestamp=24/05/2022 19:11:00
2022-05-24 19:12:52.852 DoLogFile: Writing log entry for 24/05/2022 19:11:00
2022-05-24 19:12:52.852 DoLogFile: max gust: 7
2022-05-24 19:12:52.858 DoLogFile: log entry for 24/05/2022 19:11:00 written
2022-05-24 19:12:52.863 Writing today.ini, LastUpdateTime = 24/05/2022 19:11:00 raindaystart = 40.82 rain counter = 40.82
2022-05-24 19:12:52.863 GetArchiveData: Log file entry written
2022-05-24 19:12:52.921 Creating WU URL #1
2022-05-24 19:12:52.921 http://weatherstation.wunderground.com/ ... =updateraw
2022-05-24 19:12:52.924 1 archive entries processed
2022-05-24 19:12:52.924 GetArchiveData: Loaded archive record for Page=0 Record=2 Timestamp=24/05/2022 19:12:00
2022-05-24 19:12:52.924 GetArchiveData: Processing archive record for 24/05/2022 19:12:00
2022-05-24 19:12:52.924 Writing to Month.ini file
2022-05-24 19:12:52.926 End writing to Month.ini file
2022-05-24 19:12:52.929 New all-time record: New time = 2022-05-24 19:12, new value = 2.400 "High daily windrun" prev time = 2022-05-24 19:11, prev value = 2.383
2022-05-24 19:12:52.936 New monthly record: month = 05: New time = 2022-05-24 19:12, new value = 2.400 "High daily windrun" prev time = 2022-05-24 19:11, prev value = 2.383
2022-05-24 19:12:52.937 GetArchiveData: Page=0 Record=2 Timestamp=24/05/2022 19:12:00
2022-05-24 19:12:52.937 DoLogFile: Writing log entry for 24/05/2022 19:12:00
2022-05-24 19:12:52.937 DoLogFile: max gust: 7
2022-05-24 19:12:52.938 DoLogFile: log entry for 24/05/2022 19:12:00 written
2022-05-24 19:12:52.939 Writing today.ini, LastUpdateTime = 24/05/2022 19:12:00 raindaystart = 40.82 rain counter = 40.82
2022-05-24 19:12:52.941 GetArchiveData: Log file entry written
2022-05-24 19:12:52.976 sendWebSocketData: Update already queued, dropping this one
2022-05-24 19:12:52.976 Creating WU URL #2
2022-05-24 19:12:52.976 http://weatherstation.wunderground.com/ ... =updateraw
2022-05-24 19:12:52.977 2 archive entries processed
2022-05-24 19:12:52.977 GetArchiveData: Loaded archive record for Page=0 Record=3 Timestamp=23/05/2022 00:26:00
2022-05-24 19:12:52.977 GetArchiveData: Ignoring old archive data
2022-05-24 19:12:52.977 3 archive entries processed
2022-05-24 19:12:52.977 GetArchiveData: Loaded archive record for Page=0 Record=4 Timestamp=23/05/2022 00:27:00
2022-05-24 19:12:52.977 GetArchiveData: Ignoring old archive data
2022-05-24 19:12:52.977 4 archive entries processed
2022-05-24 19:12:52.977 GetArchiveData: Downloading Archive Data
2022-05-24 19:12:52.977 Roll-over hour = 0
2022-05-24 19:12:52.978 GetArchiveData: Last Archive Date: 24/05/2022 19:12:00
2022-05-24 19:12:52.978 GetArchiveData: Date: 11448
2022-05-24 19:12:52.978 GetArchiveData: Time: 1912
2022-05-24 19:12:52.978 WakeVP: Not required
2022-05-24 19:12:52.978 GetArchiveData: Sending DMPAFT
2022-05-24 19:12:52.978 WaitForACK: Wait for ACK
2022-05-24 19:12:54.076 WaitForAck: (1) Timed out
2022-05-24 19:12:55.079 WaitForAck: (2) Timed out
2022-05-24 19:12:55.079 WaitForAck: timed out
2022-05-24 19:12:55.079 GetArchiveData: No Ack in response to DMPAFT
2022-05-24 19:12:55.079 WakeVP: Not required
2022-05-24 19:12:55.079 GetArchiveData: Sending DMPAFT
2022-05-24 19:12:55.080 WaitForACK: Wait for ACK
2022-05-24 19:12:55.087 WaitForACK: ACK received
2022-05-24 19:12:55.087 GetArchiveData: Received response to DMPAFT, sending start date and time
2022-05-24 19:12:55.087 WaitForACK: Wait for ACK
2022-05-24 19:12:55.099 WaitForACK: ACK received
2022-05-24 19:12:55.099 GetArchiveData: Waiting for response
2022-05-24 19:12:55.099 GetArchiveData: Reading data: 0 pages , offset = 0
2022-05-24 19:12:55.099 GetArchiveData: No Archive data available
2022-05-24 19:12:55.100 Logger archive reading thread completed
2022-05-24 19:12:55.106 Start normal reading loop
2022-05-24 19:12:55.107 SendLoopCommand: Starting - LPS 2 1
2022-05-24 19:12:55.108 WakeVP: Not required
2022-05-24 19:12:55.108 SendLoopCommand: Sending command LPS 2 1, attempt 1
2022-05-24 19:12:55.108 SendLoopCommand: Wait for ACK
2022-05-24 19:12:55.108 WaitForACK: Wait for ACK
2022-05-24 19:12:55.118 Start Extra Sensors
2022-05-24 19:12:55.118 Start Timers
2022-05-24 19:12:55.118 Starting 1-minute timer
2022-05-24 19:12:55.118 Data logging interval = 0 (1 mins)
2022-05-24 19:12:55.118 Starting Realtime timer, interval = 30 seconds
2022-05-24 19:12:55.122 Uploading WU archive #1
2022-05-24 19:12:55.125 Windylist count is zero
2022-05-24 19:12:55.125 MySqlList is Empty
2022-05-24 19:12:55.126 Normal running
2022-05-24 19:12:55.213 WaitForACK: ACK received
2022-05-24 19:12:55.220 LOOP2: Waiting for LOOP2 data
2022-05-24 19:12:55.247 LOOP2: Data packet is good
2022-05-24 19:12:55.248 LOOP2: 10-min gust: 5
2022-05-24 19:12:55.248 SendLoopCommand: Starting - LOOP 50
2022-05-24 19:12:55.248 WakeVP: Not required
2022-05-24 19:12:55.248 SendLoopCommand: Sending command LOOP 50, attempt 1
2022-05-24 19:12:55.249 SendLoopCommand: Wait for ACK
2022-05-24 19:12:55.249 WaitForACK: Wait for ACK
2022-05-24 19:12:55.310 WaitForACK: ACK received
2022-05-24 19:12:55.328 LOOP: 1 - Data packet is good
2022-05-24 19:12:55.400 LOOP: 2 - Data packet is good
2022-05-24 19:12:55.401 sendWebSocketData: Update already queued, dropping this one
2022-05-24 19:12:55.418 WU Response: OK: OK
2022-05-24 19:12:55.418 Uploading WU archive #2
2022-05-24 19:12:55.535 WU Response: OK: OK
2022-05-24 19:12:55.535 End of WU archive upload
2022-05-24 19:12:55.584 LOOP: 3 - Data packet is good
2022-05-24 19:12:57.591 LOOP: 4 - Data packet is good
2022-05-24 19:12:59.588 LOOP: 5 - Data packet is good
2022-05-24 19:13:00.205 Writing to Month.ini file
2022-05-24 19:13:00.206 End writing to Month.ini file
2022-05-24 19:13:00.209 New all-time record: New time = 2022-05-24 19:13, new value = 2.450 "High daily windrun" prev time = 2022-05-24 19:12, prev value = 2.400
2022-05-24 19:13:00.215 New monthly record: month = 05: New time = 2022-05-24 19:13, new value = 2.450 "High daily windrun" prev time = 2022-05-24 19:12, prev value = 2.400
2022-05-24 19:13:00.241 DoLogFile: Writing log entry for 24/05/2022 19:13:00
2022-05-24 19:13:00.241 DoLogFile: max gust: 7
2022-05-24 19:13:00.242 DoLogFile: log entry for 24/05/2022 19:13:00 written
2022-05-24 19:13:00.243 Writing today.ini, LastUpdateTime = 24/05/2022 19:13:00 raindaystart = 40.82 rain counter = 40.82
2022-05-24 19:13:00.249 Creating standard web files
2022-05-24 19:13:00.353 Done creating standard Data file
2022-05-24 19:13:00.353 Creating graph data files
2022-05-24 19:13:01.370 Done creating graph data files
2022-05-24 19:13:01.375 LocalCopy: Uploading standard web files
2022-05-24 19:13:01.548 LocalCopy: Done copying standard web files
2022-05-24 19:13:01.548 LocalCopy: Copying graph data files
2022-05-24 19:13:01.603 LOOP: 6 - Data packet is good
2022-05-24 19:13:03.099 LocalCopy: Done copying graph data files
2022-05-24 19:13:03.099 LocalCopy: Copying daily graph data files
2022-05-24 19:13:03.593 LOOP: 7 - Data packet is good
2022-05-24 19:13:03.610 LocalCopy: Done copying daily graph data files
2022-05-24 19:13:03.610 LocalCopy: Copying Moon image file
2022-05-24 19:13:03.685 LocalCopy: Done copying Moon image file
2022-05-24 19:13:03.686 LocalCopy: Copy process complete
2022-05-24 19:13:05.601 LOOP: 8 - Data packet is good
2022-05-24 19:13:07.599 LOOP: 9 - Data packet is good
2022-05-24 19:13:09.587 LOOP: 10 - Data packet is good
2022-05-24 19:13:11.599 LOOP: 11 - Data packet is good
2022-05-24 19:13:13.595 LOOP: 12 - Data packet is good
2022-05-24 19:13:15.588 LOOP: 13 - Data packet is good
2022-05-24 19:13:17.587 LOOP: 14 - Data packet is good
2022-05-24 19:13:18.685 Exiting system due to external: Ctrl-C
2022-05-24 19:13:18.688 Cumulus closing
2022-05-24 19:13:18.688 Stopping timers
2022-05-24 19:13:18.688 Stopping extra sensors...
2022-05-24 19:13:18.688 Extra sensors stopped
2022-05-24 19:13:18.688 Stopping station...
2022-05-24 19:13:18.689 Closing connection
2022-05-24 19:13:18.690 Station stopped
2022-05-24 19:13:18.690 Writing today.ini file
2022-05-24 19:13:18.693 Completed writing today.ini file
2022-05-24 19:13:18.693 Station shutdown complete
2022-05-24 19:13:19.204 Cumulus has shutdown
2022-05-24 19:13:19.558 Releasing Mutex
freddie
Posts: 2433
Joined: Wed 08 Jun 2011 11:19 am
Weather Station: Davis Vantage Pro 2 + Ecowitt
Operating System: GNU/Linux Ubuntu 22.04 LXC
Location: Alcaston, Shropshire, UK
Contact:

Re: migrating old data to cumulus MX

Post by freddie »

GaxUser wrote: Fri 20 May 2022 9:06 pm
most every time I run the program it says Downloading Archive Data blah blah runs through - processed 0% to 100% TWICE
That's normal. It's because downloading a lot of archive data can be slow and new archive data can be added/created while this is happening. The second request is made to pick up any archive records created during this time.
Freddie
Image
freddie
Posts: 2433
Joined: Wed 08 Jun 2011 11:19 am
Weather Station: Davis Vantage Pro 2 + Ecowitt
Operating System: GNU/Linux Ubuntu 22.04 LXC
Location: Alcaston, Shropshire, UK
Contact:

Re: migrating old data to cumulus MX

Post by freddie »

[2022-05-24 19:12:49.680 C:\Users\Kyle Kotwica\Desktop\CumulusMX\data\alltime.ini]
Don't install Cumulus on your desktop. This is mentioned in the Wiki. Best place is c:\CumulusMX
Freddie
Image
freddie
Posts: 2433
Joined: Wed 08 Jun 2011 11:19 am
Weather Station: Davis Vantage Pro 2 + Ecowitt
Operating System: GNU/Linux Ubuntu 22.04 LXC
Location: Alcaston, Shropshire, UK
Contact:

Re: migrating old data to cumulus MX

Post by freddie »

2022-05-24 19:12:49.709 LoadDayFile: Attempting to load the day file
2022-05-24 19:12:49.709 LoadDayFile: No Dayfile found - No entries added to recent daily data list
Could you check if your dayfile is present, please? It contains all your daily readings and extremes (as opposed to the data obtained at your archive interval) and should be in the data folder. File name is dayfile.txt.
Freddie
Image
User avatar
mcrossley
Posts: 12689
Joined: Thu 07 Jan 2010 9:44 pm
Weather Station: Davis VP2/WLL
Operating System: Bullseye Lite rPi
Location: Wilmslow, Cheshire, UK
Contact:

Re: migrating old data to cumulus MX

Post by mcrossley »

For the old records, CMX reads those from the various xxx.ini files in your data folder. So if they were copied across from your old install and CMX is not picking them up, then we need to see the contents of them, let's start with the alltime.ini file.

Can you attach (not paste please) the alltime.ini file from your C1 install and the same file that is currently in your CMX data folder?
GaxUser
Posts: 29
Joined: Thu 19 May 2022 9:26 pm
Weather Station: davis vp2
Operating System: windows
Contact:

Re: migrating old data to cumulus MX

Post by GaxUser »

Thanks everyone. It seems the .ini files got overwritten. The data is migrated, and all is well.
Post Reply