NOAA Report Error [Solved]

[Cambium]

I'm trying to run the CreateMissing and I feel like I started a new 1000 piece puzzle. lol

I am reading each step but stuck on this. Command prompt not opening it. Yes the CreateMissing download is in the CumulusMX folder extracted. When I click the ExportToMySQL window opens and closes right away

[HansR]

1) There is nothing to do with ExportToMySQL so why do you click that? Just stick to CreateMissing.exe and run it (remember you first have to correct your data first!)

2) The CMD window says it does not recognise CreateMissing.exe as a program or batch file. If I download it and run it it runs. So you must be doing something wrong. It may be the rights you have from the CMD window so try to open an administrator CMD window. Powershell: place the mouse on the CumulusMX directory, press SHIFT, click the right button: the menu then gives the choice to open a powershell window in that directory. When you are in the powershell, execute CreateMissing.exe

3) If I click the image it tries to download something from Imgur. Try to simply attach the image as a file (tab attachments below the message editor) that makes it possible to download and enlarge the image by the user without Imgur. I have reading glasses, the text is pretty small and I need to enlarge it.

[Cambium]

2) The CMD window says it does not recognise CreateMissing.exe as a program or batch file. If I download it and run it it runs. So you must be doing something wrong. It may be the rights you have from the CMD window so try to open an administrator CMD window. Powershell: place the mouse on the CumulusMX directory, press SHIFT, click the right button: the menu then gives the choice to open a powershell window in that directory. When you are in the powershell, execute CreateMissing.exe

This is what I get

[Gyvate]

I'm trying to run the CreateMissing and I feel like I started a new 1000 piece puzzle. lol

I am reading each step but stuck on this. Command prompt not opening it. Yes the CreateMissing download is in the CumulusMX folder extracted. When I click the ExportToMySQL window opens and closes right away

this message from the operaring system comes when the file with that name is not found in the current directory or in the PATH environment variable.

Did you copy CreateMissing.exe and CreateMissing.exe.config into the CumulusMX directory ?
(Maybe you didn't unpack the CreateMissing-v1.2.0.zip file ? - or unpacked/unzipped/extracted it into some other directory)

It has either to be there (in the current directory) or your PATH environment variable has to be augmented with the path to the directory where the CreateMissing.exe file is located.

Easiest is to copy CreateMissing.exe and CreateMissing.exe.config into the ...\CumulusMX directory (where the Cumulus.ini is located) from where you unpacked the zip file to.

Then executing the CreateMissing command will work.
(.exe is not necessary to start a program under Windows unless there is another program with the same name in the same directory but with the ending .bat or .com, which is most probably not the case here).

I just downloaded and unpacked that file (into a directory where there is no Cumulus.ini) and it started right away, just (correctly !) complaining that there's no Cumulus.ini
and then of course aborted

D:\Weather\Cumulus>createmissing
CreateMissing v.1.2.0

Processing started: Mittwoch, 15. Dezember 2021 21:58:06

Failed to find Cumulus.ini file!

D:\Weather\Cumulus>

[PaulMy]

Is there anything in the MXdiags\ CreateMissing log file?

Enjoy,
Paul

[Gyvate]

Is there anything in the MXdiags\ CreateMissing log file?

Enjoy,
Paul

when this message from the OS (Windows) comes, the executable file simply doesn't exist in the current directory
Nothing to be found - no log file created as the program didn't start yet

This is Windows basics - same in Linux
example - I try to execute CreateMissing.exe in a directory where it (CreateMissing.exe) doesn't exist:
I just get the same message @Cambium was showing in his screen copy:
D:\Weather>createmissing.exe
'createmissing.exe' is not recognized as an internal or external command,
operable program or batch file.

(note that contrary to Linux the Windows command processor is not case sensitive)

[Cambium]

I did extract it all in the CumulusMX folder. I'm taking a break from all this for a little. Work got busy again. Sorry.

Is there anything in the MXdiags\ CreateMissing log file?

Enjoy,
Paul

Nope. See attached. And I did fix the errors shown in this report after 9am. No more errors. Let me see what happens tomorrow.

[Gyvate]

I did extract it all in the CumulusMX folder. I'm taking a break from all this for a little. Work got busy again. Sorry.

Is there anything in the MXdiags\ CreateMissing log file?
Enjoy,
Paul

Nope. See attached. And I did fix the errors shown in this report after 9am. No more errors. Let me see what happens tomorrow.

Sorry to maybe appear to look somewhat nit-picky:
in the extracting process the extraction program often creates a (n unexpected) sub-directory.
when you are in the ..\CumulusMX directory (I write ..\ because I don't know whether your CumulusMX directory is directly under root ("\") or on a lower level)
what does "dir *.exe" (without "") show ?
it should show +/- the same as below:
C:\CumulusMX>dir *.exe
Volume in drive C is Windows
Volume Serial Number is 947B-725F
Directory of C:\CumulusMX
16.12.2021 00:01 47.616 CreateMissing.exe
02.12.2021 21:25 1.696.256 CumulusMX.exe
2 File(s) 1.743.872 bytes
0 Dir(s) 68.306.575.360 bytes free
C:\CumulusMX>
If CreateMissing.exe is not shown by the dir *.exe command, then CreateMissing.exe is not there.

- In Windows File Explorer go to the directory/folder where the archive (CreateMissing-v1.2.0.zip) is in
- richt-click on the CreateMissing-v1.2.0.zip entry and choose "open with" and then "Windows Explorer"
- you will see the three files inside the archive/ZIP file
- in the left part of Windows File Explorer, where you can see the directory tree, locate your CumulusMX folder
- mark the three files from the archive and drag them with the mouse (either right-click or left-click) into your CumulusMX folder
- now the dir *.exe command executed in a console window inside your CumulusMX directory should show CumulusMX.exe and CreateMissing.exe
(usually, when you open a console windows/command prompt, it opens in the C:\Users\username directory - then first execute
cd \CumulusMX to move into the \CumulusMX directory before you execute the dir *.exe command)
- if the dir *.exe still does not show the CreateMissing.exe file, see next paragraph

It's also possible that your AntiVirus Program or the Windows Defender considered it to be suspicious and has quarantined it - and it therefore disappeared - if it's not there and there is no CumulusMX sub-directory inside your CumulusMX directory (\CumulusMX\CumulusMX) - that's what sometimes happens when unpacking/extracting that the path from the ZIP file is applied - where the unpacked CreateMissing.exe might be, then check the logs of your AntiVirus programs.

When your Dec21log.txt is now error free as you suggest, then CreateMissing.exe should fill the gaps in the dayfile.txt file and your NOAA report should be created with the proper daily entries.

[HansR]

Try to execute "./CreateMissing.exe" or specify the full path.

[Cambium]

Sorry guys, work got hectic. I appreciate the time and effort you guys are putting into this. Totally appreciate it. I know we'll get it eventually and hopefully have an "Ah Ha" moment.

- In Windows File Explorer go to the directory/folder where the archive (CreateMissing-v1.2.0.zip) is in
- richt-click on the CreateMissing-v1.2.0.zip entry and choose "open with" and then "Windows Explorer"
- you will see the three files inside the archive/ZIP file
- in the left part of Windows File Explorer, where you can see the directory tree, locate your CumulusMX folder
- mark the three files from the archive and drag them with the mouse (either right-click or left-click) into your CumulusMX folder
- now the dir *.exe command executed in a console window inside your CumulusMX directory should show CumulusMX.exe and CreateMissing.exe
(usually, when you open a console windows/command prompt, it opens in the C:\Users\username directory - then first execute
cd \CumulusMX to move into the \CumulusMX directory before you execute the dir *.exe command)
- if the dir *.exe still does not show the CreateMissing.exe file, see next paragraph

I just did all this and this is what I get now..

Microsoft Windows [Version 10.0.19042.1415]
(c) Microsoft Corporation. All rights reserved.

C:\Users\RLF>cd \CumulusMX

C:\CumulusMX>dir *.exe
Volume in drive C has no label.
Volume Serial Number is F026-994A

Directory of C:\CumulusMX

12/04/2021 11:23 AM 1,696,256 CumulusMX.exe
12/17/2021 07:10 AM 16,384 ExportToMySQL.exe
2 File(s) 1,712,640 bytes
0 Dir(s) 870,318,964,736 bytes free

C:\CumulusMX>

When your Dec21log.txt is now error free as you suggest, then CreateMissing.exe should fill the gaps in the dayfile.txt file and your NOAA report should be created with the proper daily entries.

Definetly error free according to the Diags but on the NOAA report Cumulus is reading "0" for a minimum low when I first start it up. The max is fine.. This could be a seperate issue that we dont have to tackle until we solve the other issue. As long as when I input my data into the Dec21 log & Cumulus reads it, I'll be fine. It hasnt yet which is leading to my previous issue of why isnt it showing up in the NOAA report.

What if I delete everything in the Day file? Will it regenerate a new dayfile with all the data?

[Cambium]

And here's an attachment of the Dec21 log. I inputted data from December 1st from the WeatherSmartIP download.

Note for December 16th, the minimum temp is there but on the NOAA report its showing up as 0 for the time I started Cumulus up which was 19:51

Ignore the NOAA data for Dec 1st-6th. I did a copy and paste to see if it showed up. It did. Hopefully we can fix it so it automatically picks up the actual data.

[Gyvate]

Looks like you downloaded and unpacked the wrong archive.
Try the one attached.
You seem to have downloaded/unpacked the ExportToMySQL archive instead.

When your minute log (Dec21log.txt) is complete, CreateMissing.exe will create missing entries in the dayfile.txt or update wrong ones (due to missing minute values).
Then CMX can create the proper NOAA report for the month.

You say it is showing the time for when you started ...
started what ? CMX or creating the NOAA report.
It looks that at 19:51 you started CMX first time that day - so if the lowest temperature was at that time, that looks correct.
It doesn't know anything else about what was before at that day. So at 19:50 was nothing = 0.00.

[Cambium]

Looks like you downloaded and unpacked the wrong archive.
Try the one attached.
You seem to have downloaded/unpacked the ExportToMySQL archive instead.

When your minute log (Dec21log.txt) is complete, CreateMissing.exe will create missing entries in the dayfile.txt or update wrong ones (due to missing minute values).
Then CMX can create the proper NOAA report for the month.

You say it is showing the time for when you started ...
started what ? CMX or creating the NOAA report.

CMX. I dont always have it open. I'll try the download when I get back. Thanks!

[Gyvate]

In order to get a proper NOAA, the daily minute log should be complete (or - that's an assumption as I don't know the program code - at least for the day at midnight 00:00 / 12:00 PM there should be at least one entry which can be taken for reference of the day). Ideally, if you don't run CMX 24/7, you fill the Dec21log.txt (and later Jan22log.txt etc.) with the missing data from your TP3000WC console export regularly and run CreateMissing.exe afterwards before getting a proper NOAA report.

And remember: "... but as MX only reads the dayfile.txt as MX starts up, any changes this utility makes will not be picked up by MX until MX is stopped and restarted. "

For more details about how CreateMissing.exe works, see the WiKi: https://cumuluswiki.org/a/Calculate_Missing_Values section "How to do "Calculate Missing" "

Not sure if I suggested earlier, but you could run CMX on a Raspi with minimum power consumption 24/7, either under Raspbian/Debian OS (Linux) or under Windows 11.
For Win 11 I could give you the necessary hints how to do if you are interested. The Raspbian/Debian version is also very simple to install. There are even Raspi image solutions (ready-made OS copy with CMX).
Then all those issues of missing readings, retroactive import of missing data etc., will disappear (unless something serious happens with the infrastructure).
You can view everything on your PC with a virtual desktop (VNC) inbuilt in the Raspbian OS - with Win 11 you would have to install a VNC server on Win11 like TightVNC, or, of course, if it's the CMX interface, in your browser. The VNC is only for operating CMX on the OS level (updates, editing files etc.).
I have both versions running (Linux/Windows) smoothly.

[Gyvate]

Didnt relize Excel didnt use the double digits for any of the AM time. SMH.

One of the reasons we repeatedly recommend not to use Excel to edit the data files - unless you really know Excel and how to handle data files in it, there are all sorts of subtle ways it can change your data.

If you use Excel - it might be very useful if you have to create the mmmYYlog.txt format (sequence) from an export with different observation sequence or/and have to convert date time (e.g. remove AM/PM and the space) etc. - then you need to format the fields explicitly as text (!!). ANY OTHER DATA TYPE WILL CREATE ISSUES like missing leading zeros or missing trailing characters (numbers) or trailing spaces. The alternative (writing e.g. a little Visual Basic program [Win] or Python program [Win, Linux]) needs more expertise than most people have.

I use Excel for converting the time stamp of my WS2320E (TP3000) export, but it needs to be done properly. A text editor doesn't have the powerful tools which Excel has (and if you import years of data, you'll get crazy in a text editor only), but you have to watch the format ! AND you have to save your work as type "CSV(Comma delimited) (*.csv)". Otherwise you will get different delimiters. CMX won't be amused.