Page 1 of 1

log file errors

Posted: Mon 24 Nov 2014 12:13 am
by n9mfk
I just check me weather pc i have these errors
11/23/2014 9:51:00 AM : 11/23/2014 9:51:00 AM Error writing data to data file: C:\Cumulus\data\Nov14log.txt. I/O error 32
11/23/2014 9:51:00 AM : 11/23/2014 9:51:00 AM Error writing EOL to data file: C:\Cumulus\data\Nov14log.txt. I/O error 103
11/23/2014 9:51:00 AM : 11/23/2014 9:51:00 AM Error closing data file: C:\Cumulus\data\Nov14log.txt. I/O error 103
11/23/2014 9:56:00 AM : 11/23/2014 9:56:00 AM Error writing data to data file: C:\Cumulus\data\Nov14log.txt. I/O error 32
11/23/2014 9:56:00 AM : 11/23/2014 9:56:00 AM Error writing EOL to data file: C:\Cumulus\data\Nov14log.txt. I/O error 103
11/23/2014 9:56:00 AM : 11/23/2014 9:56:00 AM Error closing data file: C:\Cumulus\data\Nov14log.txt. I/O error 103
11/23/2014 10:01:00 AM : 11/23/2014 10:01:00 AM Error writing data to data file: C:\Cumulus\data\Nov14log.txt. I/O error 32
11/23/2014 10:01:00 AM : 11/23/2014 10:01:00 AM Error writing EOL to data file: C:\Cumulus\data\Nov14log.txt. I/O error 103
11/23/2014 10:01:00 AM : 11/23/2014 10:01:00 AM Error closing data file: C:\Cumulus\data\Nov14log.txt. I/O error 103
11/23/2014 11:51:00 AM : 11/23/2014 11:51:00 AM Error writing data to data file: C:\Cumulus\data\Nov14log.txt. I/O error 32
11/23/2014 11:51:00 AM : 11/23/2014 11:51:00 AM Error writing EOL to data file: C:\Cumulus\data\Nov14log.txt. I/O error 103
11/23/2014 11:51:00 AM : 11/23/2014 11:51:00 AM Error closing data file: C:\Cumulus\data\Nov14log.txt. I/O error 103
what do i need to do?
beau

Re: log file errors

Posted: Mon 24 Nov 2014 1:40 am
by SpaceWalker
I/O error 32 = ERROR_SHARING_VIOLATION
The process cannot access the file because it is being used by another process

I/O error 103 = ERROR_TOO_MANY_SEM_REQUESTS
The semaphore cannot be set again (or the file cannot be accessed).

As Steve has written so often: "It's not a problem with the file itself. Something on your system has (or had) the file open, preventing Cumulus writing to it. The usual suspects are anti-virus programs, backup programs, etc."

Re: log file errors

Posted: Mon 24 Nov 2014 2:44 am
by n9mfk
is there a way to get missing data back?
Thanks Beau

Re: log file errors

Posted: Mon 24 Nov 2014 8:25 am
by steve
There is another "usual suspect" to add to my list as it hadn't occurred to me until recently when someone else had an issue.

If you are uploading the log file by ftp now, as mentioned in your other thread, then this is likely to be the cause. If the file is large (and it's close to the end of the month, so this is likely) it will take a while to upload. If the upload hasn't completed by the time Cumulus needs to write to the file again, the file will be locked by the ftp thread and the logging code will not be able to access it. There is another current thread about this exact same issue. You have to allow enough time for the file to be uploaded.

There is no way to get the entries back. You could 'rewind' using the backup files and get Cumulus to download the data from the logger, but when you do that you don't get exactly the same entries as you had before, as the data is not as good when coming from the logger. So you have to decide whether to go with the missing entries, or have all of your entries since the 'rewind' be not quite as "good" as they currently are.

Re: log file errors

Posted: Mon 24 Nov 2014 1:34 pm
by n9mfk
Steve,
just a thought would there be some way to make a copy of the file then have the copy uploaded so it would not hurt the working file

Re: log file errors

Posted: Mon 24 Nov 2014 2:15 pm
by steve
The problem with that is that if the previous upload hadn't finished, it wouldn't be able to make the copy either. Handling this situation is beyond the scope of what Cumulus is intended to do. If you look at the other thread currently discussing this issue, you'll see a recommendation to use some sync/backup software. Software like that is designed to cope with files being locked, Cumulus is not. If you really want to upload an entire log file every upload, and you are not prepared to change the intervals to allow the upload to complete, then you will have to look at using separate software that is intended to do the job properly.

Re: log file errors

Posted: Wed 26 Nov 2014 12:06 am
by steve
It occurs to me that you could get Cumulus to copy the log file by using two entries in the files table. In the first entry put <currentlogfile> for the local file, and a temporary file for the remote file, e.g. C:\Cumulus\tempfile.txt, and don't tick the ftp box. In the second entry, put the temp file name for the the local file, and whatever you've already got for the remote path and file for the remote file, and tick the ftp box. I can't guarantee it will work, but it might be worth trying.

Re: log file errors

Posted: Wed 26 Nov 2014 2:12 pm
by n9mfk
Steve,
how do I rollback cumulus?
thanks Beau

Re: log file errors

Posted: Wed 26 Nov 2014 2:19 pm
by steve
Find the time that you want to roll back to in the backup folders (one is created each time Cumulus starts, and one just after midnight). Stop Cumulus and copy all of the files from the chosen folder into the data folder, overwriting the ones that are there, and then start Cumulus up again. Make sure that you don't try to roll back to a point before the current contents of your station's logger starts.