Page 1 of 1

Met Office WOW has stopped recording data

Posted: Tue 31 Jul 2012 1:45 pm
by BigDave
Sorry if someone has posted this elsewhere, but the met office WOW site seems to have stopped recording data from Cumulus as of 01:30 on 31/7/2012.

Is anyone else experiencing the same?

Cheers

Re: Met Office WOW has stopped recording data

Posted: Tue 31 Jul 2012 1:55 pm
by steve
Mine seems to be updating OK. If you turn on the debug log, that should show any errors coming back from WOW.

Re: Met Office WOW has stopped recording data

Posted: Tue 31 Jul 2012 1:59 pm
by BigDave
Interesting.. Thanks Steve

I'm getting the following in Cumulus.009

31/07/2012 14:33:47.593 : PleaseWaitForm destroyed - end of startup sequence
31/07/2012 14:34:00.546 : Writing today.ini, LastUpdateTime = 31/07/2012 14:34:00 raindaystart = 393.899993896484 rain counter = 394.200012207031
31/07/2012 14:34:09.593 : An error has occurred during the WOW update: Connection timed out (Error #10060)
31/07/2012 14:34:09.593 : Uploading WOW archive #2
31/07/2012 14:34:31.593 : An error has occurred during the WOW update: Connection timed out (Error #10060)
31/07/2012 14:34:31.593 : Uploading WOW archive #3
31/07/2012 14:34:53.593 : An error has occurred during the WOW update: Connection timed out (Error #10060)
31/07/2012 14:34:53.593 : WOW archive upload complete

Haven't yet gone back in time to find older errors.

Does this tell you anything useful?

Re: Met Office WOW has stopped recording data

Posted: Tue 31 Jul 2012 2:07 pm
by BigDave
Having enabled the Debug log just after 15:00, I think I might have just missed the WOW update, so here's what I got:


1666.890 : 15:00:17 USB device is plugged in
1666.890 : 15:00:17 request EW data block, written = 9, addr = 000000
1666.906 : 15:00:17 EW data line 01 55 AA FF FF FF FF FF FF
1666.906 : 15:00:17 EW data line 02 FF FF FF FF FF FF FF FF
1666.922 : 15:00:17 EW data line 03 05 20 08 80 11 00 3F 0A
1666.922 : 15:00:17 EW data line 04 01 00 00 F0 0F 00 B0 85
1666.922 : 15:00:17 USB device is plugged in
1666.937 : 15:00:17 request EW data block, written = 9, addr = 0085B0
1666.953 : 15:00:17 EW data line 05 00 38 E8 00 4E D5 00 54
1666.953 : 15:00:17 EW data line 06 27 00 00 00 00 22 05 00
1666.953 : 15:00:17 Data: 00 38 E8 00 4E D5 00 54 27 00 00 00 00 22 05 00
1667.000 : 15:00:17 EW data line 07 05 3D E2 00 4B C5 00 B6
1667.000 : 15:00:17 EW data line 08 27 00 03 00 02 D6 04 00
1672.906 : WOW update done
1672.906 : 15:00:23 WOW Response Code: 404 Response =
1676.890 : 15:00:27 USB device is plugged in
1676.890 : 15:00:27 request EW data block, written = 9, addr = 000000
1676.906 : 15:00:27 EW data line 01 55 AA FF FF FF FF FF FF
1676.906 : 15:00:27 EW data line 02 FF FF FF FF FF FF FF FF
1676.922 : 15:00:27 EW data line 03 05 20 08 80 11 00 3F 0A
1676.922 : 15:00:27 EW data line 04 01 00 00 F0 0F 00 B0 85
1676.922 : 15:00:27 USB device is plugged in
1676.937 : 15:00:27 request EW data block, written = 9, addr = 0085B0
1676.953 : 15:00:27 EW data line 05 00 38 E8 00 4E D5 00 54
1676.953 : 15:00:27 EW data line 06 27 00 00 00 00 22 05 00
1676.953 : 15:00:27 Data: 00 38 E8 00 4E D5 00 54 27 00 00 00 00 22 05 00
1677.000 : 15:00:27 EW data line 07 05 3D E2 00 4B C5 00 B6
1677.000 : 15:00:27 EW data line 08 27 00 03 00 02 D6 04 00
1686.890 : 15:00:37 USB device is plugged in
1686.890 : 15:00:37 request EW data block, written = 9, addr = 000000
1686.906 : 15:00:37 EW data line 01 55 AA FF FF FF FF FF FF
1686.922 : 15:00:37 EW data line 02 FF FF FF FF FF FF FF FF
1686.922 : 15:00:37 EW data line 03 05 20 08 80 11 00 3F 0A
1686.937 : 15:00:37 EW data line 04 01 00 00 F0 0F 00 B0 85
1686.937 : 15:00:37 USB device is plugged in
1686.937 : 15:00:37 request EW data block, written = 9, addr = 0085B0
1686.953 : 15:00:37 EW data line 05 00 38 E8 00 4E D5 00 54
1686.968 : 15:00:37 EW data line 06 27 00 00 00 00 22 05 00
1686.968 : 15:00:37 Data: 00 38 E8 00 4E D5 00 54 27 00 00 00 00 22 05 00
1687.000 : 15:00:37 EW data line 07 05 3D E2 00 4B C5 00 B6
1687.000 : 15:00:37 EW data line 08 27 00 03 00 02 D6 04 00
1688.906 : 15:00:39 Exit ftpthreadexecute
1688.906 : 15:00:39 Logging out
1688.906 : 15:00:39 FTP Session Closed
1688.906 : 15:00:39 FTP quit done
1688.906 : 15:00:39 Enabling web update
1688.906 : 15:00:39 Exit ftpthreadfinish
1696.890 : 15:00:47 USB device is plugged in

I will check again at 15:15.

Re: Met Office WOW has stopped recording data

Posted: Tue 31 Jul 2012 2:21 pm
by BigDave
Degub.log is telling me little more than before:


2549.859 : 31/07/2012 15:15:00 Minute timer 15
2549.859 : Adding LH entry, ts = 15:15:00 raintot = 394.200012207031
2549.859 : TD = 0.0833333358168602 Lastval = 394.200012207031 Firstval = 394.200012207031 rate = 0
2549.859 : raindiff = 0rainmult = 1
2549.859 : 15:15:00 Creating WXNow File
2550.250 : Creating web graphs
2551.531 : 15:15:02 Updating WOW
2551.531 : http://wow.metoffice.gov.uk/automaticre ... s%20v1.9.3

2551.531 : 15:15:02 Logging in to [IP ADDRESS ALTERED]
2556.890 : 15:15:07 USB device is plugged in
2556.890 : 15:15:07 request EW data block, written = 9, addr = 000000
2556.906 : 15:15:07 EW data line 01 55 AA FF FF FF FF FF FF
2556.922 : 15:15:07 EW data line 02 FF FF FF FF FF FF FF FF
2556.922 : 15:15:07 EW data line 03 05 20 08 80 11 00 3F 0A
2556.937 : 15:15:07 EW data line 04 01 00 00 F0 0F 00 E0 85
2566.890 : 15:15:17 USB device is plugged in
2566.890 : 15:15:17 request EW data block, written = 9, addr = 000000
2566.906 : 15:15:17 EW data line 01 55 AA FF FF FF FF FF FF
2566.922 : 15:15:17 EW data line 02 FF FF FF FF FF FF FF FF
2566.922 : 15:15:17 EW data line 03 05 20 08 80 11 00 3F 0A
2566.937 : 15:15:17 EW data line 04 01 00 00 F0 0F 00 E0 85
2566.937 : 15:15:17 USB device is plugged in
2566.937 : 15:15:17 request EW data block, written = 9, addr = 0085E0
2566.953 : 15:15:17 EW data line 05 00 38 E8 00 50 D0 00 55
2566.968 : 15:15:17 EW data line 06 27 00 03 00 0C 22 05 00
2566.968 : 15:15:17 Data: 00 38 E8 00 50 D0 00 55 27 00 03 00 0C 22 05 00
2566.984 : 15:15:17 EW data line 07 05 3D E2 00 49 CA 00 B5
2567.015 : 15:15:17 EW data line 08 27 00 00 00 0C D6 04 00
2572.656 : WOW update done
2572.656 : 15:15:23 WOW Response Code: 404 Response =
2576.890 : 15:15:27 USB device is plugged in
2576.890 : 15:15:27 request EW data block, written = 9, addr = 000000
2576.906 : 15:15:27 EW data line 01 55 AA FF FF FF FF FF FF
2576.922 : 15:15:27 EW data line 02 FF FF FF FF FF FF FF FF
2576.922 : 15:15:27 EW data line 03 05 20 08 80 11 00 3F 0A
2576.937 : 15:15:27 EW data line 04 01 00 00 F0 0F 00 E0 85
2576.937 : 15:15:27 USB device is plugged in
2576.937 : 15:15:27 request EW data block, written = 9, addr = 0085E0
2576.953 : 15:15:27 EW data line 05 00 38 E8 00 50 D0 00 55
2576.968 : 15:15:27 EW data line 06 27 00 03 00 0C 22 05 00
2576.968 : 15:15:27 Data: 00 38 E8 00 50 D0 00 55 27 00 03 00 0C 22 05 00
2577.000 : 15:15:27 EW data line 07 05 3D E2 00 49 CA 00 B5
2577.000 : 15:15:27 EW data line 08 27 00 00 00 0C D6 04 00
2586.890 : 15:15:37 USB device is plugged in
2586.890 : 15:15:37 request EW data block, written = 9, addr = 000000
2586.906 : 15:15:37 EW data line 01 55 AA FF FF FF FF FF FF
2586.922 : 15:15:37 EW data line 02 FF FF FF FF FF FF FF FF
2586.922 : 15:15:37 EW data line 03 05 20 08 80 11 00 3F 0A
2586.937 : 15:15:37 EW data line 04 01 00 00 F0 0F 00 E0 85
2586.937 : 15:15:37 USB device is plugged in
2586.937 : 15:15:37 request EW data block, written = 9, addr = 0085E0
2586.953 : 15:15:37 EW data line 05 00 38 E8 00 50 D0 00 55
2586.968 : 15:15:37 EW data line 06 27 00 03 00 0C 22 05 00
2586.968 : 15:15:37 Data: 00 38 E8 00 50 D0 00 55 27 00 03 00 0C 22 05 00
2587.000 : 15:15:37 EW data line 07 05 3D E2 00 49 CA 00 B5
2587.000 : 15:15:37 EW data line 08 27 00 00 00 0C D6 04 00
2588.547 : 15:15:39 Exit ftpthreadexecute
2588.547 : 15:15:39 Logging out
2588.547 : 15:15:39 FTP Session Closed
2588.547 : 15:15:39 FTP quit done
2588.547 : 15:15:39 Enabling web update
2588.547 : 15:15:39 Exit ftpthreadfinish
2596.890 : 15:15:47 USB device is plugged in
2596.890 : 15:15:47 request EW data block, written = 9, addr = 000000
2596.922 : 15:15:47 EW data line 01 55 AA FF FF FF FF FF FF
2596.922 : 15:15:47 EW data line 02 FF FF FF FF FF FF FF FF
2596.937 : 15:15:47 EW data line 03 05 20 08 80 11 00 3F 0A
2596.937 : 15:15:47 EW data line 04 01 00 00 F0 0F 00 E0 85
2596.937 : 15:15:47 USB device is plugged in
2596.953 : 15:15:47 request EW data block, written = 9, addr = 0085E0
2596.968 : 15:15:47 EW data line 05 00 38 E8 00 50 D0 00 55
2596.968 : 15:15:47 EW data line 06 27 00 03 00 0C 22 05 00
2596.968 : 15:15:47 Data: 00 38 E8 00 50 D0 00 55 27 00 03 00 0C 22 05 00
2597.015 : 15:15:47 EW data line 07 05 3D E2 00 49 CA 00 B5
2597.015 : 15:15:47 EW data line 08 27 00 00 00 0C D6 04 00
2606.890 : 15:15:57 USB device is plugged in
2606.890 : 15:15:57 request EW data block, written = 9, addr = 000000
2606.906 : 15:15:57 EW data line 01 55 AA FF FF FF FF FF FF
2606.922 : 15:15:57 EW data line 02 FF FF FF FF FF FF FF FF
2606.922 : 15:15:57 EW data line 03 05 20 08 80 11 00 3F 0A
2606.937 : 15:15:57 EW data line 04 01 00 00 F0 0F 00 E0 85
2606.937 : 15:15:57 USB device is plugged in
2606.937 : 15:15:57 request EW data block, written = 9, addr = 0085E0
2606.953 : 15:15:57 EW data line 05 00 38 E8 00 50 D1 00 55
2606.968 : 15:15:57 EW data line 06 27 00 00 00 07 22 05 00
2606.968 : 15:15:57 Data: 00 38 E8 00 50 D1 00 55 27 00 00 00 07 22 05 00
2606.984 : 15:15:57 EW data line 07 05 3D E2 00 49 CA 00 B5
2606.984 : 15:15:57 EW data line 08 27 00 00 00 0C D6 04 00
2609.531 : 31/07/2012 15:16:00 Minute timer 16
2609.531 : Adding LH entry, ts = 15:16:00 raintot = 394.200012207031
2609.531 : TD = 0.0833333358168602 Lastval = 394.200012207031 Firstval = 394.200012207031 rate = 0
2609.531 : raindiff = 0rainmult = 1
2609.531 : 15:16:00 Creating WXNow File

Any idea what this error code might mean?
2572.656 : 15:15:23 WOW Response Code: 404 Response =

Re: Met Office WOW has stopped recording data

Posted: Tue 31 Jul 2012 2:52 pm
by steve
HTTP error 404 is "not found", so it's either a problem at WOW affecting your site, or (less likely) a DNS problem causing you to connect to the wrong server.

You could try pasting the URL from the debug log into your browser, putting in your pass code where the asterisks are, and sending it. If that updates correctly, then you could try restarting Cumulus as the DNS may have supplied the wrong address early this morning; restarting it may cause the correct address to be read.

Re: Met Office WOW has stopped recording data

Posted: Tue 31 Jul 2012 3:34 pm
by BigDave
Thanks Steve, I will give that a try, but before I do I am a little concerned that I might then have a "hole" in the data held on the WOW servers. Is there anything I can do to force Cumulus to catch up everything since 0130 this morning, and do I need to do this before "fixing" the problem?

Thanks in advance.

Re: Met Office WOW has stopped recording data

Posted: Tue 31 Jul 2012 3:56 pm
by steve
The only way to do that would be to 'rewind' all of your data using the files from a Cumulus backup, forcing it to re-download the data from the station's logger, which it would then send to WOW. You'll need to make sure uploads from Cumulus are being accepted again before you try that.

I see you have an entry from 16:40 - was that from a manual upload in a browser?

Edit: and now lots of other entries from earlier - I assume you have 'rewound'?

Re: Met Office WOW has stopped recording data

Posted: Tue 31 Jul 2012 3:59 pm
by BigDave
Update:

I think it must have been a DNS problem. I forced my router to refresh it's IP address, DNS primary and secondary servers, flushed the DNS on the server machine and the URL then started working, as did the uploading to WOW.

In order to then re-send the data to WOW, I edited the Jul12Log.txt file and the timestamp in the today.ini file causing cumulus to re-download the data since 01:30, which it then uploaded to WOW.

Perhaps a little surprisingly, WOW seemed quite happy to accept data timestamped prior to the most recent data and filled in it's graphs accordingly.

Thanks very much for your help on this one Steve!

OOPS! you beat me to it!