Page 1 of 1

PWS weather Catchup

Posted: Sun 11 Dec 2011 9:44 am
by rich27gc
I have recently started sending data to PWS weather, because I shutdown Cumulus at night I rely on catchup to fill the gaps in the data but it does not seem to be working. I use catchup on WOW and WU and they work OK.

Any suggestions?

Re: PWS weather Catchup

Posted: Sun 11 Dec 2011 11:01 am
by steve
Perhaps it was unable to contact the PWS site. Look in the diags file for error messages.

Re: PWS weather Catchup

Posted: Sun 11 Dec 2011 11:45 am
by rich27gc
Thanks for reply Steve
Have looked at the diags file and all seems to upload OK, I get the message 11/12/2011 08:45:34.997 : PWS archive upload complete
Strangly I do receive the odd error for both WU and WOW, but they work OK.

Re: PWS weather Catchup

Posted: Sun 11 Dec 2011 3:26 pm
by steve
Sorry, I've no idea, then. I spent an hour earlier today testing it, and the 'catch up' uploads to PWS worked fine. PWS Weather use the same software as WU, so the uploads are pretty much identical. If you look at the generated URLs in the diags files, you should see that the URLs are very similar, so what works for WU should work for PWS (as it does for me).

Re: PWS weather Catchup

Posted: Sun 11 Dec 2011 4:06 pm
by steve
It might be interesting to compare the URLs generated by Cumulus with the data on your PWS page. Something odd happened around 0843:
PWS - Station Observations for SHAP1 - Mozilla Firefox_2011-12-11_16-01-50.png
Some of those entries don't seem to belong there. I know that PWs and WU both tend to ignore the timestamps on some uploads and use the current time instead - I usually find that happens to the last 'catch up' upload; it appears that they do some sort of time 'correction' if the timestamp is in the recent past.

Re: PWS weather Catchup

Posted: Sun 11 Dec 2011 4:22 pm
by steve
You had the same glitch yesterday, as did I after my station was offline overnight due to the storm:

http://www.pwsweather.com/archivewx.php ... d=20111209

It looks like there's a bug at PWS Weather with the handling of 'back-dated' data that only shows up with large amounts of uploads (e.g. overnight catch up).

Re: PWS weather Catchup

Posted: Sun 11 Dec 2011 4:31 pm
by rich27gc
Not much we can do about that then, as I always shutdown at night this is going to happen. :?
I have just tried a small catchup and it did work OK.

Thanks for the time you spent on this Steve

Great service as always :clap:

Re: PWS weather Catchup

Posted: Sun 11 Dec 2011 4:37 pm
by steve
I've just noticed that I'm not encoding the colons in the time as %3A and I probably should be. Maybe this sometimes causes PWS a problem. I'll do some experimenting and get back to you.

Re: PWS weather Catchup

Posted: Sun 11 Dec 2011 5:26 pm
by steve
Please give 1.9.2 build 1023 a try (now in the download area); I've encoded colons correctly, so it might make PWS Weather happier.

Re: PWS weather Catchup

Posted: Sun 11 Dec 2011 5:30 pm
by rich27gc
Will try it and let you know tomorrow.

Thanks Steve

Re: PWS weather Catchup

Posted: Mon 12 Dec 2011 6:55 am
by rich27gc
Sorry Steve that has made no difference, just did the same this morning :(

Re: PWS weather Catchup

Posted: Mon 12 Dec 2011 8:50 am
by steve
I didn't think it would, to be honest. It might be worth contacting PWS Weather; they're clearly not handling the timestamps correctly.

Re: PWS weather Catchup

Posted: Mon 12 Dec 2011 4:53 pm
by rich27gc
OK will contact PWS weather and see what happens.

Thanks for the hard work.

Re: PWS weather Catchup

Posted: Tue 13 Dec 2011 6:39 pm
by rich27gc
Have had a reply from PWS weather and they said "PWS weather does not accept backfill at this time, it is planned for a future release".
Looks like I will have to wait for the future!