Page 1 of 4
realtime.txt
Posted: Fri 17 Oct 2008 6:53 pm
by steve
The 1.8.2 beta is looking reasonable, so I want to make it the proper release version shortly.
I've added a few items on to the end of the existing realtime.txt file, mainly so that the amount of configuration needed in banner.php can be reduced.
The format is now:
Code: Select all
Example: 17/10/08 19:35:10 9.8 92 8.5 18.7 23.0 217 0.0 3.4 1006.6 SW 5 mph °C mb mm 1.8.2
Field Example Description
1 17/10/08 date (always dd/mm/yy)
2 19:35:10 time (always hh:mm:ss)
3 9.8 outside temperature
4 92 relative humidity
5 8.5 dewpoint
6 18.7 wind speed (average)
7 23.0 wind speed (gust)
8 217 wind bearing
9 0.0 current rain rate
10 3.4 rain today
11 1006.6 barometer
12 SW wind direction
13 5 wind speed (beaufort)
14 mph wind units
15 °C temperature units
16 mb pressure units
17 mm rain units
18 1.8.2 Cumulus version
Is there anything else that I can
easily add at this point that would be useful?
Re: realtime.txt
Posted: Fri 17 Oct 2008 8:09 pm
by TNETWeather
Need to look at it more, but I would take the Degree symbol out, just leave the C or F. Any script that is going to use that can easily have the degree symbol in their output (however it needs to be done) by default and only need to know if it is C or F and any script would be able to convert data knowing it was C or F if it wanted to show the opposite value format.
The degree symbol can cause issues in some scripts because it is an 8bit character unlike the rest.
I would need to change the collector scripts as they don't deal with N length (like they should). but I could have that fix tonight. I was planning on doing that anyway as I realized the other night it would be an issue if you extended the file.
As to other values...
Indoor temp might be nice. (I monitor that to make sure it doesn't get too high).
I had a list of values that I was collecting via current available tags in the article:
https://cumulus.hosiene.co.uk/viewtopic.php?f=4&t=147
I see I posted it in the wrong area.
Not sure you want to go that far for a file that is uploaded every minute (or sooner)... but I am uploading all the tags now in that same interval without any issues. I would think you have all of those tags already at your fingertips since you are already using them as you process output files.
Sample output of that looks like below and is not that large:
Code: Select all
2008-10-17 13:05 92.4 20 45.5 2.4 176 F1 5.0 1016.6 32.5 -0.9 0.00 0.01 9.82 0.00 0.00 83.9 26 92.4 +1.4 92.6 12:36 61.4 04:06 8.4 09:58 17.6 09:21 1019.6 08:15
Missing is some of the redundant info that you were using for the realtime SWF script (wind speed info) but that could be added back in.
Many of the values included in that allow for more complete graphs and web templates. In graphs ... A rain Graph that shows Month to date as well as todays rain. In a web template, you can easily create a historical table showing the last hour or hours of values...
That file layout comes the closest to that basics of what WD outputs in what it calls the clientraw.txt file (though it has a lot more info in it).
Re: realtime.txt
Posted: Fri 17 Oct 2008 10:14 pm
by dc1500
Can the monthly rainfall and annual rainfall be directly edited in the display? If not is that a possibility?
Dave
Re: realtime.txt
Posted: Sat 18 Oct 2008 9:16 am
by steve
dc1500 wrote:Can the monthly rainfall and annual rainfall be directly edited in the display? If not is that a possibility?
You mean change the values in the (proposed) realtime.txt file? I don't really see how that would work?
Re: realtime.txt
Posted: Sat 18 Oct 2008 9:35 am
by dc1500
Ermm, what do I mean?! This is probably wrong thread. If the "This Month" rainfall amount is wrong due to earlier false rainfall figures or misediting how can the monthly figure be corrected. I'm not sure how it calculates it. Is it a running total from the <month08.txt> log file?
Dave
Re: realtime.txt
Posted: Sat 18 Oct 2008 9:41 am
by steve
dc1500 wrote:Ermm, what do I mean?! This is probably wrong thread.
Ah, right
If the "This Month" rainfall amount is wrong due to earlier false rainfall figures or misediting how can the monthly figure be corrected. I'm not sure how it calculates it. Is it a running total from the <month08.txt> log file?
Dave
The monthly and annual totals are calculated from the daily totals in the dayfile.txt, so strictly speaking, to correct the monthly and annual totals you really need to correct the daily totals. I realise that editing the data files is a bit tricky and error-prone, and I
will do something about it eventually. The CSV editor that Phil found makes it a bit easier.
Re: realtime.txt
Posted: Sat 18 Oct 2008 10:57 am
by Paul C
Steve
You mention in previous posts that in new versions of cumulus you wanted to move to a datbase that was online (stored on the server) so you can access it any time and create graphs and charts. Is this the start of it with the "realtime.txt" etc or have I got the wrong end of the stick ?
As the previous poster "DC1500" wa asking. I woulndt mind if the database was editable, especially the rainfall. If an inbuilt editing function could be written into cumulus that would be help. I still have big differences at times with my AWS rain gauge and my Met Gauge. Only a few mm, but they do add up over time - perhaps this suggestion/takling point should be moved to another section of the forum, apologies.
Re: realtime.txt
Posted: Sat 18 Oct 2008 11:22 am
by steve
Paul C wrote:Steve
You mention in previous posts that in new versions of cumulus you wanted to move to a datbase that was online (stored on the server) so you can access it any time and create graphs and charts. Is this the start of it with the "realtime.txt" etc or have I got the wrong end of the stick ?
What I had in mind was a 'real' online MySQL database with all of your data in it (my proposed change to storing data locally would also be a MySQL database, so the two could just be sychronised somehow). So it's separate from the realtime stuff, but it's similar in what it lets you do (it would let you select any range of data to be plotted, as far back as you wanted, for example).
As the previous poster "DC1500" wa asking. I woulndt mind if the database was editable, especially the rainfall. If an inbuilt editing function could be written into cumulus that would be help. I still have big differences at times with my AWS rain gauge and my Met Gauge. Only a few mm, but they do add up over time - perhaps this suggestion/takling point should be moved to another section of the forum, apologies.
Again, the move to storing the data locally in a MySQL database makes editing the data much easier.
Re: realtime.txt
Posted: Sat 18 Oct 2008 3:13 pm
by steve
This is my new proposed realtime.txt format (as now in operation on sanday.org.uk/weather)
Code: Select all
Example: 18/10/08 16:03:45 8.4 84 5.8 24.2 33.0 261 0.0 1.0 999.7 W 6 mph C mb mm 146.6 +0.1 85.2 588.4 11.6 20.3 57 3.6 -0.7 10.9 12:00 7.8 14:41 37.4 14:38 44.0 14:28 999.8 16:01 998.4 12:06 1.8.2
Field Example Description
1 18/10/08 date (always dd/mm/yy)
2 16:03:45 time (always hh:mm:ss)
3 8.4 outside temperature
4 84 relative humidity
5 5.8 dewpoint
6 24.2 wind speed (average)
7 33.0 wind speed (gust)
8 261 wind bearing
9 0.0 current rain rate
10 1.0 rain today
11 999.7 barometer
12 W wind direction
13 6 wind speed (beaufort)
14 mph wind units
15 C temperature units
16 mb pressure units
17 mm rain units
18 146.6 wind run (today)
19 +0.1 pressure trend value
20 85.2 monthly rain
21 588.4 yearly rain
22 11.6 yesterday's rainfall
23 20.3 inside temperature
24 57 inside humidity
25 3.6 wind chill
26 -0.7 temperature trend value
27 10.9 today's high temp
28 12:00 time of today's high temp (hh:mm)
29 7.8 today's low temp
30 14:41 time of today's low temp (hh:mm)
31 37.4 today's high wind speed (average)
32 14:38 time of today's high wind speed (average) (hh:mm)
33 44.0 today's high wind gust
34 14:28 time of today's high wind gust (hh:mm)
35 999.8 today's high pressure
36 16:01 time of today's high pressure (hh:mm)
37 998.4 today's low pressure
38 12:06 time of today's low pressure (hh:mm)
39 1.8.2 Cumulus version
Look OK?
Re: realtime.txt
Posted: Sat 18 Oct 2008 3:47 pm
by TNETWeather
Yep.
.... short response...
Re: realtime.txt
Posted: Sat 18 Oct 2008 5:54 pm
by TNETWeather
The transition hath begun...
Code: Select all
2008-10-18 10:41:40 86.3 22 43.0 2.4 0.0 23 0.00 0.00 1016.6 NNE 1 mph
2008-10-18 10:42:39 86.3 21 41.8 1.2 1.0 23 0.00 0.00 1016.6 NNE 1 mph
2008-10-18 10:42:39 86.3 21 41.8 1.2 1.0 23 0.00 0.00 1016.6 NNE 1 mph
2008-10-18 10:42:39 86.3 21 41.8 1.2 1.0 23 0.00 0.00 1016.6 NNE 1 mph
2008-10-18 10:45:32 86.3 21 41.8 1.2 5.0 115 0.00 0.00 1016.5 ESE 1 mph F hPa in 5.1 0.0 0.01 9.82 0.00 84.5 25 86.3 0 86.5 10:35 61.9 04:35 2.4 06:02 7.6 06:13 1017.1 08:33 1015.3 03:08 1.8.2
2008-10-18 10:46:32 86.5 21 41.9 1.2 5.0 115 0.00 0.00 1016.6 ESE 1 mph F hPa in 5.1 0.0 0.01 9.82 0.00 84.5 25 86.5 +0.2 86.5 10:35 61.9 04:35 2.4 06:02 7.6 06:13 1017.1 08:33 1015.3 03:08 1.8.2
2008-10-18 10:47:32 86.4 21 41.8 1.2 5.0 114 0.00 0.00 1016.5 ESE 1 mph F hPa in 5.2 0.0 0.01 9.82 0.00 84.3 25 86.4 +0.3 86.5 10:35 61.9 04:35 2.4 06:02 7.6 06:13 1017.1 08:33 1015.3 03:08 1.8.2
2008-10-18 10:48:32 86.4 21 41.8 1.2 2.5 114 0.00 0.00 1016.5 ESE 1 mph F hPa in 5.2 0.0 0.01 9.82 0.00 84.5 25 86.4 +0.2 86.5 10:35 61.9 04:35 2.4 06:02 7.6 06:13 1017.1 08:33 1015.3 03:08 1.8.2
2008-10-18 10:49:32 86.8 22 43.4 1.2 6.3 169 0.00 0.00 1016.5 S 1 mph F hPa in 5.2 0.0 0.01 9.82 0.00 84.3 25 86.8 +0.3 86.8 10:49 61.9 04:35 2.4 06:02 7.6 06:13 1017.1 08:33 1015.3 03:08 1.8.2
2008-10-18 10:50:32 87.1 21 42.4 1.2 6.3 178 0.00 0.00 1016.5 S 1 mph F hPa in 5.2 0.0 0.01 9.82 0.00 84.3 25 87.1 +0.7 87.1 10:50 61.9 04:35 2.4 06:02 7.6 06:13 1017.1 08:33 1015.3 03:08 1.8.2
Re: realtime.txt
Posted: Sat 18 Oct 2008 9:28 pm
by pinto
No!
Code: Select all
18/10/08 23:26:02 8.4 87 6.4 0.0 1.6 191 0.0 0.0 1020.6 S 0 kph C hPa mm 73,5 0,0 41,6 41,6 0,0 21,4 54 8,4 -0,1 15,0 15:09 2,7 06:09 12,9 14:34 25,7 14:52 1021,1 00:00 1018,5 18:03 1.8.2
dots or comma's (I love dots, easy to do calculations in PHP)
@Kevin:your PHP log-script is working OK, it writes the values as they are(dots or comma's)
Re: realtime.txt
Posted: Sat 18 Oct 2008 9:58 pm
by TNETWeather
Should work as long as the delimiter is a space. It only looks at the date to reformat it, everything else is just sent out as it was.
Re: realtime.txt
Posted: Sat 18 Oct 2008 10:03 pm
by pinto
Only an idea: can Steve add the buildnumber to the realtime.txt
so you can add it to the banner-script
when people have something to ask AND use the banner it is easy for Steve to see what version and build they are using
version 1.8.2-b453
Re: realtime.txt
Posted: Sun 19 Oct 2008 11:40 am
by steve
pinto wrote:dots or comma's (I love dots, easy to do calculations in PHP)
Oops, well spotted. I forgot to standardise on dots for the new values. I'll fix it...