Page 1 of 1
Google indexing .txt weather files
Posted: Wed 10 Jul 2013 10:11 am
by Worf
Very strange. Google has started indexing all .txt files relating to my weather station. If you search for "
www.finghall.com" (as typed) you will see what I mean. Is there a way of adding something to the template for those pages to stop robots crawling them? Thanks.
Re: Google indexing .txt weather files
Posted: Wed 10 Jul 2013 10:17 am
by steve
Re: Google indexing .txt weather files
Posted: Wed 10 Jul 2013 10:30 am
by Worf
Many thanks for that. I realise I can block individual txt files, but which template file do I need to edit in Cumulus to ensure that all newly generated files contain the "no robots" info?
Re: Google indexing .txt weather files
Posted: Wed 10 Jul 2013 10:33 am
by steve
You don't put it in the files themselves, you put it in the robots.txt file.
Re: Google indexing .txt weather files
Posted: Wed 10 Jul 2013 11:23 am
by Worf
Understood. Just me being thick!
Many thanks
Bruce