[tech] robots.txt file

[Ian McKellar]

On Tue, Dec 05, 2000 at 05:33:15PM +0800, Mark Tearle wrote:
> A robots.txt file has been added to the UCC web site at
> http://www.ucc.gu.uwa.edu.au/ to exclude all user directories from
> search enginess (*due to BFK*)  (and so we can get put back in the
> UWA search engine again)

Would it be possible to only return that robots.txt for our uwa.edu.au
address and not our ucc.asn.au address? That way member pages would still
be indexed - but only at our non-UWA affiliated address?

Ian