# Robots.txt # for domain: http://www.kernowbase.co.uk # All robots will spider the domain User-Agent: * Allow: /