# Robots.txt file created by http://www.webtoolcentral.com # For domain: http://slba.org.uk # All robots will spider the domain User-agent: * Disallow: /updates/ Disallow: /stats/ # Disallow Scooter/1.0 User-agent: Scooter/1.0 Disallow: / # Disallow Scooter/3.2 User-agent: Scooter/3.2 Disallow: /