# This file sets out restrictions that most spiders and automatic # web-indexers voluntarily abide by. For more information, check out: # http://info.webcrawler.com/mak/projects/robots/norobots.html User-agent: * # Stay away from these: Disallow: /admin Disallow: /Balisage Disallow: /redirect.html Disallow: /peerrevform.txt Disallow: /ReviewAppForm.txt Disallow: /mlang.html Disallow: /people/usdin/Sassy.html Disallow: /papers/achallc2000/ Disallow: /guestbook/ Disallow: /Extreme/ Disallow: /temp/ Disallow: /stats/ Disallow: /collection/ Disallow: /commentform.txt Disallow: /DTD-Comment/ Disallow: /unicode/ Disallow: /extremereg.txt Disallow: /mulberry.css Disallow: /JATS-Con Disallow: /*.txt # Add more disallow lines for specific files that you do not want automated # web-searching tools to access, such as a membership list, or temporary # files that you intend to remove or rename quickly. For example: # Disallow: /year-end-clearance.html