## Disallow all crawlers access to certain pages. User-agent: * Disallow: /checkout.asp Disallow: /add_cart.asp Disallow: /view_cart.asp Disallow: /error.asp Disallow: /shipquote.asp Disallow: /rssfeed.asp Disallow: /Useful-Lilnks_ep_32.html Disallow: /Store-Policy_ep_30.html Disallow: /Returns-Exchanges_ep_31.html Disallow: /contact-us_ep_5.html Disallow: /Terms-of-Use_ep_28.html User-agent: ShopWiki Crawl-Delay: 5 http://www.theheadshoponline.com/sitemap.xml