# Disallow all crawlers access to certain pages. User-agent: * Disallow: /directory Disallow: /pages/20.asp # Sitemap files Sitemap: http://www.csn.edu/sitemap.xml