# The following disallows all search engines and robots from crawling the directory and pages: Sitemap: http://www.3gb.com.au/sitemap.xml Sitemap: http://www.3gb.com.au/Blog/sitemap.axd Sitemap: http://www.3gb.com.au/blog_sitemap.xml Sitemap: http://www.3gb.com.au/crm_dictionary_sitemap.xml Sitemap: http://www.3gb.com.au/crm_guide.xml User-agent: * Disallow: /admin/