# Disallow all crawlers access to certain pages. sitemap: http://www.shinyorb.com/sitemap.xml.gz User-agent: * Disallow: /dev/ Disallow: /admin/ Disallow: /testzone/ Disallow: /old/ Disallow: /beta/private/ Disallow: /static/cr/ Disallow: /cjfeeds/ Disallow: /sort_images/ # Disallow: /rooms/