# Robots.txt file for domain: http://www.onasia.com # All robots will spider the domain # User-agent: * # Disallow: # Disallow msnbot User-agent: msnbot Disallow: /system/ # Prevent attempted indexing of an old directory User-agent: * Disallow: /content/stories/