# ROBOTS.TXT FOR http://www.villapolis.com # ALLOWS ALL ROBOTS TO INDEX ALL FILES # EXCEPT THOSE IN THE FOLLOWING FOLDERS: # /Admin, /Propman, /Payments, /JavaScript, # /Invoices, /Temp, /Customers, /Configuration AND /Secure folders User-agent: * Disallow: /Propman/ Disallow: /Secure/ Disallow: /Admin/ Disallow: /Payments/ Disallow: /JavaScript/ Disallow: /Invoices/ Disallow: /Temp/ Disallow: /Customers/ Disallow: /Configuration/ #ROBOT MJ12bot MAY BE THE CAUSE OF WEB SITE FAILURES DUE TO HEAVY LOAD (NOV 2008) User-Agent: MJ12bot Crawl-Delay: 20 #ROBOT WorldIndexer MAY BE THE CAUSE OF WEB SITE FAILURES DUE TO HEAVY LOAD (NOV 2008) User-Agent: WorldIndexer Crawl-Delay: 20