# robots.txt, justicescrapers.com 11/26/2008 # User-agent: * Disallow: /includes/ Disallow: /aspnet_client/ Disallow: /logs/ sitemap: http://www.justicescrapers.com/sitemap.xml User-agent: TurnitinBot Disallow: / #Will disallow all urls on your site