User-agent: * Disallow: /logs/ Disallow: /site_dev/ Disallow: /admin/