User-agent: * Disallow: /admin/ Disallow: /extranet/ Disallow: /401 Disallow: /403 Disallow: /404 Disallow: /500 Disallow: /503 Disallow: /_