User-agent: * Disallow: /intranet/ Disallow: /en/intranet/ Disallow: /download/ Disallow: /en/download/ Disallow: /cgi-bin/ Disallow: /wp-admin/ Disallow: /archives/ Disallow: /wp-content/plugins/ Disallow: /readme.html Disallow: /refer/ Disallow: /wp-includes/ Disallow: /comments/feed/