文章内容
1、wordpress内置默认robots.txt
1 2 3 | User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php |
2、推荐robots.txt规则
01 02 03 04 05 06 07 08 09 10 11 12 13 14 15 16 | User-agent: * Disallow: /wp-admin/ Disallow: /wp-content/ Disallow: /wp-includes/ Disallow: /trackback/ Disallow: /comments/ Disallow: /attachment/ Disallow: /comments/feed Disallow: /feed Disallow: /*/feed Disallow: /*/comment-page-* Disallow: /*?replytocom=* Disallow: /*/trackback Disallow: /?s=* Disallow: /*/?s=* Disallow: /wp-*.php |