robots.txt文件示例

版权声明:本文为博主原创文章,欢迎转载,请注明出处 https://blog.csdn.net/mouday/article/details/91361874
# robots.txt generated at http://tool.chinaz.com/robots/ 
User-agent: *
Disallow: 
Crawl-delay: 10
Sitemap: http://domain.com/sitemap.xml

robots文件生成:http://tool.chinaz.com/robots/

猜你喜欢

转载自blog.csdn.net/mouday/article/details/91361874