版权声明:本文为博主原创文章,欢迎转载,请注明出处 https://blog.csdn.net/mouday/article/details/91361874
# robots.txt generated at http://tool.chinaz.com/robots/
User-agent: *
Disallow:
Crawl-delay: 10
Sitemap: http://domain.com/sitemap.xml
robots文件生成:http://tool.chinaz.com/robots/