• support@seotoolserp.com

Robots.txt Generator


Default - All Robots are:  
    
Crawl-Delay:
    
Sitemap: (leave blank if you don't have) 
     
Search Robots: Google
  Google Image
  Google Mobile
  MSN Search
  Yahoo
  Yahoo MM
  Yahoo Blogs
  Ask/Teoma
  GigaBlast
  DMOZ Checker
  Nutch
  Alexa/Wayback
  Baidu
  Naver
  MSN PicSearch
   
Restricted Directories: The path is relative to root and must contain a trailing slash "/"
 
 
 
 
 
 
   



Now, Create 'robots.txt' file at your root directory. Copy above text and paste into the text file.


About Robots.txt Generator

Hay Welcome to SeoToolSerp Robots.txt Generator Tool, a tool that will for sure prove terribly helpful to webmasters in creating their sites Googlebot friendly. primarily, what this free tool will is to supply the mechanism.txt file.

Our Robots.txt Generator Tool for wordpress has created the lives of webmasters straightforward by doing an advanced task on its own and with simply some clicks of the mouse, this tool can generate a Googlebot friendly robots.txt file.
Robots.txt is Associate in Nursing awful tool for website homeowners, and it'll build their lives abundant easier than before.

This tool includes a easy interface, and you have got the choice to pick out that things ought to be enclosed insidethe robots.txt file and that not. Here's however you'll be able to build use of this SEO tool:

• Choose whether or not you would like all robots or simply some robots to own access to your site's files. All robots ar allowed by default.
• Choose what proportion delay there ought to be within the crawls. you'll be able to choose your most popularpossibility from five seconds to a hundred and twenty seconds. By default, we've set it 'no delay'.
• If you have got your site's sitemap, then paste it here. Otherwise, you'll be able to proceed.
• Select that larvas will crawl your net and select any bot that you do not need to crawl your site's files.
• The last step is to limit directories. the trail is relative to root and should contain a trailing slash "/".
• After you have got generated Googlebot friendly robots.txt file mistreatment our Robots.txt Generator Tool for site, it is the time to transfer it to the basis directory of your website.

Using SeoToolSerp Robots.txt generator, webmasters will instruct any robots that records or files in your website's root index ought to be crawled crept by the Googlebot. you'll be able to even choose that specificmechanism you would like to own entry to your site's index and confine totally different robots from doing likewise. you'll be able to conjointly instruct that that mechanism ought to get access to files your site's root catalog and that mechanism ought to get access to a different file.