Robots.txt Generator

50 FREE Professional SEO Tools For Site Monitoring

Robots.txt Generator


Default - All Robots are:  
    
Crawl-Delay:
    
Sitemap: (leave blank if you don't have) 
     
Search Robots: Google
  Google Image
  Google Mobile
  MSN Search
  Yahoo
  Yahoo MM
  Yahoo Blogs
  Ask/Teoma
  GigaBlast
  DMOZ Checker
  Nutch
  Alexa/Wayback
  Baidu
  Naver
  MSN PicSearch
   
Restricted Directories: The path is relative to root and must contain a trailing slash "/"
 
 
 
 
 
 
   



Now, Create a 'robots.txt' file at the your root directory of your site. Copy the above text and paste it into the text file 'robots.txt' you created and save it.


About Robots.txt Generator

Our Robot txt Generator is a simple SEO tool that can locate the root of your domain or website. It can be used to generate proper robot txt directives and help search engines spot and determine the existing files and directories that should to be blocked or indexed and then generates the Robot.txt file for your domain.