Robots Text Editor


Robots Text Editor

Robots Text Editor / Generator

Create / Edit your Robots Txt file with our free Generator / Editor

Enter Your website URL   ( If it comes back blank try with or without www )


Robots Text File Editor
Search Engine   ⁄   Engines -- Use * for all or Engine Agent name
  Agent Name
Copy and paste your Text to your robots.txt file
robots.txt

To allow all robots all of the website
User-agent: *
Disallow:

To exclude all robots from all of the webiste
User-agent: *
Disallow: /

To exclude all robots from part of the website
User-agent: *
Disallow: /cgi-bin/

You can also disallow a page
User-agent: *
Disallow: /testers/test.html

You must have a forward slash before and after a folder name!