How To Write A Good Robots.txt File. All in one seo will show your existing robots.txt file in the ‘robots.txt preview’ section at the bottom of your screen. If you want to instruct all robots to stay away from your site, then this is the code you should put in your robots.txt to disallow all:
![Meta Robots Tag [noindex, nofollow] Moz](https://i2.wp.com/moz-static.s3.amazonaws.com/learn/seo/Robots.txt-and-Robots-meta-directives/Picture1.png?mtime=20170427084857)
Select edit next to the custom robots.txt file and check the yes box. Our robots.txt generator tool is designed to help webmasters, seos, and marketers generate their robots.txt files without a lot of technical knowledge. The presence of this file is not compulsory for the operation of the website, but at the.
