Now, Create 'robots.txt' file at your root directory. Copy above text and paste into the text file.
Use this tool to create Robots.txt file for your domain as your settings.
We are doing rigorous testing and I would appreciate your valuable feedback to make this tool work better.
Please share your valuable feedback at Contact Us page.