nancyisabell
New member
Hii friends,
What is robots.txt? What is its use?
What is robots.txt? What is its use?
Hii friends,
What is robots.txt? What is its use?
I agree wityh you and well said dear.Robot.txt is a text file which you put in your website to tell search engine which pages you would like not to crawl.
I am gonna give you some idea how to create Robot.tex. Please have a look below:
User Agent: *
Disallow: /Admin/
Disallow: /ce/
Disallow: /dp/
Disallow: /cid-pi-ap/