S sarvodyaseo New member Oct 27, 2014 #2 there are two method to control to bots via robots.txt and use of robot meta in page.
R RH-Calvin New member Oct 28, 2014 #3 Robots can be controlled either by a Sitemap or a Robots.txt file. Sitemap helps the robots to crawl webpages, while Robots.txt file lists webpages that you want to restrict form robots to crawl.
Robots can be controlled either by a Sitemap or a Robots.txt file. Sitemap helps the robots to crawl webpages, while Robots.txt file lists webpages that you want to restrict form robots to crawl.
K kaurdevinder New member Nov 3, 2014 #5 You can use robots.txt file to control robot.It is best method.