E edwina New member Feb 28, 2015 #2 Use following thinks to control the robot, >robot.txt >robot meta tag
R RH-Calvin New member Mar 3, 2015 #3 Robots.txt file is a good way to control the robots for your website pages.
D davidweb09 Active member Mar 4, 2015 #4 Robots.txt file. other way is to add robots tag in header tags.