robots.txt is blocking all spiders

[boopika]

what does it "robots.txt is blocking all spiders" mean?

 

[RH-Calvin]

Robots.txt is a text file which enlists all webpages that you want to restrict from search engine spiders. These pages are human visible but are never crawled by Google spiders and hence never cached and indexed.

 

[davidweb09]

You have to edit your robots.txt file to allow complete website for Google indexing.

 

[Sara James]

The User-agent: rule specifies which User-agent the rule applies to, and * is a wildcard matching any User-agent. Disallow: sets the files or folders that are not allowed to be crawled.

 

[amar495]

google will not follow no index rules in robots.txt, you must use meta no index