Why we use nofollow in Robot.txt?

LisaHandson89

New member
Initially, the nofollow attribute appeared in the page-level meta tag, and instructed web indexes not to not to followr (i.e., crawl) any outgoing links on the page. For instance:

<meta name="robots" content="nofollow"/>

Before nofollow was utilized on individual links, keeping robots from following individual links on a page required a great deal of effort (for instance, redirecting the link to a URL blocked in robots.txt). That is the reason the nofollow attribute value of the rel attribute was made. This gives webmasters more granular control: rather than advising search engines and bots not to follow any links on the page, it gives you a chance to effectively instruct robots not to crawl a particular links.
 
Back
Top