Indexing and Crawling

Crawling is the process of an engine requesting — and successfully downloading — a unique URL. Obstacles to crawling include no links to a URL, server downtime, robots exclusion, or using links (such as some JavaScript links) from which bots cannot find a valid URL.

Indexing is the result of successful crawling. I consider a URL to be indexed (by Google) when an info: or cache: query produces a result, signifying the URL’s presence in the Google index. Obstacles to indexing can include duplication (the engine might decide to index only one version of content for which it finds many nearly identical URLs), unreliable server delivery (the engine may decide to not index a page that it can access during only one-third of its attempts), and so on.
 
Caching is the process or reading through your webpage source by search engine spiders. They provide a cache certificate after a successful crawl. Indexing is updating the cached webpages in search engine database. Indexed webpages are now ready for search engine rankings.
 
Hello friends,


I would like to know that What is the difference between Indexing and Crawling ?

When search engine crawlers visit any link is called crawling and when crawlers save or index that links in search engine database is called indexing.
 
Back
Top