spiders

[daffyduck]

sorry this might not be in the right section but can someone explain to me how google spiders work exactly?

[lillianabe]

it is kind of program which continuously scan the web and look for the new information on the website or web. whenever it gets any website first time, based on your content subject of website it index and store the data about your website in database which search engine use to rank different websites for different search queries.

[siljajoseph]

search engine can tell you where a file or document is found.To find this information on the hundreds of millions of Web pages that exist, a search engine employs special software robots, called spiders, to build lists of the words found on Web sites. When a spider is building its lists, the process is called Web crawling...........


Web Design & Development (http://www.prodigyapex.co.uk)

[Dog]

Spiders are a search engines way of exploring the internet.
They help to find new web pages and analyse how important the web page is so it can be given a web page ranking.