View Single Post
07-27-2007, 07:52 PM
#23
RossJJ is offline RossJJ
Status: RJ
Join date: Dec 2004
Location: Essex
Expertise:
Software:
 
Posts: 1,116
iTrader: 1 / 100%
 

RossJJ is on a distinguished road

Send a message via AIM to RossJJ Send a message via MSN to RossJJ

  Old

Originally Posted by myname View Post
Seach Engines? how does that work
Well search engines start by deploying a Search Engine Spider

Also known as a web crawler or robot, a search engine spider is an automated program that reads web pages and follows any links to other pages within the site. This is often referred to as a site being "spidered" or "crawled". There are three very hungry and active spiders on the Net. Their names are Googlebot (Google), Slurp (Yahoo!) and MSNBot (MSN Search).

Spiders start their journeys with a list of page URLs that have previously been added to their index (database). As it visits these pages, crawling the code and copy, it adds new pages (links) that it finds on the page to its index. As such, one could refer to a spider as feeding an evolving index.

The spider returns to the sites in its index on a regular basis, scanning for any changes. How often the spider returns is up to the search engines to decide. Website owners do have some control in how often a spider visits their site by making use of a robot.txt file. Search engines first look for this file before crawling a page further.

Now people can use a search bar to search the spidered webpage’s, the results are ordered by keywords, relevance and link popularity, so obviously Indy's websites is ranking for a certain search term. When people click on his website he's gained a possible client.

Hope that clears things up