GTFO Google bot
Moderators: mogers, scorch-, Cory Cory! Price, laura
-
british
- Posts: 417
- Joined: Fri Aug 12, 2011 2:52 pm
- Clans: eXquisite.Uk. ASK.pl, Nihilist, azFIRE, pUr, feat 6, Dying Breed, v! naturalskillz, JIMS AUTO
- Location: Tempe, arizona
- Contact:
GTFO Google bot
Registered users: alex kirk, british, Burntwaffles, chimpanzebra, element, Google [Bot], k4b00m, stealthlol
-
SKiNnTo
- Posts: 862
- Joined: Mon Apr 18, 2011 6:38 pm
- Clans: LAB, Shock&Awe,[sAs]
- Location: SE, Michigan
- Contact:
Re: GTFO Google bot
Googlebot is Google's web crawling bot (sometimes also called a "spider"). Crawling is the process by which Googlebot discovers new and updated pages to be added to the Google index.
We use a huge set of computers to fetch (or "crawl") billions of pages on the web. Googlebot uses an algorithmic process: computer programs determine which sites to crawl, how often, and how many pages to fetch from each site.
http://support.google.com/webmasters/bi ... wer=182072
We use a huge set of computers to fetch (or "crawl") billions of pages on the web. Googlebot uses an algorithmic process: computer programs determine which sites to crawl, how often, and how many pages to fetch from each site.
http://support.google.com/webmasters/bi ... wer=182072
-
british
- Posts: 417
- Joined: Fri Aug 12, 2011 2:52 pm
- Clans: eXquisite.Uk. ASK.pl, Nihilist, azFIRE, pUr, feat 6, Dying Breed, v! naturalskillz, JIMS AUTO
- Location: Tempe, arizona
- Contact:
Re: GTFO Google bot
cheers for that Eric,Sears wrote:
I had just never seen the Google bot doing work before, pretty neat stuff.
Re: GTFO Google bot
WELL I STILL DON'T LIKE HIM EITHER.
Re: GTFO Google bot
[youtube]9fEjJ4Ecy9Q[/youtube]