How a spider indexes your site

Matt Cutts recently gave an interview which, for many people in SEO, allows us to get a glimp (ie a partial rather than a full glimpse) inside Google’s mindset. Matt Cutts’ answers have been brilliantly illustrated by randfish on SeoMoz, and whatever level of expertise you possess in SEO and internet marketing, this should be…