Is your site unfriendly to search engine spiders like MSNBot?
Microsoft blogger Eytan Seidman on their MSN Search blog offers some very useful specifics on what makes a site crawler unfriendly, particularly to MSNBot:
An example of a page that might look “unfriendly” to a crawler is one that looks like this: http://www.somesite.com/info/default.aspx?view=22&tab=9&pcid=81-A4-76§ion=848&origin=msnsearch&cookie=false….URL’s with many (definitely more than 5) query parameters have a very low chance of ever being crawled….If we need to traverse through eight pages on your site before finding leaf pages that nobody but yourself points to, MSNBot might choose not to go that far. This is why many people recommend creating a site map and we would as well.
Possible Related Posts
Posted by stephan of stephan on 11/21/2004
Permalink | 
Email This Post
| 
Print
| Trackback | Comments (1) | Comments RSS
Filed under: Dynamic Sites, Spiders, URLs
any suggestion for my website ? please follow the link to advise
Comment by Loan — 4/8/2008 @ 10:50 am