Is your site unfriendly to search engine spiders like MSNBot?
Microsoft blogger Eytan Seidman on their MSN Search blog offers some very useful specifics on what makes a site crawler unfriendly, particularly to MSNBot:
An example of a page that might look “unfriendly” to a crawler is one that looks like this: http://www.somesite.com/info/default.aspx?view=22&tab=9&pcid=81-A4-76§ion=848&origin=msnsearch&cookie=false….URL’s with many (definitely more than 5) query parameters have a very low chance of ever being crawled….If we need to traverse through eight pages on your site before finding leaf pages that nobody but yourself points to, MSNBot might choose not to go that far. This is why many people recommend creating a site map and we would as well.
Possible Related Posts
Posted by stephan of stephan on 11/21/2004
Permalink | | 
Print
| Trackback | Comments Off on Is your site unfriendly to search engine spiders like MSNBot? | Comments RSS
Filed under: Dynamic Sites, Spiders, URLs
No comments for Is your site unfriendly to search engine spiders like MSNBot?
No comments yet.
Sorry, the comment form is closed at this time.