Natural Search Blog


Is your site unfriendly to search engine spiders like MSNBot?

Microsoft blogger Eytan Seidman on their MSN Search blog offers some very useful specifics on what makes a site crawler unfriendly, particularly to MSNBot:

An example of a page that might look “unfriendly” to a crawler is one that looks like this: http://www.somesite.com/info/default.aspx?view=22&tab=9&pcid=81-A4-76&section=848&origin=msnsearch&cookie=false….URL’s with many (definitely more than 5) query parameters have a very low chance of ever being crawled….If we need to traverse through eight pages on your site before finding leaf pages that nobody but yourself points to, MSNBot might choose not to go that far. This is why many people recommend creating a site map and we would as well.

buy peptides

No comments for Is your site unfriendly to search engine spiders like MSNBot? »

No comments yet.

Leave a comment

* Do not use spammy names!

RSS feed for comments on this post. TrackBack URI

RSS Feeds
Categories
Archives

Fatal error: Uncaught Error: Call to undefined function split() in /home2/sspencer/public_html/naturalsearchblog.com/wp-content/plugins/nicearchive.php:55 Stack trace: #0 /home2/sspencer/public_html/naturalsearchblog.com/wp-content/themes/naturalsearch/footer.php(33): get_niceArchive() #1 /home2/sspencer/public_html/naturalsearchblog.com/wp-includes/template.php(688): require_once('/home2/sspencer...') #2 /home2/sspencer/public_html/naturalsearchblog.com/wp-includes/template.php(647): load_template('/home2/sspencer...', true) #3 /home2/sspencer/public_html/naturalsearchblog.com/wp-includes/general-template.php(84): locate_template(Array, true) #4 /home2/sspencer/public_html/naturalsearchblog.com/wp-content/themes/naturalsearch/index.php(49): get_footer() #5 /home2/sspencer/public_html/naturalsearchblog.com/wp-includes/template-loader.php(74): include('/home2/sspencer...') #6 /home2/sspencer/public_html/naturalsearchblog.com/wp-blog-header.php(19): require_once('/home2/sspencer...') #7 /home2/sspencer/public_html/naturalse in /home2/sspencer/public_html/naturalsearchblog.com/wp-content/plugins/nicearchive.php on line 55