Natural Search Blog


Yahoo’s Recent Spider Improvement Beats Google’s

Googlebot Spider

Yahoo!’s Search Blog announced yesterday that they were making some final changes to their spider, (named “Slurp”), standardizing their crawlers to provide a common DNS signature for identification/authorization purposes.

Previously, Slurp’s requests may have come from IP addresses associated with inktomisearch.com, and now they should all come from IPs associated with domains in this standard syntax:

[something].crawl.yahoo.net

(more…)


Fatal error: Uncaught Error: Call to undefined function UTW_ShowCurrentTagSet() in /home2/sspencer/public_html/naturalsearchblog.com/wp-content/themes/naturalsearch/footer.php:5 Stack trace: #0 /home2/sspencer/public_html/naturalsearchblog.com/wp-includes/template.php(688): require_once() #1 /home2/sspencer/public_html/naturalsearchblog.com/wp-includes/template.php(647): load_template('/home2/sspencer...', true) #2 /home2/sspencer/public_html/naturalsearchblog.com/wp-includes/general-template.php(76): locate_template(Array, true) #3 /home2/sspencer/public_html/naturalsearchblog.com/wp-content/themes/naturalsearch/index.php(49): get_footer() #4 /home2/sspencer/public_html/naturalsearchblog.com/wp-includes/template-loader.php(74): include('/home2/sspencer...') #5 /home2/sspencer/public_html/naturalsearchblog.com/wp-blog-header.php(19): require_once('/home2/sspencer...') #6 /home2/sspencer/public_html/naturalsearchblog.com/index.php(17): require('/home2/sspencer...') #7 {main} thrown in /home2/sspencer/public_html/naturalsearchblog.com/wp-content/themes/naturalsearch/footer.php on line 5