Natural Search Blog

Yahoo! is blogging

Yahoo! now has a corporate blog, Yahoo! Search Blog. I’ve been a fan of an unofficial Yahoo blog, namely that of Yahoo employee Jeremy Zawodny, for a while now. But it’s good to see the company embracing blogging in an official capacity.

4 comments for Yahoo! is blogging »

  1. MyAvatars 0.2

    It is absolutely possible that Yahoo!’s natural search algos ever screw up? Are they perfect? I have clear proof that they black-listed our site but no one can give me answers at Yahoo! any ideas? Tx.

    Comment by tim — 9/21/2006 @ 9:19 am

  2. MyAvatars 0.2

    Tim, I glanced at your site,, in Yahoo! Site Explorer, and I don’t think they blacklisted you, since I see 100+ pages of yours in their index.

    Also, you come up tops in their SERPs for a search like “Global Forex”, so you’re definitely not blacklisted, at least not on 9/23/06.

    However, I did see *multiple* versions of your homepage indexed, each with different affiliate IDs. Ex:

    Having so many versions of your homepage indexed can really mess up your rankings and such, since Yahoo’s algo must figure out what page is authoritative.

    For each of these URLs that have affiliate IDs, you need to deliver up 301 redirects back to your main homepage , sans the affiliate IDs, for each of the big spiders. Your endusers can still come through those tracking URLs so you can tell who comes in from what traffic channel, but you need to sniff for the search engine bots and redirect them to the reguler homepage URL.  That way, you’ll have only one homepage indexed, so your pagerank won’t get watered-down by so many unnecessary pages.

    Read Stephan’s article on “Spiders like Googlebot choke on Session IDs“, since that describes essentially the same problem you’ve got.

    Comment by Chris Smith — 9/23/2006 @ 2:49 am

  3. MyAvatars 0.2

    We’ve got the prob. fixed via a ‘re-review’ from Yahoo!

    Per your suggestion, the problem is the ids track our lead sources, lead numbers, quality, conversion, etc. Do you know any alternative solutions? Thanks in advance.

    Comment by tim — 9/25/2006 @ 7:48 am

  4. MyAvatars 0.2

    Yes, I know you’re using the IDs to track your referrals.

    There’s a few ways you can keep those alternate URLs from getting indexed, though.

    First, your tracking application or homepage could redirect search engine bots to the non-query-stringed homepage URL. To do this the application that delivers the homepage could sense for the search engine’s spider useragent strings and redirect if the visitor reflects those strings.

    Or, you could program your homepage to include robots metatags which specify NOINDEX anytime the homepage URL has a querystring.

    Alternatively for choice #3, you could set up a special subdirectory to use for receiving those referrals. For instance:, and your URLs could dump folx to that location:

    The index in that location could just redirect those users to your main homepage, using server-side redirect or a metatag refresh.

    Then, you could set up your robots.txt file to specify that bots not crawl the /leads/ subdirectory. In this way, you could count the referral click-throughs and keep those alternate URLs from getting indexed.

    Comment by Chris Smith — 9/26/2006 @ 8:24 am

Leave a comment

* Do not use spammy names!

RSS feed for comments on this post. TrackBack URI

RSS Feeds
Aug Sep Oct Nov
Jan Feb Mar Apr
Jan Feb Apr May
Jun Jul Aug Sep
Oct Nov Dec  
Jan Feb Mar Apr
May Jun Jul Aug
Sep Oct Dec  
Jan Feb Mar Apr
May Jun Jul Aug
Sep Oct Nov Dec
Mar Apr May Jun
Jul Aug Sep Oct
Nov Dec    
Jan Feb Mar Dec
May Jun Jul Aug
Sep Oct Nov Dec