The Australian edition of Lifehacker reports  that Sensis , Telestra’s yellow pages division, has finally allowed bots to crawl their online yellow pages so links to their listings are now showing up in Google SERPs and other search engines. Previously, they were apparently blocking Google and bots by either using robots.txt disallow rules and/or blocking the bots with network access rules.
Amusingly, Lifehacker mentions, “The fact that it was ever blocked is frankly one of the weirdest Internet strategies imaginable, but that’s another story.”
I can well remember back when Superpages allowed me to optimize the yellow pages content — it’s so gratifying to see the dramatic traffic increase that occurs when a site that has blocked content is suddenly opened up for spidering and indexing. Sensis will undoubtedly enjoy a similar punch up in traffic now, and their clients will benefit from the added visibility, too.
Why did they block Google for so long? Could be simple ignorance, or it could have been the continued use of a Business 1.0 strategy. For one thing, internet yellow pages sites are huge targets for dataminers who harvest listing information for re-use in many ways, including spamming of email addresses, composing telemarketing phone number lists, as well as building competing directory information sites.
Google could have been blocked automatically as a seeming dataminer. Heck, they ARE dataminers of a sort, but most of us in the search marketing profession have taken to viewing them as benign/beneficial dataminers. It’s the difference between parasites and symbiotic organisms.
Lifehacker goes on to say that they’re skeptical about Sensis’ claims  that businesses businesses listed in their yellow pages will get more visibility in Google SERPs. Actually, this is true, if Sensis does all their search engine optimization (“SEO”) correctly. To take it to the next level, Sensis will have to not just open up to the bots but also perform additional Local SEO.
(Coincidentally,Â and even more amusingly, Sensis’ General Manager of Online Search and Directories is also named “Chris Smith”. Yes, I grudgingly admit it — my cloning project has been humming along, and I now have successfully accomplished being in more than one place at a time so that I can do SEO for multiple companies simultaneously.)