Here’s an entertaining article from DomainGang.
Yahoo to eliminate all Bots, Crawlers and Web Spiders
Posted by Lucius “Guns” Fabrice on September 20, 2010
Since the early 90’s the automated search and retrieval of the so-called “deep web” has become the ultimate goal of every search engine. While Google recently introduced the Instant Search feature that delivers results on the spot, trends might change soon.
After almost 15 years on the go, Yahoo announced that it’s pulling the plug on its bots, crawlers and web spiders.
“Our business model is simple: automation kills jobs”, said Matt Jiggerson, chief engineer at Yahoo.
“All this software, searching thousands of web sites and storing millions of gigabytes of information does not fit in the current state of bad economy we are facing”.
Read the whole article.
Tags: federated search