Google Custom Search is cool. And it’s a natural step for Google to distribute their search technology (dare I say “longtail-ize”?) in the same way that they distributed their ad technology when they expanded Adwords (on their domain) into Adsense (on anyone’s page). So it was a natural fit for us to use it as the backend for our Lijit Personal Network Search, and we’ve been happy with the initial results.
But it’s not perfect.
Ethan Zuckerman wrote about problems with Co-op search back in October, and Google quickly responded with a fix. However, we’re seeing a lot of Ethan’s problems here at Lijit as well. The problem is that if your desired search results would not normally fall in the top 1000 results of a normal Google search, they don’t get included in your results. For example, Brad Feld has written a ton about Microsoft in his blog at feld.com as can be seen in a typical site: Google search. However, when you use a Co-op search which includes feld.com/*, you don’t get any results fromthat domain. The problem seems to be that feld.com doesn’t make it into the top 1000 results for a normal search for ‘”microsoft”. In a similar vain, if you search me for “sex” you’ll get stuff from BoingBoing (a high PageRank site) but not my post “Attention is Meme Sex” like you might expect.
So it seems that the fixes implemented for Ethan aren’t working across the board. But I am encouraged by Google’s response to Ethan and hope that they will eventually be able to solve our issues.
We have been quite pleased with Google Custom Search, which we used to create a search engine dedicated to project management (http://www.sharedplan.com/pms.html). Because the scope of our engine is pretty limited, we have not seen the kinds of problems you refer to.
While I’m glad they make their search engine available for custom implementations, I maintain a healthy skepticism about Google’s intentions in most of the things they do. A company that is so amazingly successful but frustratingly secretive does not earn trust well.
tracy