Chris Dixon

Google should open source what actually matters: their search ranking algorithm

Websites live or die based on how a small group of programmers at Google decide their sites should rank in Google’s main search results.  As the “router” of the vast majority of traffic on the internet, Google’s secret ranking algorithm is probably is the most powerful piece of software code on the planet.

Google talks a lot about openness and their commitment to open source software. What they are really doing is practicing a classic business strategy known as “commoditizing the complement“*.

Google makes 99% of their revenue by selling text ads for things like plane tickets, dvd players and malpractice lawyers. Many of these ads are syndicated to non-Google properties. But the anchor that gives Google their best “inventory” is the main search engine at Google.com.  And the secret sauce behind Google.com is the algorithm for ranking search results. If Google is really committed to openness, it is this algorithm that they need to open source.

The alleged argument against doing so is that search spammers would be able to learn from the algorithm to improve their spamming methods. This form of argument is an old argument in the security community known as “security through obscurity.” Security through obscurity is a technique generally associated with companies like Microsoft and is generally opposed as ineffective and risky by security experts. When you open source something you give the bad guys more info, but you also enlist an army of good guys to help you fight them.

Until Google open sources what really matters – their search ranking algorithm – you should dismiss all their other open-source talk as empty posturing. And millions of websites will have to continue blindly relying on a small group of anonymous engineers in charge of the secret algorithm that determines their fate.

* You can understand a large portion of technology business strategy by understanding strategies around complements. One major point: companies generally try to reduce the price of their products complements (Joel Spolsky has an excellent discussion of the topic here). If you think of the consumer as having a willingness to pay a fixed N for product A plus complementary product B, then each side is fighting for a bigger piece of the pie. This is why, for example, cable companies and content companies are constantly battling. It is also why Google wants open source operating systems to win, and for broadband to be cheap and ubiquitous. [link to full post]

  • Pingback: » Google, if you really want to be open, open-source your search engine! Dvorak Uncensored: General interest observations and true web-log.

  • Bigdog

    Hey Chris, Why don't you open source your copyrights and your bank account, too?

  • Pingback: Google Shouldn’t Open Source Their Search Algo « ecpm blog

  • Pingback: SearchCap: The Day In Search, December 22, 2009 | Online Marketing Strategy

  • James Riso

    I commend Google for the openness they embrace–especially the “data liberation” movement Matt mentioned–where it benefits me, the consumer. And to the extent that the company's choice to keep search and advertising closed allows them deliver services I find valuable, I commend that too. That said, I am turned off by the corporation-cum-savior image they often attempt to project. Call me a cynic. Rosenberg clearly downplays the gritty specifics of how Google's strategy is profit-generating (i.e. the critical role of closed-ness) but is quite generous with the “feel good” side of things. The angle shows up elsewhere with Google, I think you'd agree. I'm sure when that proposed “re-write the MBA curriculum” does happen, it will be put much more objectively.

  • Jimbo

    They are already Crowd sourced (not open) One of the places Google has a huge advantage is in their huge base of advertisers that one by one populate the paid serps side of the engine. To be honest when doing a lot of searches I find a better quality result via the paid links than in some instances of the organic.

    In reply to better overall results in the search marketplace I don't think it even matters at this point. People have already associated search with Google. If a magical no name engine appeared tomorrow with “Better” results than Google who would use it?

    IMO I think only one company could compete with Goog in search and they are more closed than them and that is Apple.

    I think at this time in the search space the masses use a comfortable brand. Bing or Yahoo don't have the same brand mind share that Google has in search and it shows in terms of use penetration. Take a popular brand like apple with a growing % of hardware devices such as Mac, Ipod Touch, Iphone, Islate(soon) and load them all with Apples search engine as the default and you will have a competitor to Google. Not Binghoo.

  • Jimbo

    They are already Crowd sourced (not open) One of the places Google has a huge advantage is in their huge base of advertisers that one by one populate the paid serps side of the engine. To be honest when doing a lot of searches I find a better quality result via the paid links than in some instances of the organic.

    In reply to better overall results in the search marketplace I don't think it even matters at this point. People have already associated search with Google. If a magical no name engine appeared tomorrow with “Better” results than Google who would use it?

    IMO I think only one company could compete with Goog in search and they are more closed than them and that is Apple.

    I think at this time in the search space the masses use a comfortable brand. Bing or Yahoo don't have the same brand mind share that Google has in search and it shows in terms of use penetration. Take a popular brand like apple with a growing % of hardware devices such as Mac, Ipod Touch, Iphone, Islate(soon) and load them all with Apples search engine as the default and you will have a competitor to Google. Not Binghoo.

  • Pingback: The tradeoff between open and closed cdixon.org – chris dixon's blog

  • Pingback: The Great Tech Debate: Open Platforms Vs. Closed Platforms | Startups

  • Pingback: Wordpress, the GPL and What It Means | Robby Grossman

  • Pingback: Inside Voices, Please | Aitir Google Lab

  • Pingback: Inside Voices, Please | Nerd Alert Marketing

  • Pingback: Inside Voices, Please | KAPILA YOGA

  • Pingback: Inside Voices, Please | Vishnu chintapally

  • Pingback: Inside Voices, Please : Technobyte

  • Pingback: Inside Voices, Please | IT Service Corporation Web Solutions

  • Pingback: Inside Voices, Please | iSEO Blog