At the risk of beating a dead horse, I'll try to summarize. Google believed that queries and clicks on Google search results were being used in Bing's ranking, so we ran an experiment. The experiment confirmed that clicks on Google search results are used by Microsoft in Bing's search rankings.
Things we don't know include:
- the degree to which those clicks are used in Bing's rankings.
- whether MSFT does Google-specific processing of the clickstream data they get, or whether clicks on Google are treated the same as some-random-website.com.
- how long clicks on Google search results have been used in Bing's ranking (months, years, etc.).
Those are open questions that Microsoft could best answer.
"I thought it was the search results that Google accused Microsoft of stealing."
I'm trying to use very precise/neutral language to avoid the "copying/cheating" brouhaha. The crux of the issue is that clicks on Google search results are used in Bing's search rankings.
Really glad to see you reply here Matt. Never expected it. Kudos!
I think Microsoft did acknowledge using clickstream data as one of the 1000 signals for their relevance ranking. Now regarding the degree to which they are used, I don't have any internal knowledge of either MSFT or GOOG but from my understanding of how search works, words like "hiybbprqag" couldn't have existed in MSFT's index to return any results. So the only signal that could possibly contribute to the ranking of "hiybbprqag" was the clickstreamm data that was generated by GOOG sting operation. So at least for that query term it must have been a big deciding factor. For the popular query terms, I doubt it's that high. I use both bing and google fairly regulalrly and I can tell that for most typical queries, bing results are comparable to Google but for the tail queries, google does a better job. If they were giving any special weight to google click data then they would have done it for tail queries (which they apparently cannot do as well as google) to improve their relevance there.
Regarding Google specific processing, again bulk of the search activity in US happens in GOOG, so I can imagine a lot of search click data is generated on google.
As for the time, I am not sure why that even matters. From my usage of bing and google over past few months, bing has been consistent in the behaviour. If this was a sudden change, I'd have seen a jusp in bing quality overnight. Don't remember seeing that.
Things we don't know include:
- the degree to which those clicks are used in Bing's rankings.
- whether MSFT does Google-specific processing of the clickstream data they get, or whether clicks on Google are treated the same as some-random-website.com.
- how long clicks on Google search results have been used in Bing's ranking (months, years, etc.).
Those are open questions that Microsoft could best answer.