Evaluation 14: query logs and click deviation

Search engines use query logs for evaluating their ranking algorithms. Query logs contain clicks. We can compute click deviation and use it as a proxy for relevance, or convert user clicks into pairwise preferences.