Title :
Search engines evaluation using users efforts
Author :
Goutam, Rajesh Kumar ; Dwivedi, Sanjay K.
Author_Institution :
Dept. of Comput. Sci., Babasaheb Bhimrao Ambedkar Univ., Lucknow, India
Abstract :
The performance evaluation of search engines continues to become an research problem. Numerous researchers tried to measure the quality of information retrieval systems with different parameters and achieved several milestones. in case of graded relevance dependent measures, the Discounted Cumulative Gain metric exists that deals with the position of the retrieved results. In this paper, we present the task of learning rankings with the help of human assessment and click hits. we combined experts judgments about the results with the users clicks hits and found that this strategy is effective to assign ranking. The proposed ranking method can be seen as an extension of Expected Reciprocal Ranking that correlates better with clicks metrics than editorial metrics.
Keywords :
learning (artificial intelligence); search engines; user interfaces; clicks metrics; discounted cumulative gain metric; editorial metrics; expected reciprocal ranking; information retrieval systems; learning rankings; search engines; users efforts; Computers; Equations; Mathematical model; Measurement; Numerical models; Search engines; Information retrieval; Non-binary relevance; Search engine; Search engine evaluation; performance;
Conference_Titel :
Computer and Communication Technology (ICCCT), 2011 2nd International Conference on
Conference_Location :
Allahabad
Print_ISBN :
978-1-4577-1385-9
DOI :
10.1109/ICCCT.2011.6075104