(1+1)-Evolutionary gradient strategy to evolve global term weights in information retrieval

Ibrahim, Osman Ali Sadek; Landa-Silva, Dario

Abstract

In many contexts of Information Retrieval (IR), term weights play an important role in retrieving the relevant documents responding to users' queries. The term weight measures the importance or the information content of a keyword existing in the documents in the IR system. The term weight can be divided into two parts, the Global Term Weight (GTW) and the Local Term Weight (LTW). The GTW is a value assigned to each index term to indicate the topic of the documents. It has the discrimination value of the term to discriminate between documents in the same collection. The LTW is a value that measures the contribution of the index term in the document. This paper proposes an approach, based on an evolutionary gradient strategy, for evolving the Global Term Weights (GTWs) of the collection and using Term Frequency-Average Term Occurrence (TF-ATO) as the Local Term Weights (LTWs). This approach reduces the problem size for the term weights evolution which reduces the computational time helping to achieve an improved IR effectiveness compared to other Evolutionary Computation (EC) approaches in the literature. The paper also investigates the limitation that the relevance judgment can have in this approach by conducting two sets of experiments, for partially and fully evolved GTWs. The proposed approach outperformed the Okapi BM25 and TF-ATO with DA weighting schemes methods in terms of Mean Average Precision (MAP), Average Precision (AP) and Normalized Discounted Cumulative Gain (NDCG).

Citation

Ibrahim, O. A. S., & Landa-Silva, D. (2016). (1+1)-Evolutionary gradient strategy to evolve global term weights in information retrieval. In P. Angelov, A. Gegov, C. Jayne, & Q. Shen (Eds.), Advances in computational intelligence systems: contributions presented at the 16th UK Workshop on Computational Intelligence, September 7–9, 2016, Lancaster, UK (387–405). https://doi.org/10.1007/978-3-319-46562-3_25

• Conference Name: 16th Annual UK Workshop on Computational Intelligence (UKCI 2016)
• Conference Location: Lancaster, UK
• Start Date: Oct 7, 2016
• End Date: Sep 9, 2016
• Acceptance Date: Jul 31, 2016
• Online Publication Date: Sep 6, 2015
• Publication Date: Sep 7, 2016
• Deposit Date: Sep 13, 2016
• Peer Reviewed: Peer Reviewed
• Issue: 513
• Pages: 387–405
• Series Title: Advances in intelligent systems and computing
• Series Number: 513
• Series ISSN: 2194-5365
• Book Title: Advances in computational intelligence systems: contributions presented at the 16th UK Workshop on Computational Intelligence, September 7–9, 2016, Lancaster, UK
• ISBN: 9783319465616
• DOI: https://doi.org/10.1007/978-3-319-46562-3_25
• Public URL: https://nottingham-repository.worktribe.com/output/818749
• Publisher URL: http://link.springer.com/chapter/10.1007/978-3-319-46562-3_25