Welcome to the InfoSci Platform
Reference Hub2
A Comparison of Retrieval Result Relevance Judgments Between American and Chinese Users

A Comparison of Retrieval Result Relevance Judgments Between American and Chinese Users

Jin Zhang, Yuehua Zhao, Xin Cai, Taowen Le, Wei Fei, Feicheng Ma
Copyright: © 2020 |Volume: 28 |Issue: 3 |Pages: 21
ISSN: 1062-7375|EISSN: 1533-7995|EISBN13: 9781799804123|DOI: 10.4018/JGIM.2020070108
Cite Article Cite Article

MLA

Zhang, Jin, et al. "A Comparison of Retrieval Result Relevance Judgments Between American and Chinese Users." JGIM vol.28, no.3 2020: pp.148-168. http://doi.org/10.4018/JGIM.2020070108

APA

Zhang, J., Zhao, Y., Cai, X., Le, T., Fei, W., & Ma, F. (2020). A Comparison of Retrieval Result Relevance Judgments Between American and Chinese Users. Journal of Global Information Management (JGIM), 28(3), 148-168. http://doi.org/10.4018/JGIM.2020070108

Chicago

Zhang, Jin, et al. "A Comparison of Retrieval Result Relevance Judgments Between American and Chinese Users," Journal of Global Information Management (JGIM) 28, no.3: 148-168. http://doi.org/10.4018/JGIM.2020070108

Export Reference

Mendeley
Favorite Full-Issue Download

Abstract

Relevance judgment plays an extremely significant role in information retrieval. This study investigates the differences between American users and Chinese users in relevance judgment during the information retrieval process. 384 sets of relevance scores with 50 scores in each set were collected from 16 American users and 16 Chinese users as they judged retrieval records from two major search engines based on 24 predefined search tasks from 4 domain categories. Statistical analyses reveal that there are significant differences between American assessors and Chinese assessors in relevance judgments. Significant gender differences also appear within both the American and the Chinese assessor groups. The study also revealed significant interactions among cultures, genders, and subject categories. These findings can enhance the understanding of cultural impact on information retrieval and can assist in the design of effective cross-language information retrieval systems.