Ranking the Online Documents Based on Relative Credibility Measures

Ahmad Dahlan, Dwi H. Widyantoro, Suhono H. Supangkat, Benhard Sitohang

Abstract


Information searching is the most popular activity in Internet. Usually the search engine provides the search results ranked by the relevance. However, for a certain purpose that concerns with information credibility, particularly citing information for scientific works, another approach of ranking the search engine results is required. This paper presents a study on developing a new ranking method based on the credibility of information. The method is built up upon two well-known algorithms, PageRank and Citation Analysis. The result of the experiment that used Spearman Rank Correlation Coefficient to compare the proposed rank (generated by the method) with the standard rank (generated manually by a group of experts) showed that the average Spearman 0 < rS < critical value. It means that the correlation was proven but it was not significant. Hence the proposed rank does not satisfy the standard but the performance could be improved.

Full Text:

PDF

References


Janes, J.W. & Rosenfeld, L.B., Networked Information Retrieval and Organization: Issues and Questions, Journal of The American Society for Information Science, 47(9), pp. 711-715, 1996.

Rieh, S.Y., Judgment of Information Quality and Cognitive Authority in the Web, Journal of the American Society for Information Science and Technology, 53, 145–161, 2002.

Dahlan, A. & Sitohang, B., Kredibilitas Informasi di Internet, Jurnal Gematika, 8(1), 2006.

Knight, S.A. & Burn, J., Developing a Framework for Assessing Information Quality on the World Wide Web, Informing Science Journal 8 (5), pp. 159-172, 2005

Flanagin, A.J. & Metzger, M.J., The Role Of Site Features, User Attributes, And Information Verification Behaviors On The Perceived Credibility Of Web-Based Information, New Media and Society, 9(2), pp. 319-342, SAGE Publications, 2007.

Fogg, B.J., Marshall, J., Kameda, T., Solomon, J., Rangnekar, A., Boyd, J. & Brown, B., Web Credibility Research: A Method for Online Experiments and Early Study Results, Proceedings of ACM CHI 2001 Conference on Human Factors in Computing Systems, v.2. New York: ACM Press, 2001, http://captology.stanford.edu/pdf/WebCred%20 Fogg%20 CHI%202001% 20short%20paper.pdf, (18 April 2005).

Geyskens, I., Steenkamp, J.B.E.M., Scheer, L.K. & Kumar, N., The Effects of Trust and Interdependence on Relationship Commitment: A transatlantic study, International Journal of Research in Marketing, 13, pp. 303-317, 1996.

Jarvenpaa, S.L. & Tractinsky, N., Consumer Trust in an Internet Store: A Cross-Cultural Validation, Journal of Computer-Mediated Communication vol. 5 issue 2, 2000, http://www. ascusc.org/jcmc/vol5/ issue2/jarvenpaa.html, (18 April 2005).

Fogg, B.J. & Tseng H., The Elements of Computer Credibility, Proceedings of ACM CHI 99 Conference on Human Factors in Computing Systems, New York: ACM Press: 80-87, 1999, http://captology.stanford.edu/pdf/p80-fogg.pdf, (18 April 2005).

Greer, T., Holinga, D., Kindel, C., Netznik, M., Brown, J., Hickey, K. & Pozen, V., An Educators’ Guide to Credibility and Web Evaluation, White Papers, Universiy of Illinois / Urbana-Campaign 1999, revised on 1st of July 2002, http://lrs.ed.uiuc.edu/wp/ credibility/index.html, (27 April 2005).

Wathen, C.N. & Burkel, J., Believe it or not: Factors Influencing Credibility on the Web, Journal of American Society of Information Science and Technology, 53(2), pp. 134-144, 2002.

Prasad, C., Haripriya, Mohania, M., Gupta, A. & Kambayashi, Y., Credibility of Data in World Wide Web, Advances in Multimedia and Databases for the New Century (Advanced Database Research and Development Series), Vol. 10:10-18, World Scientific, Dec. 1999.

Huerta, E. & Ryan, T., The Credibility of Online Information, Ninth Americas Conference on Information System, 2003.

Kirk, E.E., Evaluating Information Found on the Internet, Sheridan Libraries John Hopkins University, 1996, http://www.library.jhu.edu/ researchhelp/general/evaluating/ index.html (18 April 2005).

Smith, A.G., Testing the Surf: Criteria for Evaluating Internet Information Resources, The Public-Access Computer Systems Review 8, no. 3, Victoria University of Wellington, NZ; 1997, http://info.lib.uh.edu/ pr/v8/n3/smit8n3.html (18 April 2005).

Beck, S.E., The Good, The Bad & The Ugly: or, Why It's a Good Idea to Evaluate Web Sources, Reference & Research Services Department New Mexico State University Library, 2005, http://lib.nmsu.edu/instruction/ evalcrit.html, (6 May 2005).

Brin, S. & Page, L., The anatomy of a large-scale hypertextual Web search engine, Computer Networks and ISDN Systems, 30(1-7), pp. 107-117, 1998.

Garfield, E., Citation Indexes for Science, A New Dimension in Docu-mentation through Association of Ideas, Science 122, 108–111, 1955.

Dahlan, A. & Sitohang, B., Combining PageRank and Citation Analysis to Measure Information Credibility in Internet, Proceedings of Ninth International Conference on Information Integration and Web-based Applications & Services (iiWAS2007), December 2007.

Sobek, M., The Implementation of PageRank in the Google Search Engine, eFactory Gmbh & Co. KG Internet Agentur, 2003, http://pr.efactory.de/e-pagerank-implementation.shtml, (6 May 2005).

Kleinberg, J.M., Authoritative Sources in a Hyperlinked Environment, Proceedings of ACM-SIAM Symposium on Discrete Algorithms, pp. 668-677, January 1998.

Yang, K. & Meho, L.I., Citation Analysis: A Comparison of Google Scholar, Scopus, and Web of Science, Proceeding of the 69th Annual Meeting of the American Society for Information Science and Technology (ASIST) 43, Austin, 2006.

Bauer, K. & Bakkalbasi, N., An Examination of Citation Count in a New Scholarly Communication Environment, D-Lib Magazine, 11(9), ISSN 1082-9873, 2005, http://www.dlib.org//dlib/september05/bauer/09bauer. html, (7 May 2007).

Borgman, C.L. & Furner, J., Scholarly communication and bibliometrics, Annual Review of Information Science and Technology, 36, pp. 3-72, 2002.

Kosmopoulos, C. & Pumain, D., Citation, Citation, Citation: Bibliome-trics, the Web and the Social Sciences and Humanities, Cybergeo, European Journal of Geography, 411, 2007.

Dodge, Y., The Concise Encyclopedia of Statistics, Springer Reference, Springer, 2008.

Zar, J.H., Critical Values of the Spearman’s Ranked Correlation Coefficient (rs), in Biostatistical Analysis, 26, Ed. 2, Table B.19, Prentice-Hall, Englewood Cliffs, NJ., 1984, http://webspace.ship.edu/ pgmarr/Geo441/Tables/Spearman%20Ranked%20Correlation%20Table.pdf (18 March 2009).




DOI: http://dx.doi.org/10.5614%2Fitbj.ict.2009.3.1.2

Refbacks

  • There are currently no refbacks.


Contact Information:

ITB Journal Publisher, LPPM – ITB, 

Center for Research and Community Services (CRCS) Building Floor 7th, 
Jl. Ganesha No. 10 Bandung 40132, Indonesia,

Tel. +62-22-86010080,

Fax.: +62-22-86010051;

e-mail: jictra@lppm.itb.ac.id.