Evaluation of five web search engines in Arabic language´
W. Tawileh, T. Mandl, and J. Griesbaum. Proceedings of LWA2010 - Workshop-Woche: Lernen, Wissen & Adaptivitaet, Kassel, Germany, (2010)
Abstract
To explore how Arab Internet users can find the information in their mother tongue on the web, the five web search engines Araby, Ayna, Google, MSN and Yahoo were tested on an information retrieval evaluation basis with the consideration of the webspecific evaluation requirements. The test used fifty randomly selected queries from the top searches on the Arabic search engine Araby. The relevance of the top ten results and their descriptions retrieved by each search engine for each query were evaluated by independent jurors. Evaluations of results and descriptions were then compared to assess their conformity. The core finding was that Google performed almost all the times better than the other engines. The difference to Yahoo was however not statically significant, and the difference to the third ranked engine MSN was significant to a low degree. The Arabic search engine Araby showed performance on most of the evaluation measures, while Ayna was far behind all other search engines. The other finding was the big differences between search results and their descriptions for all tested engines.
%0 Conference Paper
%1 ir1
%A Tawileh, Wissam
%A Mandl, Thomas
%A Griesbaum, Joachim
%B Proceedings of LWA2010 - Workshop-Woche: Lernen, Wissen & Adaptivitaet
%C Kassel, Germany
%D 2010
%E Atzmüller, Martin
%E Benz, Dominik
%E Hotho, Andreas
%E Stumme, Gerd
%K arabic engines evaluation information retrieval room:-1418 search session:ir2 test web workshop:ir
%T Evaluation of five web search engines in Arabic language´
%U http://www.kde.cs.uni-kassel.de/conf/lwa10/papers/ir1.pdf
%X To explore how Arab Internet users can find the information in their mother tongue on the web, the five web search engines Araby, Ayna, Google, MSN and Yahoo were tested on an information retrieval evaluation basis with the consideration of the webspecific evaluation requirements. The test used fifty randomly selected queries from the top searches on the Arabic search engine Araby. The relevance of the top ten results and their descriptions retrieved by each search engine for each query were evaluated by independent jurors. Evaluations of results and descriptions were then compared to assess their conformity. The core finding was that Google performed almost all the times better than the other engines. The difference to Yahoo was however not statically significant, and the difference to the third ranked engine MSN was significant to a low degree. The Arabic search engine Araby showed performance on most of the evaluation measures, while Ayna was far behind all other search engines. The other finding was the big differences between search results and their descriptions for all tested engines.
@inproceedings{ir1,
abstract = {To explore how Arab Internet users can find the information in their mother tongue on the web, the five web search engines Araby, Ayna, Google, MSN and Yahoo were tested on an information retrieval evaluation basis with the consideration of the webspecific evaluation requirements. The test used fifty randomly selected queries from the top searches on the Arabic search engine Araby. The relevance of the top ten results and their descriptions retrieved by each search engine for each query were evaluated by independent jurors. Evaluations of results and descriptions were then compared to assess their conformity. The core finding was that Google performed almost all the times better than the other engines. The difference to Yahoo was however not statically significant, and the difference to the third ranked engine MSN was significant to a low degree. The Arabic search engine Araby showed performance on most of the evaluation measures, while Ayna was far behind all other search engines. The other finding was the big differences between search results and their descriptions for all tested engines.},
added-at = {2010-10-05T14:15:12.000+0200},
address = {Kassel, Germany},
author = {Tawileh, Wissam and Mandl, Thomas and Griesbaum, Joachim},
biburl = {https://www.bibsonomy.org/bibtex/27b499e2bef057fcb28317866ec9a2f60/lwa2010},
booktitle = {Proceedings of LWA2010 - Workshop-Woche: Lernen, Wissen {\&} Adaptivitaet},
crossref = {lwa2010},
editor = {Atzmüller, Martin and Benz, Dominik and Hotho, Andreas and Stumme, Gerd},
interhash = {46e4560ee01ea5f5bd9e8d0a253be91c},
intrahash = {7b499e2bef057fcb28317866ec9a2f60},
keywords = {arabic engines evaluation information retrieval room:-1418 search session:ir2 test web workshop:ir},
presentation_end = {2010-10-05 16:45:00},
presentation_start = {2010-10-05 16:00:00},
room = {-1418},
session = {ir2},
timestamp = {2010-10-05T14:15:13.000+0200},
title = {Evaluation of five web search engines in Arabic language´},
track = {ir},
url = {http://www.kde.cs.uni-kassel.de/conf/lwa10/papers/ir1.pdf},
year = 2010
}