An evaluation study performed in Arabic language on the five web search engines Araby, Ayna, Google, MSN and Yahoo aimed to compare how good these search engines can satisfy the information needs of native Arab users on the internet in their mother tongue. The top ten search results for fifty randomly selected search queries and the descriptions of these results in the search results list were evaluated by independent jurors on a web information retrieval basis. Comparing the relevance of results descriptions presented by each search engine and the relevance of the search results themselves, a big difference was found between search results and their descriptions for all tested engines. Six usability aspects of the tested search engines where also evaluated from the jurors' perspective. Google reached the higher usability evaluation score followed by Yahoo then MSN. The two native Arabic search engines Araby and Ayna seemed to be less accepted by participated Arab internet users.