The objective of this pilot study is to investigate relevance judgments made by end-users when searching for image information. The pilot study involved 10 undergraduate students from the Department of Journalism and Media Studies at Rutgers University using the AccuNet/AP Photo Archive to retrieve specific, general, and subjective photos. The study identified core relevance criteria used across the three different image searches, and found that the participants in the general and subjective image searches relied more on personal feelings and textual information of photos to make relevance judgments, while the participants in the specific image search depended more on the features of objects in photos. Four textual representations–caption, object name, location, and creation date, were chosen to see how useful they were for the participants making relevance judgments. The results show that location was the most useful information among the four textual representations.