5

Our product provides a search functionality. Search results are ordered by rank.

We also provide the possibility to rate the different search results: a user can (optionally) give each result a rating from 1 to 5 stars.

These ratings have no influence on the ranking of the search results. This was the recommendation of one expert we asked and it seemed very plausible to me, because rating and ranking are two different things.

E.g. sometimes I need a report or document which I don't like (and which I gave a bad rating) but which I have to use anyway.

That's the theory so far, now in practice user feedback shows, that people are expecting that their ratings have in influence on the search result order. Several users have asked why their top rated results are not put higher on the search results list.

Now the recommendation seemed quite good, but I don't want to fight against the users expectations either.

So my questions are:

  1. Is it a good practice to strictly distinguish between rating and ranking?
  2. Is there a way to fulfill this requirement and at the same time meet the users expectations?

2 Answers 2

3

You basically need to present a bunch of items and you have more than one metric to sort them by. Most websites who offer lists of items have this figured out well. You either present a sortable table where the rows are your items and the columns are the metrics, or do this via filters or tabs or any other navigation solution. Just make sure you provide an indication of all the relevant metrics in each view.

Google Play (note the open dropdown):

enter image description here

Amazon (same here): enter image description here

2
  • Yes, giving the user the possibility to define the search order could be a solution. So, I guess you would be prefer to keep ranking and rating separate?
    – stefan.s
    Jun 8, 2012 at 11:42
  • Thanks for the replies so far, I think we will for the user defined ordering of results.
    – stefan.s
    Jun 13, 2012 at 15:13
2

It really depends on what your search results (and your ratings) represent.

Your results should always be presented based on rank, but (at least in some situations), content rating may be reflected in an item's rank for a given result.

What goes in to determining the best match is highly dependent on context and content of the things being searched, and especially on the context in which items are rated.

If you're searching in a content database (e.g. an image library) and you enter the term "garden" and get 200 results, all matching the term in the image's title or description, I'd expect to see higher-rated images that still meet the search criteria as being weighted higher than equivalently-ranked images that have been rated lower. In that case, I would expect to have my rating be incorporated (appropriately weighted) into the search ranking algorithm. In general pages/images/items rated more highly are more likely to be the page users are looking for if they also appear in search results for the given keyword based on content.

Alternatively, if what you're developing is a search engine first-and-foremost (e.g. if you're Google) and the ratings are provided in the search results interface itself, I would read a rating being provided as a rating of that content in the context of my search term, not a rating of the content itself. As such, I would expect my 5-star rating of a given result to affect identical or very similar searches in the future. I would not expect that rating to be stored as a value of the content (the same result, in this design, could be rated by the same individual as both a 1-star and a 5-star result given different search keywords).

In either scenario, the rating shouldn't be the only factor in the ranking of results, or even the main one, but it should be a factor.

8
  • I've noticed that I put a lot of emphasis in this answer.
    – Kit Grose
    Jun 8, 2012 at 8:05
  • To your question about what a search result represent: it typically is a business intelligence report. But we have a federated search with an open API, so in the end it could be anything.
    – stefan.s
    Jun 8, 2012 at 11:44
  • So, your proposal is to let the rating influence the ranking. This is inline with the feedback we got from our users, but against the advice we got from an expert in this area. I'd like to hear some more opinions first...
    – stefan.s
    Jun 8, 2012 at 11:46
  • @stefan.s: Are the ratings being added to the items themselves or dynamically within search result listings?
    – Kit Grose
    Jun 10, 2012 at 7:29
  • 1
    Thanks for the replies so far, I think we will for the user defined ordering of results.
    – stefan.s
    Jun 13, 2012 at 15:13

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.