On Travelbug, we like to foster an environment where travellers help keep each other informed. We want our users to have great accommodation experiences, and we ask them to place reviews on places they’ve stayed. We prompt them with an email after their stay and we show an accommodation provider’s rating in search results and on their listing page. I outlined this stuff in my blog post of September last year, and none of this is terribly different to any other site. What is different is that we currently allow reviews by people who have not booked on Travelbug to place a review with us, but should this change?
When you book with Travelbug, then place a review after your stay, your review is badged as a “verified” review. That helps indicate it’s from someone we know has stayed and we reckon it therefore holds more weight. Here’s an example of an Auckland hotel with both types of reviews. We only used verified reviews to count towards our recent 100% guest reviewed awards, for instance.
We still allow those who didn’t book their stay with us to place a review from us (as long as it is based on actual experience with the property) and we do this to make the site a useful place to research and book accommodation.
However lately we have been a little concerned that in allowing these non-bookers to review on our site, we might be actually doing the opposite and skewing reviews towards the negative end of the spectrum. We wondered if those who were placing reviews with us might be visiting Travelbug purely to place a negative review on a place they were particularly unhappy with. So we took a look at the numbers.
The numbers show that, over the last 12 months, unverified reviews are over twice as likely to be thumbs-down reviews. Here are verified reviews first:
And here are unverified reviews:
So while 6% of those who we know have booked with us place a thumbs-down review, 14% of the ‘unknowns’ place a review with a big fat downward thumb.
The question this raises then is this: should we change our rules and only allow those who have made a booking with us place a review, thereby making the reviews automatically more authentic and trustworthy? Or should we keep it open for anyone and everyone to place a review regardless of whether they booked on Travelbug?
To help us decide, we’re running a poll over on our Travelbug Facebook page, so take a look and place your vote. Internal Trade Me polling is pretty strongly skewed in one direction, so I’m keen to see what our readers, followers and likers have to say.
Hop on over, place a vote and help shape the future of Travelbug accommodation reviews! I’ll keep you posted on the results, meanwhile here’s a cartoon from the awesome XKCD to leave you with: