On Travelbug, we like to foster an environment where travellers help keep each other informed. We want our users to have great accommodation experiences, and we ask them to place reviews on places they’ve stayed. We prompt them with an email after their stay and we show an accommodation provider’s rating in search results and on their listing page. I outlined this stuff in my blog post of September last year, and none of this is terribly different to any other site. What is different is that we currently allow reviews by people who have not booked on Travelbug to place a review with us, but should this change?
When you book with Travelbug, then place a review after your stay, your review is badged as a “verified” review. That helps indicate it’s from someone we know has stayed and we reckon it therefore holds more weight. Here’s an example of an Auckland hotel with both types of reviews. We only used verified reviews to count towards our recent 100% guest reviewed awards, for instance.
We still allow those who didn’t book their stay with us to place a review from us (as long as it is based on actual experience with the property) and we do this to make the site a useful place to research and book accommodation.
However lately we have been a little concerned that in allowing these non-bookers to review on our site, we might be actually doing the opposite and skewing reviews towards the negative end of the spectrum. We wondered if those who were placing reviews with us might be visiting Travelbug purely to place a negative review on a place they were particularly unhappy with. So we took a look at the numbers.
The numbers show that, over the last 12 months, unverified reviews are over twice as likely to be thumbs-down reviews. Here are verified reviews first:
And here are unverified reviews:
So while 6% of those who we know have booked with us place a thumbs-down review, 14% of the ‘unknowns’ place a review with a big fat downward thumb.
The question this raises then is this: should we change our rules and only allow those who have made a booking with us place a review, thereby making the reviews automatically more authentic and trustworthy? Or should we keep it open for anyone and everyone to place a review regardless of whether they booked on Travelbug?
To help us decide, we’re running a poll over on our Travelbug Facebook page, so take a look and place your vote. Internal Trade Me polling is pretty strongly skewed in one direction, so I’m keen to see what our readers, followers and likers have to say.
Hop on over, place a vote and help shape the future of Travelbug accommodation reviews! I’ll keep you posted on the results, meanwhile here’s a cartoon from the awesome XKCD to leave you with:
When you calculate your award system I feel you should use all those with “Travel Bug Verified” in your calculation.
Accommodations that use the bookit calendar on their own website can show with a lot more quality reviews on Travel Bug but do not get included in the award calculation.
It could appear strange that those achieving a high thumbs up review rate do not show as the winner.
Since Travel Bug and Bookit are owned by Trade Me it would encourage more in the industry to use the bookit calendar on their own sites. Trade me would be the winner.
Bookit system has much merit as it saves a small operator expensive merchant banking fees involved with credit cards.
Hi guys, thanks for your comment. The 2012 Travelbug Awards were calculated using only verified reviews anyway, we felt that was only fair. And reviews from bookings from you own website – if you use BookIt – will appear as “verified” on Travelbug, so there is only good news for you there too. That is certainly another advantage of using BookIt on your own site on top on the cost savings you mention. Cheers – Daniel
Yeah Thanks a bunch!
Now we have lost all our positive reviews, much appreciated NOT!
Now when people look at our site on Travelbug they are much more likely NOT to book!
A Lose Lose situation for both of us!
Surely it should be up to the individual listing/member whether they allow reviews from guests that havent booked through Book It!?
You coulda asked us first!!
We await your response with some interest.