We want to put an effort into making our reviews and ratings personal. We want them read, reviewed and rated by real people because it’s usually real people out there on the internet that are reading them or searching for information.
We want to be completely open on how we review websites on RevCrunch.
Here’s how we do it:
Selecting a travel blog to be reviewed
The RevCrunch team can submit travel sites they find themselves. We also have several directory lists to tap into. And, we take reader submissions.
Either way all websites go into a “pool” and are randomly selected before being handed over to a team member for review. At this time if there is a conflict of interest or personal reason why the team member cannot review the site then its name goes back in the pool.
Once selected the website is temporarily categorized by the team member. This is so the editor can mark up a draft calendar for publication based on topics (categories).
How the reviewer reviews a travel blog
First and foremost they read the blog! Yes, on super huge websites it’s not going to be possibly to read every page. Especially true on travel websites or prolific blogs. It will be up to the reviewer to go through as much as possible. And then prove it in their written review.
During the reading of the travel blog they’ll take notes and begin the rating process.
How the reviewer rates a travel blog
Each reviewer has a specific amount of time to review a website or blog. It’s usually based on an initial finding. The larger the website or blog the more time needed.
Depending on the category there are certain mandatory score cards that need to be filled out. Here’s an example for a “Travel Blog”
- Content (quality of content based on topics, source, originality)
- Site Design (how does the blog look, navigate, and function)
- Photography (Quality, relevance and source of photographs used)
- Style of writing (how good is the writing on the blog, style, spelling, grammar, flow)
- Continuity (specific to travel blogs, how does the continuity flow on the blog)
Most of these titles speak for themselves apart from continuity. It’s specific rating for travel blogs and even more specific to travelogues. We’ve come across many travel blogs that involve the blogger posting about a certain country or place. Then all of a sudden they start posting about another country. Or leave us hanging from a previous post. Or suddenly insert irrelevant content. To us it spoils the flow of a blog. So, we’re taking that into account.
Each rating from a reviewer is graded from 0 – 5
Submitting the review
The reviewer now hands over their full review in draft during a RevCrunch team meeting and gets a new website. Meanwhile all the other team members read the review and give their own opinion. We add up everyone’s rating and then give the blog a RevCrunch Team rating from 0 – 10.
Now it’s passed to the editor for final proofing and scheduling. At this time the Editor may, or may not decide to give the website an “Editors Choice” badge. This simply means that the blog in question is, in the editors opinion, exceptional to the point of having it highlighted.
That’s it from us, it’s off to press.
Everyone gets a say in rating a travel blog on RevCrunch. Commentators are welcome to give their own rating on a website based on a simple 0-5 rating in the comments field. They are also free to give reasons for their rating in the comments or question our ratings etc.
Readers rating are taken seriously and websites based on reader ratings are displayed in their own rating card on the side bar.
To prevent spam or vote rigging all comments are moderated.
That’s it, the whole process!
What happens if a website changes its content or design etc after you’ve reviewed it?
No problem. If the change is large enough to warrant a second review then we’ll do one. Small changes that a reviewer picks up on will not warrant a change. In such cases the editor will assign a time to re-examine a website. And, if necessary adjust the ratings and review. However just be aware that ratings can go down as well as up!
I don’t like my review can I ask for another?
That’s why we have a multi-tier review and rating system. So no you can’t.
Do you consider Page Rank?
Does Google still count page rank? Yes, we believe so. But we don’t. We’re not Google, and have no idea how Google really awards page rank so we can’t justify it as part of our rating system.
Do you rate blogs based on traffic?
No we do not take website traffic into account. We’ve looked at this and taken it under consideration. There are already many top 10/50/100 sites out there listing travel blogs by traffic rank.
Traffic rank can be duped or bought easily. We won’t go into the details here but it’s quite easy to raise your traffic rank based on several popular ranking website methods. The only true way to currently rank a website by traffic is to ask for its server stats. And, or, something like a Google Analytics report.
That way we can decipher the quality and where the traffic is coming from. However this is not feasible at the moment.
But traffic must count for something?
If we can define the quality of traffic then yes of course it counts. However for us a website getting 5,000 stumble hits a day and only 1 second on site time doesn’t rate as much as a website that gets 100 hits a day and 4 minutes on site time. Clearly there’s a difference.
On RevCrunch we want quality over quantity
And, we hope you do too!