Home > Message Board > Articles > CNET Reviews Analyzed

CNET Reviews Analyzed

[ Create New Article ] [ Reply ] [ Edit ]

CNET-Reviews

Our study analyzed 1,325 product reviews by CNET Editors across all categories during the 2007 calendar year.

CNET uses a 10-point rating scale to rate products. Each product is evaluated and given a score for "Design" (30%), "Features" (30%), and "Performance" (40%). CNET then calculates the weighted average to get a products final score.

Please note that value or price is not factored into a CNET rating.

Our study revealed the following:
  • The average and median CNET Editors product rating were both 7.0
  • The most common rating was 7.0 - given to 172 products
  • 96% or products were rated between 5.0 and 8.9 (see chart below)
Common


Each point on CNET's 10-point scale is given a classification and definition. The table below outlines the CNET rating/meaning and the percentage of reviews that received a rating in that range.

RatingCNET ClassificationCNET Definition% of Total
10PerfectThis exceedingly rare score is reserved for a product that is as perfect as it could be. 0.0%
9.0 to 9.9SpectacularA product that receives a rating in this range scores high on all of its rating criteria. It succeeds at meeting all of its intended users' needs and has no meaningful drawbacks.0.8%
8.0 to 8.9ExcellentA product that receives a rating in this range is superior in so many ways that its relatively few drawbacks are not very important. 18.6%
7.0 to 7.9Very goodWhile the strengths of a product scoring in this range certainly outweigh its weaknesses, it has some minor faults that certain users should be aware of. 41.8%
6.0 to 6.9GoodThis range represents a product that is above average. Its strengths slightly outweigh its weaknesses, making it good for most uses but not a standout. 27.8%
5.0 to 5.9AverageA product that scores in this range is functional but unremarkable. 8.0%
4.0 to 4.9MediocreProducts in this range are below average. They fall the middle of the pack for most features, but suffer from a few additional major flaws.1.7%
3.0 to 3.9PoorYou probably should not consider a product in this range or lower. There may be one or two specialized circumstances, however, that could justify the purchase of this product for a very low price for a specific demand. 1.0%
2.0 to 2.9TerribleA product that receives a rating in this range scores low on all of its rating criteria. It does not satisfy any of its intended users' needs and has no meaningful strengths. 0.3%
1.0 to 1.9AbysmalA product in this range should never have been produced. This product has no redeeming qualities and worse, may actually harm you or your productivity. 0.1%


As noted, CNET Editors only rated 8% of products from 5.0 to 5.9 during 2007, which is what CNET considers "Average", while 42% were rated 7.0 to 7.9 (Very Good).

Scale-Pie


CNET's most popular rating was 7.0, followed by 8.0, and then 7.3. The chart below shows the number of reviews given the same rating.

Distribution

The highest and lowest rated products both happened to be video games: Within each category the average rating only slightly varied from the overall average rating (7.0). Storage and Desktops received the highest average ratings, while Video Games and Portable Audio Devices were given lower average ratings.

Category

A closer look at the brands revealed a slightly greater variation from the overall average rating (7.0). Of the major manufacturers RIM (Blackberry) and Apple achieved the highest average ratings, while Casio and Olympus received the lowest.

Brand

See the tables below for additional results about categories and brands.

CategoryAverage Rating% of Total
Storage7.530.9%
Desktops7.454.1%
Networking and Wi-Fi7.441.4%
Car Tech7.431.7%
Computer Systems Accessories7.384.4%
Flat-panel and Plasma TVs7.311.6%
Peripherals7.231.5%
Headphones/Headsets7.215.5%
Home Theater in a Box7.181.0%
Cell Phones and Accessories7.1715.9%
DVD Players7.151.1%
Laptops7.076.0%
MP3 players6.983.9%
Portable TV & Video6.971.0%
Digital Camcorders6.963.0%
Computer Systems6.933.8%
Displays6.912.0%
Printers6.913.9%
Digital Cameras6.907.7%
GPS6.782.6%
Portable Audio Devices6.592.9%
Video Games6.3412.5%
Other6.9211.6%
BrandAverage Rating% of Total
Research In Motion Ltd.7.830.8%
Apple7.711.5%
Dell, Inc.7.631.6%
Microsoft Corp.7.421.3%
Sony7.394.8%
Canon USA, Inc.7.271.8%
Panasonic7.252.4%
LG Electronics U.S.A.7.251.9%
Motorola Corp.7.213.0%
Nokia Corp.7.131.7%
Sharp Electronics Corp.7.130.6%
JVC America7.121.3%
Gateway7.081.0%
Lenovo7.080.9%
HP7.084.3%
Samsung7.006.1%
Creative Labs Inc.6.980.7%
Toshiba6.922.3%
Philips Consumer Electronics6.770.8%
Eastman Kodak Co.6.660.7%
Olympus America Inc.6.590.9%
Casio Inc.6.550.5%
Other6.8659.2%


7.0 Final Thoughts
According to CNET's review policy a rating of 7.0 is considered "Very Good". Using CNET's own guidelines should we conclude that half of all products reviewed by CNET are "Very Good" or better, while the other half are, "Not Very Good"? Or, should we conclude that a rating of 7.0 is really an "Average" item since most products were given this rating?

Methodology
This was an independent study by eCoustics.com. The sample size was 1,325 product reviews by CNET Editors in 2007. Duplicate reviews (e.g. same model in different colors) and products reviewed but not given a number rating were elimated.
Relevant Product Info
Author Comments
Top of pagePrevious messageNext messageBottom of page Link to this message

New member
Username: Srjones12

River Forest, IL
United States

Post Number: 1
Registered: May-08
Edit Post

If I understand your implication correctly, we (consumers) should all now be wiser about CNET's "true" rating scale and interpret their weighted "Goods" appropriately. Well done!
Add Your Message Here
Post:
Bold text Italics Create a hyperlink Insert a clipart image
Username: Need to Register?
Password: Forgot Password?
Options: Enable HTML code in message
Automatically activate URLs in message
Action:
Topics | Last Day | Search | Formatting Tips | Terms | Rules | Help | Log out |
Home > Message Board > Articles > CNET Reviews Analyzed [ « Previous ] [ Next » ]