Early-Stage Software Can Sniff Out Lies in Fake User Reviews

If you’ve ever used reviews on Yelp.com to whittle down options for dinner, you’ve probably encountered write-ups that linger a little too long on the outstanding service of one particular waiter or perhaps sling some mud at the rival pizza shop down the street.

It’s no secret that business owners and jaded customers plant false reviews on crowd-sourced review sites such as Yelp, but a team of professors and doctoral students at Cornell University is developing software that can vet those slanderous reviews, identify deceptive language, and sift out the fake critiques from the honest ones. In the process, the software could someday help site users cut through misleading information they would otherwise accept as truth.

That consideration is especially important given web surfers’ inability to pick out deception. During the Cornell study, which was recently presented by doctoral candidate Myle Ott at the annual gathering of the Association for Computational Linguistics, Ott and a team of researchers asked 400 volunteers to write intentionally false reviews of 20 Chicago-area hotels. When a selection of those fictional reviews were given to three human judges, the panel failed to identify false entries with any accuracy beyond simple luck or guesswork.

Next, the researchers applied a set of homegrown algorithms to a collection of true and false write-ups and set the code to search for deception-identifying cues within the text of each review.

The result? Nine times out of ten, the software accurately identified deceptive hotel reviews. The findings showed that falsified reviews were more likely to contain language detailing a made-up back story—for instance, words such as “business,” “vacation,” or “my husband,” that explain a person’s fictional motivation to visit a hotel or detail who accompanied them on the trip.

On the other hand, truthful evaluations use more substantive words that reflect a live, in-person experience.  The study cites words such as “bathroom,” “check-in,” or “price” as the type of concrete keywords used by a reviewer who actually visited a place of business. The study also concluded that misleading reviews included more verbs, while truthful ones contained more nouns, likely a sign that a fake user review focuses on actions but lacks the knowledge to describe surroundings, peoples, and experiences.

When the algorithm was altered to pair the keyword-search method with other lie-detecting strategies involving punctuation and the number of first-person references, the software identified fraudulent reviews with an accuracy of 89.8 percent.

That rate of success is impressive, though the researchers were quick to point out that testing is far from conclusive. The study’s intention, to give crowd-sourcing fans a means to trust online reviews, might just make the Internet’s trust circle a little bit wider.

Tags: Software
LEAVE A REPLY
Name*
Email* (will not be published)
Website
*Indicates required field
Comments*
Submit Comments

FIND A REVIEW
Laptops
All Product Types Accessories Cars Digital Camcorders Digital Cameras eReaders GPS Laptops MP3 & Video Players Projectors Smartphones Software Storage Tablets / MIDs VoIP Wi-Fi
All Subcategories
All Subcategories All-Purpose Budget Business Desktop Replacement Gaming Multimedia Netbook Nettop Rugged Student Tablet PCs Ultraportable
Brand
Acer Alienware Apple Archos ASUS Averatec BenQ CTL Corp. Dell Digital Storm eMachines Emtec Everex Fujitsu GammaTech Gateway General Dynamics Getac Gigabyte Hercules HP HTC iBuyPower Intel Lenovo MSI Nokia Nvidia OCZ OLPC OQO Origin Panasonic Sager Samsung Sony Sylvania Systemax TabletKiosk Toshiba Verizon Viewsonic Viliv VooDoo Workhorse PC ZT Systems
Minimum Rating
Any Rating Editor's Choice 4.5 Stars 4.0 Stars 3.5 Stars 3.0 Stars
Screen Size
10 11 12 13 14 15 16 17 18 20 4 5 6 7 8 9
Resolution
1024x576 1024x600 1024x768 1200X800 1280 x 720 1280x1024 1280x768 1280x800 1366x678 1366x768 1440x1050 1440x900 1600x768 1600x900 1680x1050 1680x945 1920x1080 1920x1200 800x400 800x480
Weight Range
10.1 - 12.0 pounds 12.1 - 14.0 pounds 14.1 - 16.0 pounds 2 lbs 2 pounds and under 2+ lbs 2.1 - 4.0 pounds 4.1 - 6.0 pounds 6.1 - 8.0 pounds 8.1 - 10.0 pounds Over 16 pounds Under 2 pounds
more options
SUBSCRIBE