Friday, August 31, 2012

Designing The Next-generation Review And Recommendation System


It's unfortunate that despite of the popularity of social networks and plenty of other services that leverage network effects, the review and recommendation systems that are supposed to help users make the right decisions haven't changed much.

Thumbs-up and thumbs-down or likes and unlikes signal two things: popularity and polarization. If a YouTube video has 400 thumbs-up and 500 thumbs-down it means that the video is popular as well as polarized, but it doesn't tell me whether I will like it or not. The star review system also signals two things - on average how good something is and whether it's significant or not. There are multiple problems with this approach. An item with 8 reviews, all 5 stars, could be really bad compared to an item that has 300 reviews with 3.5 stars. Star ratings alone, without associated descriptive reviews, wouldn't make much sense if there aren't enough people who have reviewed the item. Also, relying on an average rating alone could also be problematic since it lacks the polarization element. On top of it, the review and likes could be gamed.

Pandora's as well as Netflix's recommendations are a good example of using collaborative filtering to fine tune recommendations based on user preferences. The system aggregates the overall likes and dislikes and combines that with your taste profile and a few killer algorithms to recommend what you might like. If designed well and if it has large user population, it does work. But, the challenges with such system are missing descriptive reviews and lack of ability to perform any analysis on it. If I dislike a song on Pandora, it doesn't mean the song is bad in the absolute sense. It simply means it doesn't match my taste profile. This isn't entirely true if I dislike a blender. In this case, a descriptive context is more meaningful such as I don't like this blender because it doesn't crush spinach well. People who care to make smoothies and crush ice may not care about this issue. But, these consumers have to wade through large number of reviews to determine the product fit.

E-commerce sites review systems use the same descriptive as well as non-descriptive review systems, commonly used at all places on the internet, without any significant modifications, even if the expected investment of a user is much higher on their site. If I don't like a song, I can skip it. If I don't like a YouTube video, I can stop watching it and now if I don't like a movie I can stop streaming it. This does not apply in the traditional world of e-commerce. I absolutely need to make sure that I buy something that I like. Returning an item is a far more involved process than stop watching a movie. It's an exception, not a norm.

Word of mouth and passive buying

People shop in two ways: 1) they look for a specific product, research for it, and buy it. 2) they come across a product while not looking for it, like it, and buy it.

The second way of shopping, passive buying, is as important as active buying. There are many companies with a business model built around this impulse or "serendipitous commerce", but they don't leverage collaborative filtering. I would happily read reviews of products written by my friends and people that I trust regardless of whether I'm looking for those products or not. Think of it as Disqus-style aggregated reviews by people that I trust in my social graph. This is like an online version of a cocktail party conversation where someone is raving about a new phone that he just bought. I'm not looking for a phone, but I might, in a few days. This could create new interest or expedite my decision process. This isn't done well in the online world.

The word of mouth is still by far the best system for following recommendations. I invariably watch movies that my brother recommends to me and one of my friends will read all the books that I recommend to her. I have non-transactional relationship with my friends and family.

Contextualized long tail 

One of my favorite things, when I travel (leisure or business), is to try out at least one or two recommended Indian restaurants to see how Indian food compares from city to city and country to country (so far my vote for the best Indian food outside of India goes to London). While researching for a restaurant, I typically read all the reviews that I can find. Some reviewers are Indians and some are not. Also, for the reviews written by non-Indians, some are new to Indian food and some are not. In most cases people don't identify who they are and I end up guessing based on their username, description etc. These reviews, positive or negative, don't help me much to narrow down which restaurant I should try out.

I have always found the best food at the most unusual places. All sophisticated recommendation systems would fall short of helping me find such an unusual place. These places are not the hits. They are the long tail. Getting to this long tail isn't an easy process - a lot of asking around, digging for reviews, trying out a few awful places etc.

Privacy concerns and connected identities

As the debate between anonymity and identity continues, there has been a little or no effort to get to the middle-ground, a connected identity. As a marketer I don't care who Jane is in its absolute sense but I am interested in what she likes and dislikes based on her collective and aggregated behavior across the Internet and beyond. This is not an easy system to build and consumers won't sign up for this unless there's a significant value for them. The popularity of social networks is an example where even if users are arguably upset about their privacy they still use it since the value that they receive far outweighs their concern. And remember the social networks follow the power laws. As more and more people use it the network becomes more and more valuable to the users.

Why not design review and recommendation systems that are based on connected identities? Users don't want ads, the marketers do. If companies can focus on building good products, incentivize users to write reviews, and rely on great recommendation systems to connect the right users with right products they wouldn't need ads. The marketers are chasing the illusion of targeting the right users but the inconvenient truth is that it's incredibly hard to find those users and if they do find them, they don't really want ads. What they really want is value for their money. That is the inherent conflict between the marketers and end users.

Using connected identities beyond reviews and recommendations

Connected identities are also useful beyond reviews and recommendation systems. Comcast support is one of those examples where using connected identities could greatly improve their customer support.

Comcast started using Twitter early on to respond to customers' support issues. It was a novel concept in the beginning and they really understood Twitter as an effective social media channel, but lately that model has turned out to be as bad as their phone customer support. When I tweet to @comcastcares someones gets back to me asking who I am and what issues I have. You follow me, I follow you, you DM me, I DM you my info, and after few minutes, we are nowhere close to resolving the issue. What if Comcast allowed me to attach my Twitter account to my Comcast profile? I will OAuth that, for sure. When I tweet, they exactly know who I am, what problem I am experiencing, and how they might be able to help me. This is an example of using a connected identity without compromising privacy. Comcast knows their customer's billing information; it's transactional information. But they attempt to use Twitter to communicate with you without connecting these two identities.

I don't want to "like" Comcast or "follow" Comcast to be a victim of their spam and indifference. Comcast is easy to pick on, but there are plenty of other examples where connected identities could be useful.

Users don't like to be sold at, but they do want to buy. Let's build the next-generation review and recommendation system to help them.

No comments: