2008年10月19日日曜日

Why Social Software Makes for Poor Recommendations -The Long Tail - Wired Blogs

Why Social Software Makes for Poor Recommendations - The Long Tail - Wired Blogs

The problem with social software as a recommendation network has its roots in the problem of social software itself. "Friend" is a pretty blunt instrument when it comes to describing relationships, especially in matters of taste. The sad reality is that most of my friends  have rotten taste in music (I don't hold it against them), while the music recommendations I actually follow are mostly from people I've never met, be they Rhapsody editors or MP3 blogs.  Same for virtually every other narrow category where I need advice; odds are that the real subject matter experts aren't anyone I know.

In other words, the assumption that there's a correlation between the people I like and the products I like is a flawed one.  To use an analogy, Bill Joy, the co-founder of Sun Microsystems, famously uttered this truism (now known as Joy's Law):  "No matter who you are, most of the smartest people work for someone else." The same might be said of recommendations. No matter who you are,  someone you don't know has found the coolest stuff.

Compounding the problem, the people whose recommendations I trust in music are different from those whose recommendations I trust in movies. Gadgets are yet another group of mavens, as are games and books. Indeed, although I have dozens of "trust networks" (usually formed by reputation and experience, not personal relationships), most of them have nothing in common with each other, and almost none of them I consider friends. Some of them aren't even human--they're software.

In a sense, you can think of all your filters as being part of orthogonal trust networks, often with the only common member being yourself.  They rarely, if ever, overlap. Thus any service that tries to condense all of your different planes of influence into a single dimension is going to fail, at least as far as useful recommendations go. That isn't to say that such services shouldn't offer playlist sharing and Amazon wishlists, only that I'm likely to find better advice elsewhere. 

The filters that work best for me typically earned my trust by liking some of the same things I did, then turning me on to new stuff that I liked even more.  I really don't need to know anything more about these people, other than that they've got more time than me and are willing to listen to a lot of junk in search of undiscovered gems. And they, in turn, don't care much about me. When it comes to recommendations, friendship is overrrated.

Comments

I agree with the last paragraph (excepting perhaps the final sentence). Collaborative filtering is the killer app for navigating the LT.

On the other hand, I'm not sure I agree with the wholesale dismissal of "friends" as recommenders. In the same way that you so eloquently put that we all have orthogonal recommendation networks, we also have orthogonal friend networks, don't we? The group of friends with whom you might go to a concert could, quite easily, have zero overlap with the group of friends you see at the kids' soccer games on the weekends. But yet, they are all equal in their "friendness." Again, to paraphrase your statement, the only common linkage between these friend networks is you.

To your point, all friends will not provide equal recommendations in all domains. But, I would argue, some friends will provide superior recommendations in some domains. And in these cases, as discussed here, these long tail discoveries can really strengthen friendship and community linkages.

Don't forget emotions. Certain cheesy rock ballards, weird-smelling shampoos or unreliable British sports cars may become magical if your partner dotes on them. And representing emotions digitally is even harder than just reporting facts about sales or processor speed. A tough one indeed!

Very insightful. I've definetly found this to be the case on Musicmobs. Up to this point profiles have been based strictly on musical preference and not on personal. The relationship between users is labled "favorite users" -> "fans". I like this much better than "friend".

I agree with you that the generic social networks like Friendster are pretty bad for recommendations (unless they are going to focus on making "friend" recommencations). I think you'll see many niche sites pick up the ball in more specifc domains.

More support for your observation: at Epinions, we initially thought that social networks would be the source of recommendations. We quickly changed that to using the social networks to weed out the poor recommendations (if you're trusted by nobody or trusted members rate the review poorly, you don't even make the first cut). We used other methods (expertise in a specific area as determined by the community as a whole, for example) to weight the actual ratings.

There is a collaborative-filtering research project at the University of Minnesota with a great tool called MovieLens. It gives you the best of both worlds. Its main feature is to do collaborative filtering on movie preferences, so you can get suggestions based on the opinions of the anonymous masses that share your tasts. But you can also have "buddies" and allow the program to figure in their specific tastes as well. It's interesting to see how different the results can be.

You need to rank recommenders based on the number of others who trust them, calculated recursively ala Advogato (or PageRank).

I don't need to know anything about user X personally, just that a lot of others trust his opinions. And all I need to know about any of them is that a lot of people trust -their- opinions. It bootstraps itself.

Tim

Given an efficient market, prices are the most informative means of ordering by quality.

The Long Tail will be supported primarily by advertisers and affiliate programs.

Ad rates and affiliate sales, then, are the prices of the LT.

So efficient search/navigation will require 1) availability of data about sites' ad rates/sales revenue, and 2) ad-bitrageurs, who will seek profits by buying and selling LT ad inventory, and, by so doing, will make price formation efficient in the transparent LT (i.e., given requirement #1 has been met).

All told, Open AdSense is the key...

Cui Bono? :-)

This is the obverse of the moral epiphany in "High Fidelity", in which our Hornby hero learns to value people for what they *are* like, not what they like.

I hesitate to say this, it sounding like "tagging will solve anything and everything", but perhaps a tagging system for categorizing your "friends" would solve the recommendation problem rather neatly by narrowing the domain in which a friend is useful?

I have to say/guess that this hypothesis doesn't hold true for probably half of the population in the US (especially with the younger crowd - young defined at under 27) because music, books, movies, and tv are all socio-economic indicators and filters for seeing whether or not a person is worth trying to be friends with (for the majority of people). I suspect that the crowd who takes the time to read a blog about the long tail is probably filled with early adopters who aren't just passive consumers, but the rest of the (young) world chooses their media tastes based on their existing group of friends. So if you make friends with people who watch "Friends" and listen to Matchbox20 and go to see Kirsten Dunst movies, then you will end up watching "Friends," listening to Matchbox20, and going to see Kirsten Dunst movies. Not many people take time to try out and internalize their personal media preferences any more; instead, they pick up what people around them are already using.

Take the movie Garden State for example. It did so well because its biggest selling point was that the soundtrack was chosen by the director who knew that he made a movie for people who are of the same media tastes as he is. He loves The Shins, Zero 7, Thievery Corporation, and Frou Frou so he knew that if people knew what music was associated with the movie, then the only people who would go see the movie would be people who would be sure to like the movie, which in turns makes more people go see the movie because it got only *great* buzz (I've never heard a bad review of it from someone who saw it... 55 yr. old movie critics aside). By knowing that people's media tastes are aligned with their friends' tastes, he picked up 98% of his possible market.

This is becoming truer and truer everyday, but I can easily see how it doesn't really apply to the "atomic" suburban family who has social interaction that isn't as fluid or spontaneous. When you start building your life around where you moved for your job or spouse, then you just have to be friends with the people you are stuck with.

I think that you would have a better understanding of social software if you use del.icio.us rather than Friendster as your touchstone. To me, social software does not inherently have anything to do with "friends." It simply has to do with a group of people using the same software, sharing some data, and making connections. And it can be good at filtering the long tail.

Nancy (who found this blog item through del.cio.us)

I agree with Nancy above...Replace "Friends" with "Contacts"...a contact can be a friend, a relative, or someone who is an authority on Sushi...i.e. social networks simply give you the ability to filter by taste. You can vote someone inside your favorite taste vertical, and make them more (or less) of an authority on that vertical. I like a sushi restaurant, I see who else does. Theoretically, I can trust them more to show me other sushi places...they certainly don't have to be a friend...?

Interesting post, but don't a large percentage of friendships form on the foundations of shared interest and taste?

There's 2 types of friends recommendations the way I see it. One is based on what they like, and the other is based on what they know YOU like. Social networks like Friendster really only account for the first one, so it isn't very effective as you mentioned.
However, as mentioned above, there are other social networks more focused on shared tastes, rather than who you know, and provide something closer to the 2nd type of recommendation that is more useful.

Sometimes it works out. My top three 'musical neighbours' on audioscrobbler are my wife and two of my closest friends. Certainly I have plenty of other friends whose musical tastes I wouldn't want to use in filtering, but I would suspect that a fine-grained social network specification would be a very useful element for me in selecting new music. Social software _alone_ may not be useful, but as part of a package it definitely has a place.

I think the problem is we try to categorize "real life". "real life" is hybrid, we have friends, contacts, relationships for a multitude of reasons, and these reasons change over time and thus change the relationship. Any type of format reminds me quickly of solving problems in my physics studies with very simplified equations (first order instead of say 10th order) and thus can give you an *idea* about what is going on but that is where it stops.

It seems a lot I see/read here is that: it gives you a vague understanding of the dynamics but doesn't really get to the point where on a detailed level you are able to get a good solution.

I think that problem cannot be solved and we may be much better off by either solving a small part of the total problem (focusing on one type of recommendation, in one field of expertise) or keep it "vague" and somehow let the human brain make the last few steps in a connection whenever someone is triggered by something.

In other words: create a pool of as many "triggers" as possible, which takes more time, but probably gives someone the best solution in the end.

Old Napster did a good job by being able to look into someone hard drive and check if you like what you see and make this person "important" to you.

Just to re-iterate what a number of other people here have said, a social network isn't necessarily just a set of people you've slavishly marked out as your friends, but people you're related to in a multitude of other ways; perhaps such as taste, lifestyle, expressed trust, and so on.

I think that problem cannot be solved and we may be much better off by either solving a small part of the total problem (focusing on one type of recommendation, in one field of expertise) or keep it "vague" and somehow let the human brain make the last few steps in a connection whenever someone is triggered by something.

0 件のコメント: