a thoughtful web.
Good ideas and conversation. No ads, no tracking.   Login or Take a Tour!
comment by kleinbl00
kleinbl00  ·  2720 days ago  ·  link  ·    ·  parent  ·  post: How important is crowdsourced feedback to you?

You can't assume that all aggregates are created equal. Amazon reviews, for example, are stupidly easy to buy. Youtube comments are generated by people who think commenting on Youtube videos is a form of expression; Yahoo! Answers are mostly Something Awful goons trolling each other.

You have to understand the motivation of reviewers, as well as their investment in their reviews. That pretty much makes Rotten Tomatoes wholly and absolutely useless (much like all movie reviews - ask me about the time I "wrote" a movie review for The Stranger). Tech reviews on Newegg or Amazon, on the other hand, can be evaluated on face value - "I hate this product because it failed this explicit, technical task that it had every reason to pass" vs "WORST PRODICT EVAR WOOD GIVE ZERO STARZ IF i COULLD" self-polices.

You trust the aggregate because you have no insight into how it is created. Therefore the big number matters. Sometimes, I use that approach: "I need USB cables. Here's a set with 8,000 mostly 4-star reviews. They probably don't suck too hard." However, my buddy is looking for fuel injection for his truck and I got a recommendation from someone who has put FAST systems on no less than 8 jeeps. Do I give a fuck that it's got like 3 stars most everywhere?

No. No fucks given. Gearheads are fucktards and gearheads attempting to use computers are shit-throwing monkeys.





blackbootz  ·  2720 days ago  ·  link  ·  

I intuit that there's a spectrum that aggregates fall along. But it's hard to typify the aggregates with a high signal-to-noise ratio, because it's not merely that they're "moderated" or un-self-interested or a function of how deeply the participants care.

I'm a Rotten Tomatoes snob (meaning, I'm highly influenced by critics aggregate and won't see movies if they fare too lowly). I've noticed that in the last five or so years, I've watched fewer movies. I figured that it was mainly because I'm busier, but in thinking about it, I realize that I just exported my decision making and film going is less enjoyable. Watching a movie is now a weird confirmation of the critics score instead of a single-entendre act of watching a movie and enjoying it (or not). What makes Rotten Tomatoes useless in your eyes?

b_b  ·  2720 days ago  ·  link  ·  

    I'm a Rotten Tomatoes snob.

Dude. I like you enough that I'm going to ignore this comment after a slight shaming, but I can't let it slide. Crowdsourcing is perhaps the worst way of deciding what's good (even when the crowd is critics--especially when the crowd is critics, who are useless jerkoffs who spend time sitting in judgement). By this measure Brittany Spears was the best musician of 1997 (or whenever) because everyone wanted to fuck a 16 yr old in tight red vinyl. Crowds are full or morons, and aggregating a crowd's opinion guarantees nothing but mediocrity. Rotten Tomatoes is the internet version of actual human garbage and raw sewage.

As an aside, if you want to know how worthless critics are generally, go back and read reviews of 2001 from 1967 and then from decades later, after time had proven it ot be among the greatest movies of all time. Many of the same critics changed their minds miraculously. Critics generally are scum. I except Roger Ebert from that group, because he was a very talented writer who wrote on many topics with great insight, and even when he hated a movie he was very good at putting it in context. I would recommend never reading a review until after you've seen a movie, because perhaps you'll gain some better insight. You're only making yourself seem foolish by using the opinion of others as a proxy for your own.

blackbootz  ·  2719 days ago  ·  link  ·  

No, you're right. I feel a vague sort of laziness when I check Rotten Tomatoes. Like I'm relinquishing responsibility for developing a personal taste. It started because of the expediency -- if you don't but have one evening for movie watching, you want to make sure the experience is worthwhile. But it's grown into a way larger thing than I'd like to admit. I'm resolving to stop checking RT before seeing a movie.

kleinbl00  ·  2720 days ago  ·  link  ·  

1989: the year Keyboard Magazine cited Jane Child as "Debut Album of the Year."

Among the losers.

kleinbl00  ·  2720 days ago  ·  link  ·  

Play this game for me:

1) List, oh, five movies you know really well. Like, don't like, doesn't matter. If you're really into it, list ten. Doesn't matter though.

2) Next to each one, write down what you think of that movie out of ten. Good, bad, indifferent, write it down.

3) Go look those movies up on Netflix. What does Netflix predict you'll think of those films? How's the correlation?

4) Go look those movies up on Rotten Tomatoes. How's the correlation now?

See, I'm educated about film. I'm a film professional. I'm surrounded by film professionals. And if you think you and your friends have differing views about films... I mean, my best friend since 8th grade has opinions so different than mine that I deliberately avoid any movie he likes. He's got an MFA in this shit. I've gotten into flame wars over Network and Crash. I know the guy who passed on Being John Malkovich for HBO... and we nearly came to blows over Children of Men (and I happen to hate BJM). And everybody on all sides can make erudite, intelligent arguments about why they're objectively right and why you're objectively wrong and neither one of us has a leg to stand on because at the end of the day, it's art.

Ever looked up the contemporary reviews of, say, Empire Strikes Back? Blade Runner is just as bad. How 'bout A Christmas Story? Even individual reviewers often restate their opinions. And while I usually agreed with Roger Ebert, he was offensively, stupidly wrong so often that even a reviewer you trust can often be completely full of shit.

So. There's probably no correlation between what you think and what any one reviewer thinks. There's demonstrably no correlation between what you think and what every reviewer thinks. So why give the mantrolls of Rotten Tomatoes the power to tell you that Ghostbusters sucks because it's full of GURLZ? I mean, if you care, see it for yourself and determine for yourself why it sucks (or not).

blackbootz  ·  2720 days ago  ·  link  ·  

OK, listing five movies I love and five I dislike, with they x/10 score I believe they contemporaneously received.

1) The Shawshank Redemption (10/10). Instantly recognized masterpiece.

2) Tommy Boy (8/10). Hysterical, even though retard jokes don't age well out of the 90s.

3) Children of Men (10/10). Cinematic marvel, thought-provoking sci-fi at some of its best.

4) Michael Clayton (9/10). Underrated thriller.

5) The Big Lebowski (10/10). They must have known this would be a cult classic.

6) Enough Said (4/10). I just remember wanting two hours back.

7) Wild (probably got 10/10). I disliked the movie almost as much as I disliked the first 50 pages of the book I read.

8) American Sniper (probably got an 8/10). I was distracted by the raw propaganda of this movie. I've been told that if I hated this movie, I should stay away from Michael Bay's 13 Hours.

9) Ex Machina (8/10). Twice I could not get more than halfway through this movie.

10) .... 2001 A Space Odyssey. (10/10). I know I will be called a stupid, unappreciative millennial. But I spent a month reading Anna Karenina everyday that went by faster than this movie. I can almost feel how wrong I am on this one, but I just can't force myself to like it.

Alright, firing up Rotten Tomatoes.

1) The Shawshank Redemption (10/10). 91%

2) Tommy Boy (8/10). 44% (LOL)

3) Children of Men (10/10). 92%

4) Michael Clayton (9/10). 90%

5) The Big Lebowski (10/10). 81%

6) Enough Said (4/10). 96% (Holy Jesus what the fuck?!)

7) Wild (probably got 10/10). 90%

8) American Sniper (probably got an 8/10). 72%

9) Ex Machina (8/10). 93%

10) .... 2001 A Space Odyssey. (10/10). 94%

Ok, so I wasn't totally off. I was generally within 10%, except for the times I wasn't. I don't know if my aim is good or not, or if I even want it to be good. But certainly there's an effect of priming: if a movie is rated poorly, I brace myself to enjoy it less, which is a wholly unnecessary waste of 12 bucks. I don't need to give that power away.

kleinbl00  ·  2720 days ago  ·  link  ·  

Ahh, but what did Netflix think? Because Netflix's algorithm is refined to your inputs. It uses affinity to track how well it thinks you will like something. It's our magic new data driven studio that creates content based on what people really want! And it gave us Orange is the New Black! And House of Cards!

And Marco Polo.

And that's my point: at the end of the day, the best curve fit is still an approximation of what you'll think, and it doesn't know things like "kleinbl00 hates watching OITNB Season 1 because the sound is shit, and Season 2 because you guys have never asked me how I feel about fat lesbians getting naked together." Some things it doesn't track well. The Napoleon Dynamite Problem has been solved for like eight years now and Netflix still gives four stars to shit that I hate, and two stars to shit that amuses the hell out of me (Netflix doesn't get irony).

And never mind the averages. Of your ten movies, you gave perfect scores to half of them. Of those four, three of them effectively got an A-. One of them got a B-. Doesn't mean they're wrong, it means they aren't tracking your tastes.

Which is pretty much this discussion in a nutshell.

Again - I'll use reviews that illuminate what, exactly, is broken about something. I didn't buy a phone system because a couple reviewers said "yeah, it supposedly does this thing, but we haven't gotten it to work." I got the more expensive version because everyone said "this thing is a total piece'o'cake to set up." It totally isn't, by the way... but tech support is super helpful so I'm happy with my choice.

It's all in how you use it.