Jump to content

Photo

On the internet, trolls, and finally creating an effective rating syst


  • Please log in to reply
186 replies to this topic

#181
myrmaad

myrmaad

    Sugar and Spice

  • Supporter
  • 7,083 posts
I will be happy to assist with these.

#182
documn

documn

    Mullet

  • Premium Member
  • 653 posts
I wouldn't mind having multiple rating "buckets" as some people have suggested, but I also don't see a big problem with just using one number to rate a mod. As has been mentioned before, one of the biggest problems is that many mods are miscategorized and mistagged (or untagged). Naturally I would expect the rating to rate how good the mod performs its intended functions, which should also reflect in its category and tags.

On a somewhat related note, I don't understand the need to boost up the "big mods" by making them have a rating advantage over "small mods." The big mods have always got a lot of attention, downloads, and good ratings (and they deserved it), and I never felt that they were overlooked just because there happened to be a lot of small mods that had a perfect 10 or a lot of endorsements.

#183
arachnyd

arachnyd

    Stranger

  • Members
  • Pip
  • 6 posts
Your comments about EVE-Online are very true. I used to play a long time ago, back when the game was taken somewhat seriously. EVE is a game that begs to be taken seriously, with it's rich political and economic framework. That all went downhill as soon as the retards escaped from SomethingAwful and started GoonSwarm. Pretty soon the culture was a race to the bottom, and instead of seeing debates about ingame politics on the forums you saw "THREADNAUGHT LOLZ".


#184
LHammonds

LHammonds

    Ghost in da Machine

  • Supporter
  • 12,337 posts

I wouldn't mind having multiple rating "buckets" as some people have suggested, but I also don't see a big problem with just using one number to rate a mod. As has been mentioned before, one of the biggest problems is that many mods are miscategorized and mistagged (or untagged). Naturally I would expect the rating to rate how good the mod performs its intended functions, which should also reflect in its category and tags.

On a somewhat related note, I don't understand the need to boost up the "big mods" by making them have a rating advantage over "small mods." The big mods have always got a lot of attention, downloads, and good ratings (and they deserved it), and I never felt that they were overlooked just because there happened to be a lot of small mods that had a perfect 10 or a lot of endorsements.

hehehe. You seem to have contradicted yourself. If the review only has a single number, it will be very similar to how the votes were before and are now where the popular/large mods bubble to the top.

However, if you use the multiple buckets route, you could find the "best in class" which might only cover one particular aspect (bucket) rather than weeding through the ones that did well in all the buckets.

These buckets would need to be seriously contemplated and examined from several vantage points to make sure they are selected wisely. One viewpoint being, do they allow the best overall mods to bubble to the top? Do they allow smaller, more focused mods to bubble to the top (via a subset of buckets), do the buckets allow one to find the best mod for at least 80% of what people would want to search for?

LHammonds

#185
Dark0ne

Dark0ne

    Webmaster

  • Admin
  • 21,602 posts
Lon, this system is supposed to work differently to the old system in that "epic" mods, your Midas Magics, your Elesywr's, your AlexScorpion's guns, et cetera are rated higher than the smaller mods on the sites. Endorsements tell you how many people like the mod, reviews tell you how good this mod is compared to other mods on the site. It's meant to aid in comparisons between two files where endorsements can't because a file with 200 endorsements is liked a lot, and probably worth playing just as much as a file with 400 endorsements.

#186
baduk

baduk

    Old hand

  • Members
  • PipPipPip
  • 689 posts
Hi!

I read this article a while back but forgot about it. Important stuff.

I agree with LHammonds suggestions a lot. Its actually pretty much what i was thinking while i was reading through the thread.
Some parts of this thread were painful to read, lol.

I really like the idea of having endorsements separate and written mod reviews done by qualified members of the community.

There are a lot of reviews to make though and we will need to be patient to get enough reviews done. It is necessary to have a measure to prevent all the reviews from being written for a minority of well known mods while 90% of mods stay at 0 reviews.

I suggest that there be some kind of incentive for reviewers to provide quality mod reviews. Their reviews can be listed along with their profile, other community members can rate and comment reviews, and there can be a system to give deserved recognition to people who have provided the most helpful reviews.

#187
SuperAxilla

SuperAxilla

    Regular

  • Premium Member
  • 92 posts
"drilling in to reviewers and mod authors alike the true value of the rating numbers and that it's in everybody's best interest that their reviews are fair on both sides of the coin." That's probably a key issue. If I read into this correctly. I quite like the idea of rating and I feel much safer here than I did at a different site, which I constantly ran into trolls. I got "trolledover" several times. However, one of the problems was the tight knit groups of writers who...well they had their own groups and they would gang up on others who weren't in their groups by trashing other writers articles, instigating conflict, etc. If this system would prevent that sort of behavior, then I think it would be quite nice. I was surprised to hear that there are 1 admin to 200K+ members. That kind of reinforces the whole "banhammer" concept and why it is important to have a strict "no-monkey business" policy.




IPB skins by Skinbox
Page loaded in: 0.267 seconds