PDA

View Full Version : Rating System


ZullieZevize
12-13-2011, 10:18 AM
<p>Ive seen alot of comments about the rating system so far, but what my biggest problem with it is how it calculates the 'top in style' and 'top in creativity'.</p><p>On our server, the 'top' in style and creativity with two awards for each.  Is a poor dungeon, with a very well hidden exit.  It has one vote. (most likey an alt who could actually find the exit)</p><p>This beat out other dungeons, with 4.5 stars, that had 11, 20, 30, 50 votes.</p><p>There are good dungeons, that are getting pushed down the list, because the calculations for rankings does not take this into consideration.</p><p>Its the same for the housing leaderboards.  There are ones in 'hall of fame' that have 7-10 reviews, that beat out ones with 100+ reviews, simply because it 'won' more awards, because it was a few percentage points higher (all showing 5 stars)</p><p>I never really complained about it with housing, because it didnt matter all that much. </p><p>But in Dungeon finder, where you earn tokens for others hunting in your dungeon, the ability to get enough awards to be in hall of fame, makes a difference to how many tokens we earn.</p><p>It wouldnt surprise me if people start usign free accounts, to give their competition poor ratings, just so they look better.  The people with large guilds, are already using their guild members to boost their ratings.  Yes, everyone is entitled to their opinion, but the current system can not be used to accurately select well built playable dungeons.</p>

ShadowMunkie
12-13-2011, 12:00 PM
<p><cite>ZullieZevize wrote:</cite></p><blockquote><p><strong>It wouldnt surprise me if people start usign free accounts,</strong> to give their competition poor ratings, just so they look better.  The people with large guilds, are already using their guild members to boost their ratings.  Yes, everyone is entitled to their opinion, but the current system can not be used to accurately select well built playable dungeons.</p></blockquote><p>Free Account votes never were allowed int eh first place. While yes they get the option to vote, no it doesn't count towards the actual votes.</p><p>As far as the rest, well its clear that the ones with the most friends are going to win in any rating system put into place. Of course you also have the people that buy votes. I myself have the Top Dungeon in Creativity and in Style for Chardok on my home server and I have 7 votes. It takes approximately 1 hour to complete the dungeon and awards a certain amount of tokens. People liked the dungeon because I placed the mobs really well and it was exciting and entertaining at the same time. (Note: Chardok is freaking huge.)</p>

ZullieZevize
12-13-2011, 12:40 PM
<p>But without any way for them to leave comments, you really dont know 'why' they voted the way they did.</p><p>I have 4 paying accounts in my household, so getting an alt to vote for me isnt a problem.</p><p>You, having a top rated zone, with a whopping 7 votes, is my problem.  7 votes all 5 stars = 35 stars total.</p><p>Some one else, ranking second, with 4.90 stars..100 votes, 99 5 stars, and one 1 star, (ok, dont check my math, im pullin numbers out of my head, just to show the point).. in the current system, rates lower than your 7 vote dungeon.</p><p>Its obvious that more people liked the 4.9 dungeon, but its not 'top rated'</p><p>There are plenty of other ways to rank the dungeons. </p><p>1. Add more things to vote on, and seperate some additional types. </p><p>I build  a 'solo' zone, might get high ratings by the solo'er, but low ratings by the groups.  A zone built for groups, that isnt really soloable, wont get good ratings either.</p><p>What is style?  Play style, mob placement, decorations??</p><p>Just what is Creativity?  Moving one bed from that corner to this corner? </p><p>Alot of high rated 'style and creativity' zones are all the default zones, with mobs in the standard center, corner positions, and doorway positions.</p><p>Add things to vote on like solo/group ability (single star = solo, 5 star = group) but dont have those numbers affect ranking.</p><p>Break creativity and creativity down into things like 'storyline', 'decor or enviroment' 'mob selection' 'theme' etc. Things that are a little more specific.</p><p>2. Alter the star rating, to a wider range... Say 1-10, labeled as like, disliked for example.</p><p>3. Take popularity into account somewhere.  Maybe create a 'most popular' secion for rankings with the most stars (if your going to keep the current ranking system in place)</p>

Banedon_Toran
12-13-2011, 01:52 PM
<p>If this is working the same as the housing system, the calculation ignores any excessively high rankings and any excessively low.  Not sure how it decides the cut offs but a single 1 star shouldn't make a difference.</p>

intoXILE
12-13-2011, 02:21 PM
<p><cite>ZullieZevize wrote:</cite></p><blockquote><p>Ive seen alot of comments about the rating system so far, but what my biggest problem with it is how it calculates the 'top in style' and 'top in creativity'.</p><p>On our server, the 'top' in style and creativity with two awards for each.  Is a poor dungeon, with a very well hidden exit.  It has one vote. (most likey an alt who could actually find the exit)</p><p>This beat out other dungeons, with 4.5 stars, that had 11, 20, 30, 50 votes.</p><p>There are good dungeons, that are getting pushed down the list, because the calculations for rankings does not take this into consideration.</p><p>Its the same for the housing leaderboards.  There are ones in 'hall of fame' that have 7-10 reviews, that beat out ones with 100+ reviews, simply because it 'won' more awards, because it was a few percentage points higher (all showing 5 stars)</p><p>I never really complained about it with housing, because it didnt matter all that much. </p><p>But in Dungeon finder, where you earn tokens for others hunting in your dungeon, the ability to get enough awards to be in hall of fame, makes a difference to how many tokens we earn.</p><p>It wouldnt surprise me if people start usign free accounts, to give their competition poor ratings, just so they look better.  The people with large guilds, are already using their guild members to boost their ratings.  Yes, everyone is entitled to their opinion, but the current system can not be used to accurately select well built playable dungeons.</p></blockquote><p>^^^Agree</p>