Bokardo has an article about 5 ways to improve reputation systems which is from Boxes and Arrows, On A Scale of 1 to 5
Take aways:
1. List the behaviors you want to encourage and those that you want to discourage
2. Be transparent
3. Keep your reputation system flexible
4. Avoid negative reputations
5. Reflect reality
Framework:
1. Who is doing the rating?
2. What, exactly, is being rated?
3. If people are being rated, what behaviors are we trying to encourage or discourage?