I'm not sure if this is what happened in your case, but when the star rating system came I noticed that if there was an older skin with several rates, the rating didn't change until someone new came along and rated.  Even if it was a similar rate, the over all rating changed because now.. it's not only stars that is different, the different levels of access people have puts more emphasis on their particular vote. 

So it probably isn't that anyone is mad at you, it is just some statistical adjusting that happens as the matrix wakes up and finds new numbers to play with.