When my brake pads look bad like aluminum oxide instead of rubber or when they sound rough, I lightly sand the brake pads to get to fresher rubber. Brake pads are a lot cheaper than good rims
+1 or 2.... I found these metal particles in a set of brake pads I was cleaning today.
I suspect that this is pretty hard on rims.