It ain't the acetone that's the problem, acetone is one of the safest solvents around. It is produced in small quantities by the human body and is used in various metabolic functions, and has been studied extensively for neurotoxicity, with none being found. As you mentioned though, other nasty compounds which have been dissolved into the acetone are readily absorbed by the body through the skin.
Gotta be careful with what you're working with, especially if you do it for hours every day.