I actually pushed a baby rattlesnake off of one of our streets last year. Not by picking it up, mind you, wouldn't be prudent. Rude little thing. I really didn't want to see a smashed baby rattlesnake for the rest of the summer. I ride on that street a lot. It's right by a creek, so I assume mom was nearby.
I expect there are predators that kill them.