Couple thoughts:
1. Your bibs and saddle may not be right for you. I'd start with a nice new pair of bibs - maybe even try going down a size. Some bibs are better suited to long days in the saddle than others.
2. Use more Chamois Butt'r. Apply liberally. They make small to-go packs too - like a gel. On long rides, bring one and re-apply mid ride. (Be sure not to confuse with a gel though - you don't want to eat it.)
3. Yes, hair can be an issue and removing it may help.
4. Any chance you're suffering from jock itch? That can exacerbate your issues. Make sure you're taking off your bibs as soon as possible after your ride and wash them thoroughly. (You can change out of bibs in a parking lot by wrapping a large towel around you.)