I ride a variety of dirt and gravell roads, but I tend to always keep a good eye further ahead so I have more time to slow down if there is a hairpin turn or loose patch ahead. I also continually test traction on straight safe sections and recalibrate my braking forces to stay within traction limits. Maybe your brakes do not have very good modulation, or maybe you are not keeping your speed within your stopping limits for what you can see ahead. Maybe you have to spend more time testing out a new bike to learn handling characteristics and limits. Maybe you are young enough so that falls do not hurt as much and therefore you are more willing to take chances...