I would suggest getting better rest at night, skip the afternoon coffee.
Do what you can to minimize stress. (Including getting better rest.) Family stress definitely bleeds into training and some of it counts as “training stress”. But not the productive kind that produces improvement on the bike. The counterproductive kind . If your training goal is a source of stress, consider abandoning it.
Take 1-2 days per week rest- not just off the bike but not working out at all. Every 3 week, take a rest week- cut your riding by 50-75%. Don’t try to ride hard every day.
Eat food with high nutritional value when you’re off the bike, including sufficient protein and plenty of vegetables.
For the duration of time you’re on the bike, you’re eating more than you need to. You can train yourself to eat less, although I don’t think that’s the reason you’re fatigued.
If none of that helps, see a doctor to rule out a medical cause.
Also: structured training might really help you. If you want results, that’s often the most efficient way to obtain them. And still leave time and energy for your family.