Take as long as you feel you need. Your doctor will give sensible, probably cautions, and very generic medical advice---he cannot know how well each person recuperates, or how quickly anyone might heal in a given situation.
Listen to your body, and probably, be more cautious than you need to be.
Last time I crashed hard, I re-injured by cracked collarbone twice and turned a six-week recuperation into three months. I got excited, I was overeager---I wasted six weeks of starvation (so as not to bloat up while inactive) and Complete inactivity---I lived one-handed pretty much exclusively, which was a real pain---because when I finally was able to use the arm I overstressed the bone and rebroke it. Twice. Not recommended.
Give your body time to heal deeply. Then start really slowly until you are sure that you are okay. Don't be like me, it's no fun.