I don't generally have problems after a rest day. I normally feel strong and eager, unless it's a rest day after a tough ride (say, a century, brevet, or a long ride on tour into a really nasty headwind). Sometimes those long ride hangovers last two, three, or even four days. But IME, it's the hard day hangover, not the rest day, that leaves me with logs for legs.