Just one day? It can take several days or a week.
I love cycling, and generally working out too. But I can take weeks or even months off when I'm depressed. When I first injured my back I gave up on all physical activity thinking it was over for me. It took 8 years to come out of that.
When I finally determined that it wasn't over. I got back in the saddle and loved it all over again. Riding should always be fun. When it isn't, its time to take a break.