Never.
I ride outdoors 52 weeks/year. If the weather is so crappy that it truly precludes riding a bicycle outdoors, that's the universe telling me "don't ride a bicycle today!"
And I always listen to the universe.
The trainer -- and the rollers -- are really my wife's, not mine. But even she only uses them maybe half a dozen, possibly a dozen, times a year.