In that temp range I wear my windproof jacket and long sleeve wool jersey underneath. When I warm up I just unzip the jacket halfway. My jacket is a convertible so I can remove the sleeves if needed and it becomes a vest.
Highly recommend convertible jackets for rides when you start out cold but warm up.