Black wool shorts, retro looking merino jersey, wool socks, merino sweater, cashmere tee shirt..
Sounds expensive but really functional. I had an old wool army surplus pullover--basically a double-weight long-sleeved wool T-shirt--and I would buy another in a heartbeat. As you say, even works as rain gear.