Man, I never wore any of that stuff when I first started out. I used to wear cutoff jeans with a tee shirt. I was so self conscious that I wore an unbuttoned button down short sleeve over the t-shirt so that it would cover up my fat somewhat when I had to stop at lights and such. Around town some folks would call me superman because when I was moving the button down would look like a cape flying behind me.
Years later and many pounds lighter I still can't wear the Lycra stuff. I normally wear loose polyester sports shorts and tops they sell at Walmart. Much Much better than wet sweaty cotton.