I've never built a frame or anything, but I certainly do enjoy buying a used bike, stripping it down to the bare frame and building it back up with some modifications and customizing it to my liking. I find it very therapeutic.
I guess the real term for that would be assemble rather than build.
I also like to assemble my own computers and modify guitars too. I just can't leave well enough alone. It's a sickness.