So have I been doing it wrong all along?
I take a spoke, thread a little bit on the back, poke it through until I can pinch the nipple and spoke together. Then I grab a small screwdriver and thread it in.
It's a little fiddly but seems to work. This nipple driver seems so easy to diy, that I'll definitely make one before my next build. Curious how much it helps.