I find the aesthetic of baggy pants for bikepacking to be as fashion oriented as the use of lycra is for road riding.
If I am just tooling around I will wear anything but if I am riding long distance or multiple days and worried about weight/bulk of gear I tend to stick with the following system (for bottoms only)
2x padded bike undershorts or 1 bib/1shorts
1x nylon athletic shorts for being in public. Small, light, easy to take on off without removing shoes
1x lycra tights or knee warmers (depends on season). For colder weather/mornings
1x wind/water resistant shell pants
1x micro fleece tights. For sleeping in or sudden cold weather
Sounds like a lot but it packs down small and by manipulating that combo I can ride for many days. Two shorts allow you to wash one, wear one each day for proper hygiene.