Aloo, love your persistence, keep it up. A lot of good advice given.
For me I need to try and keep options open so I don't talk myself out of riding. Having public transportation available is a great back-up, even if it takes longer. Also, knowing where a good place to stop for a break also helps. Again, the more you ride and develop a habit, the easier it will be. As BobbyG said ride your ride. Don't compare to others, especially with speed and any other metrics. Keep it fun and safe.