A man once verbally abused Abu Zar Ghifaari (radhiyallahu anhu) the illustrious Sahaabi of Nabi (sallallahu ‘alaihi wasallam), he replied to the man’s insult with the following words: “Brother! There is a steep and rocky road between me and Jannah. If I pass through safely, then your insult means nothing to me. But on the contrary, if I fail to cross that path and hence I am prevented from reaching Jannah then indeed I am worthy of insults much worse than what you have mentioned.” (Nafhatul-Arab Pg.13)
Lesson: Those who are conscious of the reality of this world and are focused towards their real destination, i.e. the Hereafter, they are not distracted by petty issues. Thus they easily dismiss the silly insults of people and happily continue on their journey towards the Aakhirah.
On the contrary if a person does not focus on his destination, or if one is consumed by his ego, such a person will be deeply affected by every little comment.
Therefore ignore the side issues. Keep your gaze on the way ahead and insha-Allah you will stay happy.