If everything you do in the name of Islam is to earn the Pleasure of Allaah, you will care less about what the people say about you.
Just note it, you cannot please all the people the same way you cannot dispelase all but your certain acts can drive the people away e.g.when you are arrogant and insolent, and you look down upon the truth and its people.
But if you take care of what is between you and your Lord, and you try your best to act within the legal and permissible limits, such as giving the people their due respect, please don't worry yourself about what the people say.
Just carry on, those who don't understand you today may do so tomorrow, and if they don't, they will on the Day of Resurrection.
Just don't compromise your Deen because of the people, or kill yourself because of them.
But if you are evil and bad, what the people say about you may count. So always watch out.
May Allaah grant us safety.
