What people say about you does not ultimately matter. What matters is what God will say about you.
Many people hated Jesus, and they sure let Him know it! If He thought taht His reputation among them was important, He would have never died for us, and would have become the Messiah that the Jews were hoping for, one who would conquer and destroy Rome and then rule the earth with an iron fist. It says in [Philippians 2:7] that Jesus made Himself "of no reputation", the lowest class of society. He was poor, homeless, "uneducated", as in never having attended formal education, worked the lower class job of carpentry, and was raised in one of the cities most notoriously known for its evil and wickedness, Nazareth.
Having these qualifications, not many people spoke highly of Him, until they finally got to know Him for who He truly was.
So don't fully trust man's opinion of you. Trust God's opinion of you, because man does not have a heaven or hell to send you to, only God does.