We are born into essential goodness, endowed with natural intuitions about what is good and worthy and what is not. This endemic moral capacity must then be trained deliberately and systematically to bring out its best in full maturity.
It is natural to want to be well-regarded by others, but you must gradually wean yourself from such dependence on the admiration or honor given or withheld by others.
Take your attention off of what you think other people think and off of the results of your actions. Defer instead to your original moral intuitions and follow them.