You should never let fear be a deterrent to pursuing, accepting, feeling or expressing love. There can be no greater self-sabotage than to deny love. And yes, of course, this includes letting yourself love yourself, and letting go of any and all attitudes that get in the way. And unconditionally granting and supporting everyone else’s right and need for self-love.
All types and degrees of fear can be eliminated, for instance through the Therapeutic Spiritual Counseling techniques of shock resolution and spiritual digestion. And this most definitely should be done. But whatever it takes, fear must not be permitted to sabotage your life.