I know the feeling of not wanting to let go since there's no one else. However, if that person, even after honestly telling him your feelings, still continues to make you feel bad, I'd consider letting him go. It's hard so take your time to think about it. Try to imagine what life without him would be like. Which is worse, being with him and being criticized or being alone but at peace? In my case, I chose the latter one after thinking for a long long time. I got hurt so many times before I let go. Now, I'm better off without him.