It sounds like you have answered your question in your own post. that doesn't make you a terrible person though. just someone who isn't being conscious of his own actions. try listening to your friends more and not pushing them away if you want to keep them.