Your friend has got a problem with boundaries and sounds pushy and single minded. He may . not have the best social skills. If you feel like screaming when you are around him, then it seems like a good idea to take a break. I don't really understand why if you feel like screaming you can't raise what is bothering you with him.