You could be seen as controlling under other circumstances. Boyfriends and spouses ought to be able to have friends and go out to do things with them. But in this case, I am wondering, too, if this guy is really the one for you. You might really just be clinging to him for fear of being alone.
I suggest you start going out yourself to public places and meet other people. Try to have fun. If you struggle with that, then you might want to talk to a therapist to get support and advice, too.