Always be wary of people who are controlling. It doesn't sound like he wants you back per say, it sounds more that he wants someone around to boss around and he probably doesn't like the fact that YOU ended things. Like a previous poster suggested, block him in every way you possibly can and if he's still hanging around get a restraining order.