If you want something, go for it! Sure, he may be a little gun shy because of your ex, but it could also be that he doesn't know how to read you either. I suggest going for drinks again, and see how it goes.