That's not a nice situation to be in. Remember as disappointing as it is, attraction is one of those undefined chemistry things where we either 'click' with someone romantically or we don't. It's not because you've done / not done anything, just he doesn't get the chemistry there.