No, it doesn't sound stupid at all (the way you feel). You could ask him if he's playing mind games. Though I suppose if he were, you wouldn't get a straight answer. Regardless of the type of relationship, I think mind games are not a good thing. I would end it.