I think you just aren't that into him. I would just break it off, personally. Sometimes people seem great on paper and are really into us, but the chemistry just isn't there. If you are having doubts just six weeks in, don't over think it, just tell him it's not working.