It doesn't sound like there's a connection there at all. I'd say just drop the guy, it's been less than a week. If you aren't feeling it now, you won't, no matter how much time goes by. And you're compromising your own comfort-zone, which is super not cool.

Dropping people can be awkward, I get that, especially if they're the reason. If you want, you can try to do it nicely, like use school as an excuse for not wanting to pursue things.

When I was younger, I always felt pressured into having sex with people immediately, concerned that the other person wouldn't want me unless I offered it. But I realized that got me no where because I was either getting used, I realized the guy was weird/creeper/not for me, or that there was no real connection. So I stopped. When I met husband, I told him I would not sleep with him until I knew we had something, and he completely respected me for it. We took things at a comfortable pace and got to know each other before making a physical connection (so a few weeks, it's not like it took forever, but long enough to know we were interested in each other). We both agreed that we're happy things went the way they did I'm just letting you know that. I'm not saying this works for everyone, but it certainly was our experience.