If your sensing red flags with him, I would end it. This is why I get nervous anytime a relationship moves on too quickly. I once was involved with someone who was very abusive towards me, but I won't get into further detail. If you sense something is off with him and your not comfortable, end it. Especially if you don't like him that much anyways. Good luck.