Yes, you need to be cautious about it... there are a lot of creeps :/
If he ever does something that really creeps you out, or you think it's unsettling, you really need to get away from him.