The I am moving to Philly could be a defence thing on his part for him to keep in check HIS emotions .....

I know I speak backwards.

Meaning he is reminding himself so he keeps you at bay.

He may like you more than he wants to ! I would go after him who says he has to move his job !