Hey there.

I agree with Rose. I don't think he's confused so much as he is perhaps a little scared that you didn't return the sentiment. That's not to put it back on you or make it your fault or anything like that. It just may mean he truly does care for you, and is thus afraid you don't feel the same way. Were it me, he sounds like he did the same I would've done in the same situation.

I think it's a great thing you place so much value on that phrase. It's often overused or thrown out without a second thought. But do be mindful to not allow a respect for it to become guarding yourself from it.

My best,
Harley