I also am hearing impaired and rely on lipreading, especially for consonant sounds. I can tell it unnerves some people, so if I notice that happening, I will explain why I do that.

It is a good question to ask her and talk about how you feel about it. Or have you asked already and that's how you know he isn't hard of hearing?