It doesn't make a difference to me, when I wasn't attached it was no big deal, and now that I am attached it doesn't seem a big deal either.
Part of the reason for that might be that we never get into conversations via email. He usually sends me a few words by way of reply and occasionally doesn't reply at all. I probably care a little more about that than I used to, but for me, the lack of expectation of a reply stops it from feeling like an attachment thing.