It's surprising about how the smallest things can mean so much, and be so important to us when they start holding symbolic value. I think you're on the right track, and maybe him not caring about it is "breaking" your connection with it?