I think what you didn't say was spoken even though it was unspoken. If you are offended by it, then you have a personal reason to be offended, (one would think).