It doesn't look all that immodest to me. As long as you're just wearing what you wear, not trying to look sexy for him or whatever--I'd assume he can tell the difference.