With me it was probably just after a week, but we had chemistry and everything.
I think a good time would be when you are comfortably in showing him your body without feeling that he will make fun of you and/or when your hormones override your common sense, whichever comes first.