I think it is fine as long as the relationship is going strong other wise.... just try your best to ignore your families comments and if nothing else tell them its none of their business - and do it straight to their face.