Well, he might consider changing his workout time to avoid you, but odds are his time is scheduled pretty tight already. He shouldn't have to give up his health because you are infactuated with him.

You mentioned you are a mother. Are you a single mom? That must be a tough job for you, as well. TC!