This can depend on perspective.

From A’s perspective, it might look as though B has given up on A.

But from B’s perspective, it might look as though A no longer wants B around. Consequently, B stays away.