The idea of nerve damage came to my mind, too. The experience of numbness during yoga suggests that the numbness isn't limited to or groin.

If this continues, let your PCP know. Perhaps you'll get referred to a neurologist and undergo an EMG test or similar.