Your doctor may be right in the thought that you might not be contagious at this point.
Just reading this along with a couple other sites makes it sound like unless you shared a moist towel there's perhaps not much to worry about?
Warts (for Parents)