Your Dr. didn't even taper you off it, so it is definitely withdrawal.

You could be having problems for quite some time, unless you reinstate it.