It goes away after a short while of taking it regularly and also dosage dependant.

Compared to some of the regularly proscribed benzos out there Buspar is pretty light weight.