Been there done that, unfortunately more than once (because I'm stupid and it took me awhile to learn my lesson) -- it is never a good idea. One of you always ends up getting hurt or feeling used. You're worth more than casual physical relationships. Keep telling yourself that.