Can you get breast cancer immediately after going off birth control because of the birth control? I went off it about 2 weeks ago and now I have this painful red lump on my left breast and I’m kind of freaking out. I’m only 26 though and I have practically no family history.