Really, I think it basically comes down to your gut feelings and if you see a better and brighter future in another area there. That you may actually like. You probably somewhat know the ins and outs of the different departments and how they flow. The people and personalities from each.
I always say, no matter what. Make sure that you have a backup plan if it doesn't work. So, you're covered!
I have had to make decisions like this. Where, I was basically on the fence. Stressing hard, go for what you think will be the best for you, in the long run!