It's been a while since I've been on a plane. The thought of taking my kids on one, stresses me to no avail, so we haven't. Do you feel, entertaining your baby will be enough of a distraction from focusing on the anxiety?
I agree with others, just having things to keep yourself occupied/comfort items sounds like a good idea.
I am the opposite of an aisle person, I prefer the window, something about being able to look out of it, soothes me a bit.
I hope all goes well, for you