If you have the funds to fly across country to go visit him for the weekend, so that you can also check out his city and see if you'd even want to move there for a change (I don't know your work situation), you should go for it. Life is too short.
Normally, I am a naysayer with rebounds b/c of my own personal bad experience being the rebound for a guy who doesn't want to commit to me but just use me as an 'in-between' woman. But if you like this guy and just want to have fun with no plans to commit to anything, then why not see if he's up for a long-distant fling?