I think you should follow your heart. If I were in your situation, I'd take the better job but that's just me.

Years and years ago I got a good job with good pay at a very large and still growing banking company. People were being promoted quickly and I was told right out the gate that I would go great places in the company. While I was still in training at this company another company I wanted to work with for years held a large career fair. I was offered a job with them making less money with less benefits....but something told me I should take the position. I typed up my resignation and gave compliments to the many trainers and managers. The company decided to pay me for the 2 weeks and said continuing training seemed pointless but they said they'd welcome me back with open arms if I decided to come back in the future....I was so worried I was making the wrong choice but went with my gut. 6 months after I took the new job, the bank went completely under due to the financial crisis and everyone in the company lost their job. I worked for the company I chose for 11 years and felt very grateful and lucky for making the switch.

Good luck with your decision.