I say go ahead and write him. life is too short and he probably made that trip to see you because he is interested in you to some degree. it seems like the trip was like an investment of kindness towards you. still, play safe if your heart says.