Going with him will just give him false hope. If he's determined enough he will take any scrap of attention as an invitation to try again with you. Its best to just scrap the prom plans. Sounds cold but stringing him along (even if its not what you are intending) will only hurt him more.