Just tell him you can't afford it right now. Then hang around someone else for a while. Someone positive.