Maybe you are one of his last friends from school because he's burned everyone else borrowing from them.
You have the right to respond to calls and texts when it suits you. Answer if/when you feel like it.
As for the ongoing requests for money, why not outright tell him you don't lend people money, period.