Replace it with something else. At the time when you called him, now do instead: watch tv show, shopping, talk to someone else instead, clean, read a book, cook