Let him know that you feel he doesn't understand when he calls them excuses. And please, please never use it as an excuse - you might be caught and that could unravel everything.