Honestly, unless there was more to his reply than you are giving us, there is absolutely nothing in his reply that seems like he is annoyed with you. Is that just your fear at this moment?