You're allowed to be frustrated, it can't be at all easy.

The only thing (and I know it sounds corny) is to hope that its only a phase and that he will eventually grow out of it (Well, not out of ADHD!).

(If I might ask) is he on medication for the ADHD?