I would say that friendships are about having a connection with someone else as a person. So try not to look at the diagnosis and ask yourself how strong the connection is between you. It may be that he is likes to do things on impulse but if this does not suit you and leaves you anxious then you need to communicate that to him. Good relationships are built on good communication.