No you didn't do anything wrong. It's possible that because you were so anxious you read too much into his tone. I think it's more likely he was just being direct and nothing more. Sometimes people are more terse over the phone, especially if they are busy and that can come off as aloof.