That was very unprofessional, but I have seen doctors like this. They seem to think patients are specimens that don't need bedside manner. It sounds to me like the doctor was just thinking random thoughts and vocalized it.

But I am here because of the same reasons. I have anxiety because I constantly think I am going to develop an illness. As soon as I see one little symptom, I start to imagine many others until I convince myself there is something wrong. A few years ago I felt ill, and it was all just stress and depression causing muscle aches, etc. But during one of my many doctor visits, and after running a few standard tests, that doctor says "well maybe it's cancer". Yes, just like that. As if he were talking about a cold. I openly freaked out and went into a panic in his office. He then realized what he had said and back tracked saying that he was just thinking out loud and that it was very unlikely that I had cancer. I obviously had a very bad few months after that of waking up with anxiety believing I was going to die. After some time I realized what the anxiety was doing to me and when I settled down, so did the symptoms. I never went back to that doctor again.
But you can't just let that make you feel that this means something horrible. Go get seen by another doctor for your own peace of mind.