I wonder if it is not confidence as such but the way you look at setbacks and what people say?

You have plenty of experience you say so will know that things will go wrong from time to time and people won't always comment helpfully all the time.

Perhaps you are being quite hard on yourself? I am pretty sure you could be a little more sympathetic with yourself.