I feel this way if I ask a professional contact that I didn't make an extremely good impression with or that I don't feel has my best interests in mind.

If what you feel is similar, I wouldn't call it guilt or feeling like you're wasting people's time so much as being afraid of being let down by the people you ask.

I understand this feeling.