I haven't ever had anyone say I was taking up too much of someones time. I have a couple of relatives that would like me to disappear.
I'm a frog of little brain so I am a little confused. There are 3 people in this scenario - you, the person who made the comment and the person that the comment was referring to.
I'm not sure I could give you any advice good, bad or otherwise. I know it gets you thinking. If you don't feel that you are spending to much time then perhaps it isn't that you spend too much time but that the other person (the one who made the comment) feels they are not getting enough.
Not very helpful, sorry

((((( Cthomas )))))

kebs