Your own opinion of yourself is what really matters. Just do the job and trust yourself to do it. Is there gossip in the work environment that you are aware of?