You are in a very bad work situation, and you are being bullyed by your co-workers, and your being controlled by them. Time to look for anther job. You can not change them. It is not your fault.