Thanks justafriend for the explanation

After the physiotherapist mentioned I could remove it for lifting light stuff I followed her instructions.

I told the doctor today what physiotherapy mentioned and asked if I should stop wearing it completely. He told me all the above in original post.

I have a high pain tolerance and it's difficult for me to express it. The injury is from a tragic incident so maybe I'm a bit more sensitive now.