This is not a problem of lack of assertiveness, at least not in the way in which the word is usually conceptualized.

In terms of practical steps, therapy, as advised above, would really help you out,

Wishing you the best.