Welcome to psychcentral! It is always a persons perogative to say no, whether it's always been ok or not! Maybe by writing down your feeings about this will help you find the words next time? And if that doesn't work, then write them TO him and let him read them. If he still plays dumb, then I would tell him NO permanently! You gotta take care of YOU, and right now it sounds like you need extra care. Be well.